Jenkins slave's environment variables on Ubuntu

I failed to set environment variables on a Jenkins slave running ssh on Ubuntu.
Adding EXPORT's to ~/.bashrc didn't work even though it works for interactive logging-in.
Creating ~/.pam_environment and adding environment variables successfully sets them even though it doesn't work for interactive logging-in.
So, I use both ~/.pam_environment and ~/.bashrc.