Zotero usage with Firefox Prox Manager (Foxy Proxy) or Proxy Automatic Configuration File (pac) file
Hello,
I have been using firefox extension foxy proxy for a long time to access institutionaly to the digital libraries. I used to use Zotero along with it. For example to access ieexplore, I have a configuration in the foxy proxy which detects the site and activates the proxy. The digital library sites become institutional access and let to access pdf versions of the papers.
Zotero used to not care the changes in the proxy and download the pdf paper without problem. Nowadays when proxy is activated by foxy proxy, Zotero connector is losing connection with Standalone Zotero application. Why?
How can I make Zotero use the proxy defined by the Firefox Proxy Manager (Foxy Proxy)?
I am using manjaro linux. There is no predefined system proxy in the OS level. Only gateway etc. is defined for the network connection. Any help is much appreciated.
I have been using firefox extension foxy proxy for a long time to access institutionaly to the digital libraries. I used to use Zotero along with it. For example to access ieexplore, I have a configuration in the foxy proxy which detects the site and activates the proxy. The digital library sites become institutional access and let to access pdf versions of the papers.
Zotero used to not care the changes in the proxy and download the pdf paper without problem. Nowadays when proxy is activated by foxy proxy, Zotero connector is losing connection with Standalone Zotero application. Why?
How can I make Zotero use the proxy defined by the Firefox Proxy Manager (Foxy Proxy)?
I am using manjaro linux. There is no predefined system proxy in the OS level. Only gateway etc. is defined for the network connection. Any help is much appreciated.
Basically, 127.0.0.1 needs to be excluded from any proxying (which it should be by default in any reasonable proxy system).
Zotero will use a system-wide proxy when one is configured.
When you use a web-based proxy, the Zotero Connector passes the proxied URL and the cookies that give you access to the file on to Zotero, which then performs the download.
But if you're just selectively sending some requests to an HTTP proxy within Firefox, neither of those apply — there's no system proxy for Zotero to use, and there are also no proxied URLs and cookies.
The standard approach here is a system-wide PAC file that tells clients whether to use a configured proxy for specific domains. Zotero will use a PAC file if one is installed.
I have come up with following proxy.pac file which I tested with pacparser package in manjaro.
function FindProxyForURL(url, host)
{
if (
dnsDomainIs(host, "ieeexplore.ieee.org") ||
dnsDomainIs(host, "www.scopus.com") ||
dnsDomainIs(host, "onlinelibrary.wiley.com") ||
dnsDomainIs(host, "link.springer.com") ||
dnsDomainIs(host, "sciencedirect.com") ||
dnsDomainIs(host, "dl.acm.org")
)
{
return "HTTP ip:port"
}
else
{
return "DIRECT";
}
}
Now, I really need to find a way to deploy this to zotero. How can I do that? At https://forums.zotero.org/discussion/66667/zotero-5-proxy-configuration-via-pac-file-failure-to-authenticate-regression, I have seen following parameters
Network.proxy.type = 2 (Proxy auto-configuration PAC)
Network.proxy.autoconfig_url pointing to my PAC file
signon.autologin.proxy = true
which I have set. But zotero still does not download gated files. With system wide proxy setup, zotero did ask me username and password, but with pac file, I have not been asked username and password.
I have not seen any documentation relavant to pac file in zotero documentation, but also I can not find description of proxy relevant hidden parameters.
https://www.zotero.org/support/preferences/hidden_preferences
The same file is being honored with firefox. I switched to using this file instead of foxyproxy extension and it is working. Firefox asks the username password once and if saved, it does not ask username and password anymore and keeps working.
I expect the very same behaivor from zotero but it does not work.
If you're not seeing that happen, can you generate debug output for Zotero startup by going to Help → Debug Output Logging → "Restart with Logging Enabled…", submit the output, and provide the Debug ID here?
The content of the setting is as follows: https://www.acm.org,https://www.ebscohost.com,https://www.sciencedirect.com,https://ieeexplore.ieee.org,https://www.jstor.org,http://www.ovid.com,https://link.springer.com,https://www.tandfonline.com,https://dl.acm.org,https://onlinelibrary.wiley.com
Since this thread, https://forums.zotero.org/discussion/comment/408292#Comment_408292 is closed, I need to repeat the my question here to properly summarize the current condition and find a solution.
My post at above link (edited, enhanced below) has stated as follows.
-----
I need to use proxy server of my institution for certain electronic libraries. However I do not want to use system wide settings since it affects all connections to internet. I would like to continue my high speed internet for daily things and use proxy server to access electronic libraries.
I can do this with firefox via proxy automatic configuration file as described below links
https://support.mozilla.org/en-US/kb/connection-settings-firefox
https://en.wikipedia.org/wiki/Proxy_auto-config
I would like to be able to do the same with zotero as I can do in firefox by using proxy automatic configuration file.
I have following pac file (.mypacfile) working perfectly with firefox. (ip address and port number are disguised). Firefox automatically uses defined proxy for following urls and I can see that the sites are notifying me, my institutional access. I can download gated articles without problem manually from firefox.
function FindProxyForURL(url, host)
{
if (
dnsDomainIs(host, "ieeexplore.ieee.org") ||
dnsDomainIs(host, "scopus.com") ||
dnsDomainIs(host, "onlinelibrary.wiley.com") ||
dnsDomainIs(host, "link.springer.com") ||
dnsDomainIs(host, "sciencedirect.com") ||
dnsDomainIs(host, "dl.acm.org") ||
dnsDomainIs(host, "webofscience.com") ||
dnsDomainIs(host, "dblp.org") ||
dnsDomainIs(host, "orcid.org") ||
dnsDomainIs(host, "turcademy.com") ||
dnsDomainIs(host, "clarivate.com") ||
dnsDomainIs(host, "spiedigitallibrary.org") ||
dnsDomainIs(host, "siam.org" )
)
{
return 'PROXY IP:PORT';
}
else
{
return 'DIRECT';
}
}
To be able to use this in zotero, by looking at old post and googling, I have made following changes to zotero configuration.
Network.proxy.type = 2 (Proxy auto-configuration PAC)
Network.proxy.autoconfig_url = file:///home/user/.mypacfile
signon.autologin.proxy = true
I can not still download the gated articles for electronic libraries even though my institution has access to them. I can download manually with firefox.
What am I missing? Are my settings correct, are there any other parameters to be corrected? Is this achievable in Zotero? Any help much appreciated.
----
Debug id is D1906092782.
Since you objected to any other post, insisted to continue in this long post, and threaten me for banning from the forum and deleted my other post, I kindly would like you to answer following questions since I have not been able to find complete clear information about this elsewhere. I am asking these for reference in the same position like me. At least interested parties should find a complete information somewhere in this post.
1. Could you please point out also the correct text book settings to achieve pac file proxy configuration, and anything missing, wrong in my setup based on above description.
2. I have not been able to find description of full list of zotero advanced configuration parameters. They are partly available in zotero web site. I presume they are the same as firefox since names are the same. Could you verify this or point out a documentation of these parameters.
I would like to also point out that I have been using zotero for almost I believe 7 years. I was a paid customer for I guess three years. I have been promoting zotero amongs other competing systems for years, even I introduced, thought zotero to university students. I have post very seldom in this forum and always use proper language.
I really want you to know that I am very very offended about your treatment.
Thanks.
Zotero uses the Firefox proxy system, and nothing has changed about this in Zotero in years, so this is simply a continuation of your original issue above.
We'll take a look at your Debug ID.
extensions.zotero.proxyAuthenticationURLs
being tried are in your PAC file: Zotero will only try a subset of the hosts there at each startup to trigger a proxy authentication prompt, so you should remove the ones that you're not handling.