CNKI translator proxy error

l0o0 · October 12, 2019

I user proxy to access CNKI. The website will redirect to https://kns-cnki-net-s.vpn2.njau.edu.cn/kns/brief/default_result.aspx, "kns-cnki-net-s.vpn2.njau.edu.cn" is the proxy URL suffix. Without a proxy, the URL is https://kns.cnki.net/kns/brief/default_result.aspx. I have change the target in CNKI.js translator from "^https?://([^/]+\\.)?cnki\\.net" to "^https?://kns". The target works fine, I can see "Save to Zotero (CNKI) " when I open the CNKI URL in Firefox. But an error appears "An error occurred saving with CNKI. Attempting to save using Save as Webpage instead.". In error report I found a message "[JavaScript Error: "HTTP POST http://epub.cnki.net.s.vpn2.njau.edu.cn/kns/ViewPage/viewsave.aspx?TablePre=SCDB failed with status code 404"]".

The post URL is added a proxy suffix. I don't know why the correct URL wrote in CNKI.js is changed after proxy?

l0o0 · October 12, 2019

The correct URL in CNKI.js is "http://epub.cnki.net/kns/ViewPage/viewsave.aspx?TablePre=SCDB".

l0o0 · October 12, 2019

I have tested CNKI.js in Zotero Scaffold. It works fine in scaffold.

zuphilip · October 14, 2019

That seems to be a proxy problem. @dstillman can you have a look at this?

dstillman · October 15, 2019

I have change the target in CNKI.js translator from "^https?://([^/]+\\.)?cnki\\.net" to "^https?://kns".

You shouldn't do that, and we can't debug this as long as you're using a modified version of the translator. When the proxy is set up correctly, Zotero will automatically compare the target to the unproxied address.

You should reset your translators in Zotero, reset translators in the Zotero Connector, and try again. If you're still having trouble, we'd want to see a Debug ID from the Zotero Connector for loading the page when it doesn't show "Save to Zotero (CNKI)".

Also, what are the relevant proxy entries in the Proxies tab of the Zotero Connector preferences?

l0o0 · October 15, 2019

I have reset CNKI translator. After saving a cnki paper to zotero, I submit a debug 1904688957.

This is the debug output. https://send.firefox.com/download/4b84e9808e5d4ce4/#g4EmTtvDR7iBouV8-ska6A

And also, Could you show me some proxy config examples? @dstillman

dstillman · October 15, 2019

That's a Report ID. We need a Debug ID, and we need it from the Zotero Connector for loading the page, not from Zotero. Don't share the debug output directly.

l0o0 · October 15, 2019

Sorry for the mistake, the debug id is D1086698938

dstillman · October 15, 2019

That's still from Zotero, not the Zotero Connector.

l0o0 · October 15, 2019

The Debug ID is D2041426036.

dstillman · October 15, 2019

That doesn't show the loading of a relevant page.

l0o0 · October 15, 2019

How about this, The Debug ID is D1359644785.

dstillman · October 15, 2019

OK, that was right, but it shows the CNKI translator being detected, so either you have a working proxy entry already or that's with your custom version of the translator with the modified target. The goal here is for you to set up a proxy entry so that the current version of the translator detects via your proxy, which you said wasn't happening. (Any other fixes to the translator would happen separately.)

In any case, the proxy you're using has a weird format — the s after the original hostname is non-standard, at least for EZproxy installations — but you can try creating two proxies, one with %h-s.vpn2.njau.edu.cn/%p for the scheme and another with %h.s.vpn2.njau.edu.cn/%p. Make sure "Automatically associate new hosts" is enabled for both and "Automatically convert between dots and hyphens in proxied hostnames" is enabled for the first one. It should then automatically add the ckni.net hostnames when you load them through the proxy (or you can enter them manually (e.g., kns.cnki.net) in the bottom section.

l0o0 · October 15, 2019

I have set the proxy config in zotero connector. A Zotero proxy message pop up when I search in CNKI, but there is still an error when saving page. The Debug ID is D645124199.

The proxy setting:
proxies.proxies [{"id":1571127989363,"autoAssociate":true,"scheme":"%h-s.vpn2.njau.edu.cn/%p","hosts":["https://kns-cnki-net-s.vpn2.njau.edu.cn/","www.cnki.net","kns.cnki.net"],"dotsToHyphens":false},{"id":1571129610032,"autoAssociate":true,"scheme":"%h.s.vpn2.njau.edu.cn/%p","hosts":[],"dotsToHyphens":false}]

l0o0 · October 15, 2019

I have ignored the dotsToHyphens setting. After updating proxy
[{"id":1571127989363,"autoAssociate":true,"scheme":"%h-s.vpn2.njau.edu.cn/%p","hosts":["https://kns-cnki-net-s.vpn2.njau.edu.cn/","www.cnki.net","kns.cnki.net"],"dotsToHyphens":true},{"id":1571129610032,"autoAssociate":true,"scheme":"%h.s.vpn2.njau.edu.cn/%p","hosts":[],"dotsToHyphens":false}]

The Debug ID is D611557844. @dstillman

dstillman · October 15, 2019

(3)(+0000001): Translate: resolving URL http://epub.cnki.net/kns/ViewPage/viewsave.aspx?TablePre=SCDB

(3)(+0000001): Translate: resolved to http://epub.cnki.net/kns/ViewPage/viewsave.aspx?TablePre=SCDB

(3)(+0000005): Translate: proxified to http://epub.cnki.net-s.vpn2.njau.edu.cn/kns/ViewPage/viewsave.aspx?TablePre=SCDB

OK, so that's detecting now, but Zotero won't be able to re-proxy an non-HTTPS URL given your unusual proxy scheme. Since this was on an HTTPS URL, it uses that proxy entry and tries to add back the -s, but that's not valid for HTTP URLs through your proxy. I'm not sure why your proxy uses that weird scheme, but if the translator can be modified to use the same scheme (HTTP or HTTPS) as the original page — which it should do anyway if possible — it should build a correct URL for you.

l0o0 · October 15, 2019

Thank you for your help @dstillman . Maybe I can try to fix this problem. I am quite confused by the proxy setting. Are there any documents about that?

dstillman · October 15, 2019

The proxy setting isn't really the thing to worry about. The translator should just use HTTPS URLs when it's on an HTTPS page.

johnmy · November 2, 2019

@l0o0 Has this problem been solved?

l0o0 · November 6, 2019

@johnmy This problem has been solved.

l0o0 · November 20, 2019

@dstillman Hi, I have problems to access the web via VPN. By your instruction above, I add a proxy setting `%h.vpn2.njau.edu.cn/%p`, "Automatically associate new hosts" and "Automatically convert between dots and hyphens in proxied hostnames" are both checked.
The url without proxy:
http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=10.1111%2Fbjd.18291
The url with proxy:
https://www-wanfangdata-com-cn.vpn2.njau.edu.cn/details/detail.do?_type=perio&id=10.1111%2Fbjd.18291

I have sent a bug report 349697958 from Zotero Connector. Is there any wrong with my proxy setting?

dstillman · November 22, 2019

Continued: https://forums.zotero.org/discussion/80170/proxy-redirect-error