User:Furey/Interwiki Status - Revision history

Furey: add to admin whitelist: uncyclopedia, zeldapendium, zeldawiki

2024-07-08T16:47:01Z

add to admin whitelist: uncyclopedia, zeldapendium, zeldawiki

Furey: /* Interwiki Status */ start a log, because this sweep is taking some time. add todo for admin whitelist for zeldapendium, uncyclopedia

2024-07-08T16:42:18Z

‎Interwiki Status: start a log, because this sweep is taking some time. add todo for admin whitelist for zeldapendium, uncyclopedia

Furey: /* Interwiki Status */ down to 506 interwiki entries

2024-06-29T21:54:29Z

‎Interwiki Status: down to 506 interwiki entries

Furey: Copy edit.

2024-06-29T08:54:49Z

Copy edit.

Furey: Move whitelist here. Update stats. Some copy editing.

2024-06-28T20:21:53Z

Move whitelist here. Update stats. Some copy editing.

Furey: api for interwiki backlinks: it's there, but it misses some backlinks

2024-06-26T17:38:09Z

api for interwiki backlinks: it's there, but it misses some backlinks

Furey: /* Letter by letter */ (other first character) complete

2024-06-26T17:24:00Z

‎Letter by letter: (other first character) complete

Furey: /* Letter by letter */ 'x' 'y' 'z' complete

2024-06-26T16:52:26Z

‎Letter by letter: 'x' 'y' 'z' complete

Furey: /* Keep these for now (w) */ wikipedia is "unsearchable"

2024-06-26T14:40:11Z

‎Keep these for now (w): wikipedia is "unsearchable"

Furey: /* Letter by letter */ 'w' completed

2024-06-26T14:18:52Z

‎Letter by letter: 'w' completed

@@ Line 9: / Line 9: @@
 The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I have reported 573 entries, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to 104 (plus any entries that the admins choose not to remove). If we do more phases, we will need more sophistication and better tools.
-''todo: zeldapendium (admin whitelist), uncyclopedia (admin whitelist)''
+= Timeline =
 We started with 679 entries.
@@ Line 90: / Line 88: @@
 * wiktionary
-And some requested by editors for keeping:
+And some requested by admins for keeping:
 * zeldawiki

@@ Line 3: / Line 3: @@
 https://nethackwiki.com/wiki/Special:Interwiki
-I recently found 3 links in [[NetHackWiki:policy]] pointing to an ad farm for Vietnamese casinos and sports gambling. They were interwiki links, and the domain had transferred to a cybersquatter.
+In June 2024, I found 3 links in [[NetHackWiki:policy]] pointing to an ad farm for Vietnamese casinos and sports gambling. They were interwiki links, and the domain had transferred to a cybersquatter.
 Also wikia.com is a reputable site but they serve a lot of ads which leads to a poor reader experience. It would be good to replace wikia links to wikipedia or to independent wikis. After all, NetHackWiki is an independent wiki.
-The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I am working on phase 1, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to about 100. If we do more phases, we will need more sophistication and better tools.
+The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I have reported 573 entries, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to 104 (plus any entries that the admins choose not to remove). If we do more phases, we will need more sophistication and better tools.
-We started with 677 entries. As of June 29, 2004, we have 506 interwiki entries.
+''todo: zeldapendium (admin whitelist), uncyclopedia (admin whitelist)''
 = Learnings =

@@ Line 9: / Line 9: @@
 The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I am working on phase 1, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to about 100. If we do more phases, we will need more sophistication and better tools.
-We started with 677 entries. As of June 29, 2004, we have 553 interwiki entries.
+We started with 677 entries. As of June 29, 2004, we have 506 interwiki entries.
 = Learnings =

@@ Line 9: / Line 9: @@
 The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I am working on phase 1, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to about 100. If we do more phases, we will need more sophistication and better tools.
-We started with 677 entries. As of June 28, 2004, we have 555 interwiki entries.
+We started with 677 entries. As of June 29, 2004, we have 553 interwiki entries.
 = Learnings =
@@ Line 15: / Line 15: @@
 Wikia links turn into "not a valid community", but they do not turn into ad farms or browser hijacking sites.
-Indy links can turn into ad farms or browser hijacking sites. Use protection when checking an indy link. So far:
+Indy links can turn into ad farms or browser hijacking sites. Use protection when checking an indy link. In phase 1, I found:
 * casino and sports gambling ad farm in Vietnamese
 * casino ad farm in German
@@ Line 22: / Line 22: @@
 Mediawiki search syntax allows search by word, which is useless for a lot of common words. It takes an admin or maybe even a sheller to do regexp searches for "[[foo", "foo:", or "[foo:".
-A good test for a regexp search (or some other approach) is whether they find everything in my whitelist (hand-constructed, under construction).
+A good test for a regexp search (or some other approach) is whether they find everything in my hand-constructed whitelist.
 Several very early pages have references to external pages as policy guides. This caused the problem with [[NetHackWiki:policy]] above. It would be good to regexp search the whole wiki for interwiki links and then rewrite some of those links. I bet some of them could be just plain wikipedia links.
@@ Line 28: / Line 28: @@
 If a page uses a non-existent interwiki link,then that link will show up in https://nethackwiki.com/index.php?title=Special:WantedPages&limit=5000&offset=0 . Just look for Furey:xyzzy and see how it got into the table. Basically, an interwiki reference without a table entry becomes a redlink and goes into WantedPages. However, WantedPages is not enough to find these, because of the link table staleness issue mentioned below.
-We do not have a process for handling bluelinks in ancient discussion pages. Something like nowiki would help.
+We do not have a process for handling bluelinks from user pages. Something like nowiki would help.
 It would be good to make a NetHackWiki page with an intro to interwiki and a list of interwiki links. Then about once per month someone goes through the list, syncs it with the ground truth of the interwiki prefix table, and then clicks every link, looking for any sites that have disappeared, moved, or shifted to ad farms.
@@ Line 49: / Line 47: @@
 = Whitelist =
-Here are some prefixes I have found in use:
+Here are some prefixes I have seen in actual use:
 * Wikihack
 * clubpenguin

@@ Line 5: / Line 5: @@
 I recently found 3 links in [[NetHackWiki:policy]] pointing to an ad farm for Vietnamese casinos and sports gambling. They were interwiki links, and the domain had transferred to a cybersquatter.
-We started with 677 interwiki entries. The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I am working on phase 1, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to about 100. If we do more phases, we will need more sophistication and better tools.
+Also wikia.com is a reputable site but they serve a lot of ads which leads to a poor reader experience. It would be good to replace wikia links to wikipedia or to independent wikis. After all, NetHackWiki is an independent wiki.
-As of June 24, 2004, we have 591 interwiki entries.
+The table was dormant from the Wikia move up to June 2024. We can safely delete a large number of these, preventing future problems. I am working on phase 1, where we go letter-by-letter and delete easy cases. Phase 1 will take us down from 677 to about 100. If we do more phases, we will need more sophistication and better tools.
-Q: what if we delete an entry someone is using?
+We started with 677 entries. As of June 28, 2004, we have 555 interwiki entries.
 = Learnings =
@@ Line 27: / Line 25: @@
 Several very early pages have references to external pages as policy guides. This caused the problem with [[NetHackWiki:policy]] above. It would be good to regexp search the whole wiki for interwiki links and then rewrite some of those links. I bet some of them could be just plain wikipedia links.
 We do not have a process for handling bluelinks in ancient discussion pages. Something like nowiki would help.
 We could use a page with a whitelist of monitored interwiki links and then someone goes and clicks all of them a few times per year. I am working on a whitelist but am hampered by lack of regexp searching.
 = api for interwiki backlinks =
@@ Line 44: / Line 46: @@
 If the iwlinks table were up to date, then https://nethackwiki.com/api.php?action=query&list=iwbacklinks&prop=info&iwblprop=iwprefix|iwtitle&iwbllimit=500 would be very useful. (Even more useful with a limit of 5000 instead of 500). As it is, I do not trust iwbacklinks because it did not find clubpenguin at all, it missed one of the emacswiki pages, and it is still missing the interwiki prefix from my third example.
 = Letter by letter =

← Older revision		Revision as of 17:24, 26 June 2024
Line 37:		Line 37:

	= Letter by letter =		= Letter by letter =
		+
		+	== Safe to delete (other first character) ==
		+
		+	{\|class="wikitable mw-collapsible mw-collapsed"
		+	\|+
		+	! Prefix
		+	! URL
		+	! Uses
		+	! Site status
		+	! Comments
		+	\|-
		+	\| 3dgame \|\| http://3dgame.wikia.com/wiki/$1 \|\| 0 \|\| Not a valid community \|\| -
		+	\|-
		+	\| AwarenessWiki \|\| http://taoriver.net/aware/$1 \|\| 0 \|\| ERR_ADDRESS_UNREACHABLE \|\| -
		+	\|-
		+	\| Legowiki \|\| http://www.object-arts.com/wiki/html/Lego-Robotics/$1 \|\| 0 \|\| ERR_TIMED_OUT \|\| -
		+	\|}
		+
		+	== Keep these for now (other first character) ==
		+
		+	{\|class="wikitable mw-collapsible mw-collapsed"
		+	\|+
		+	! Prefix
		+	! URL
		+	! Uses
		+	! Site status
		+	! Comments
		+	\|-
		+	\| Cache \|\| http://www.google.com/search?q=cache:$1 \|\| unsearchable \|\| operational \|\| -
		+	\|-
		+	\| Wikihack \|\| http://nethackwiki.com/wiki/NetHackWiki:$1 \|\| unsearchable, 2+ known uses \|\| operational \|\| we have 2+ <nowiki>[[Wikihack:xxx]]</nowiki> links!
		+	\|}

	== Safe to delete (x), (y), and (z) ==		== Safe to delete (x), (y), and (z) ==

← Older revision		Revision as of 16:52, 26 June 2024
Line 37:		Line 37:

	= Letter by letter =		= Letter by letter =
		+
		+	== Safe to delete (x), (y), and (z) ==
		+
		+	{\|class="wikitable mw-collapsible mw-collapsed"
		+	\|+
		+	! Prefix
		+	! URL
		+	! Uses
		+	! Site status
		+	! Comments
		+	\|-
		+	\| xao \|\| http://XAO.wikia.com/wiki/$1 \|\| 0 \|\| Not a valid community \|\| -
		+	\|-
		+	\| ypsieyeball \|\| http://sknkwrks.dyndns.org:1957/writewiki/wiki.pl?$1 \|\| 0 \|\| ERR_TIMED_OUT \|\| -
		+	\|-
		+	\| zeldapendium \|\| http://www.zeldapendium.de/wiki/$1 \|\| 0 \|\| operational \|\| german
		+	\|-
		+	\| zeldawiki \|\| http://zeldawiki.org/$1 \|\| 0 \|\| operational \|\| -
		+	\|-
		+	\| zemirot \|\| http://zemirotdatabase.org/view_song.php?title=$1 \|\| 0 \|\| operational \|\| -
		+	\|-
		+	\| zhmusic \|\| http://zh.music.wikia.com/wiki/$1 \|\| 0 \|\| operational \|\| chinese
		+	\|-
		+	\| zwiki \|\| http://zwiki.org/$1 \|\| 0 \|\| zwiki.org link broken #6 \|\| -
		+	\|}
		+
		+	== Keep these for now (x), (y), and (z) ==
		+
		+	{\|class="wikitable mw-collapsible mw-collapsed"
		+	\|+
		+	! Prefix
		+	! URL
		+	! Uses
		+	! Site status
		+	! Comments
		+	\|-
		+	\| x-files \|\| http://x-files.wikia.com/wiki/$1 \|\| unsearchable \|\| operational \|\| -
		+	\|-
		+	\| zh.anime \|\| http://zh.anime.wikia.com/wiki/$1 \|\| unsearchable \|\| operational \|\| chinese
		+	\|-
		+	\| zh.mac \|\| http://zh.mac.wikia.com/wiki/$1 \|\| unsearchable \|\| operational \|\| chinese
		+	\|-
		+	\| zh.wikimac \|\| http://zh.mac.wikia.com/wiki/$1 \|\| unsearchable \|\| operational \|\| chinese
		+	\|-
		+	\| zzz wiki \|\| http://wiki.zzz.ee/index.php/$1 \|\| unsearchable \|\| ERR_CONNECTION_REFUSED \|\| -
		+	\|}

	== Safe to delete (w) ==		== Safe to delete (w) ==

@@ Line 155: / Line 155: @@
 | wikinfo || http://www.wikinfo.org/index.php/$1 || 2 || wikinfo exists but rearranged site || we have 2 <nowiki>[[wikinfo:xxx]]</nowiki> links!
 |-
-| wikipedia || http://en.wikipedia.org/wiki/$1 || many || operational || we have many <nowiki>[[wikipedia:xxx]]</nowiki> links!
+| wikipedia || http://en.wikipedia.org/wiki/$1 || unsearchable, many || operational || we have many <nowiki>[[wikipedia:xxx]]</nowiki> links!
 |-
 | wikt || http://en.wiktionary.org/wiki/$1 || 1 || operational || we have 1 <nowiki>[[wikt:xxx]]</nowiki> links!

@@ Line 78: / Line 78: @@
 | wikible || http://www.wikible.org/en/$1 || 0 || (sketchy site with a popup asking me to install a browser extension) || (expedited deletion requested) use protection if you visit this site.
 |-
 |}
@@ Line 98: / Line 147: @@
 | wikia || http://www.wikia.com/wiki/$1 || unsearchable || main page of fandom.com || -
 |-
 |}