Editing Talk:CopyPatrol

{{talk}}
<div style="text-align:center; margin:10px 0 20px">'''NOTE:''' This page may not be regularly checked. If you need prompt attention from the maintainers please ping a member of [[meta:Community Tech|Community Tech]].</div>

{{/Archive box}}
__TOC__
{{User:MiszaBot/config
|archive = Talk:CopyPatrol/Archives/%(year)d
|algo = old(90d)
|counter = 1
|minthreadsleft = 5
}}

== [[en:User:EranBot/Copyright/User whitelist|User whitelist]] ==

Is that list still working? Cause [https://copypatrol.toolforge.org/en/?id=105154475 this] came in. [[User:1AmNobody24|<span style="border:1px solid black;padding:1px;background-color: #4D4DFF;color: white">Nobody</span>]] ([[User talk:1AmNobody24|<span style="color: #4D4DFF">talk</span>]]) 09:52, 22 December 2023 (UTC)

:Sometimes things slip through; I don't know why. [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 15:35, 26 December 2023 (UTC)

== Is copy patrol down? ==

only 4 cases going back quite some hours [[User:L3X1|<small>en</small>L3X1]] ¡‹[[User talk:L3X1|delayed reaction]]›¡ 21:34, 25 December 2023 (UTC)

:I'm not seeing any significant gaps, just a general slowdown. I guess people had something else to do on Christmas Day. [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 15:34, 26 December 2023 (UTC)

== New CopyPatrol is live ==

I'm thrilled to announce the new version of CopyPatrol is now live at https://copypatrol.wmcloud.org. All existing links should redirect to the right place. Please join me in thanking @[[User:JJMC89|JJMC89]] for his tremendous help in this effort. He probably deserves most of the credit here, but certainly ''all'' of it for the backend that he completely rewrote from scratch. The new backend should be much more resilient, with the sporadic downtime that we occasionally see hopefully being a thing of the past. In addition, the new frontend offers a number of new features:
* Significant performance improvements
* Edit summaries, change tags, and diff sizes
* "Undo" or "revdel" links for users who have the requisite permissions

One notable change you might see is that the iThenticate reports no longer include the crawl date. Unfortunately this is outside our control. The Turnitin product team has been made aware of this feature request, so we hope it will eventually be reinstated.

Please let myself or JJMC89 know of any issues you see. At the time of writing, the backfill script is still running, so many older reports are missing. They should all be restored in due time. Additionally, we're still ironing out integration with [[mw:Extension:PageTriage]]. We'll mark [[phab:T333724]] as resolved once all of the aforementioned has been completed.

This release also marks the conclusion of a formal agreement with Turnitin. This has been in the works since at least ''May 2022''. Turnitin has been kind enough to give us free credits when we need them, but from a legal standpoint nothing solidified our relationship in the past. Now it is set in stone, and we have the reassurance that CopyPatrol is here to thrive for years to come. They were gracious enough to give us quite a bit of credits exceeding our current consumption, so we will soon be exploring adding more languages to CopyPatrol. On the front of negotiations with Turnitin, I'd like to thank @[[User:Ocaasi|Ocaasi]] who started the conversations, and more recently my colleagues @[[User:SSpalding (WMF)|SSpalding (WMF)]] from Legal, @[[User:JVargas (WMF)|JVargas (WMF)]] from Partnerships, my manager @[[User:KSiebert (WMF)|KSiebert (WMF)]], and our new Lead Community Tech Manager @[[User:JWheeler-WMF|JWheeler-WMF]].

Above all, allow me to thank all of ''you'' – our users – who are doing the actual work of helping cleanse the wikis of copyright violations. Your tireless efforts are what drove us to reaching this milestone.

Warm regards, [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 21:42, 9 April 2024 (UTC)

=== Feedback ===
{{hatnote|1={{fixed}} = code updated and confirmed would not show up if rechecked}}
: Wow, I can actually ''feel'' everything loading faster (imagine my shock on discovering that marking the status of reports is now near-instant). The new features are great, could I share a little bit of feedback?
:* The undo button is really useful, but its location next to the diff button has led to me now clicking it unintentionally multiple times (maybe it could be moved down)
: Other than that, everyone looks good. The leaderboard seems a bit funky, but I imagine that will be fixed with the backfill script. [[User:Isochrone|Isochrone]] ([[User talk:Isochrone|talk]]) 22:06, 9 April 2024 (UTC)
:It's so awesome to see how this technology and this partnership has evolved and matured. Congrats to everyone who has pushed it so much further!! [[User:Ocaasi|Ocaasi]] ([[User talk:Ocaasi|talk]]) 00:13, 10 April 2024 (UTC)
* Amazing! edit summaries are so helpful! thanks to all who made this work. [[User:L3X1|<small>en</small>L3X1]] ¡‹[[User talk:L3X1|delayed reaction]]›¡ 13:39, 10 April 2024 (UTC)
: The new version has many positive changes, such as the quick loading time and the expected reduction in outages. However, on the down side, I see that there's already 212 cases posted for April 10 and there's still three hours to go, so a projected 240 cases to assess in the 24 hour period. Given that most days we only have two people working the queue, this needs to be cut in half if that's possible. It's unrealistic and unstustainable to expect our tiny crew to keep up with the voume otherwise. (I can typically only clear about 20 cases per hour and can only commit to working on this for 3-4 hours per day.) [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 21:20, 10 April 2024 (UTC)
::Yes, many thanks for the improvements! Very grateful. I agree with Diannaa that we may need some tweaks in terms of what the bot flags as a potential copyright violation as the threshold seems to have been lowered compared to before (one example I mentioned on her talk page was that it now flags cases where someone changes one or two words in a paragraph because it detects a match for the remaining text in the paragraph). Not sure we'll be able to handle the reports otherwise. [[User:DanCherek|DanCherek]] ([[User talk:DanCherek|talk]]) 22:34, 10 April 2024 (UTC)
:::@[[User:Diannaa|Diannaa]] @[[User:DanCherek|DanCherek]] Thanks for all of the feedback! Can you link to specific example(s)? {{tq|someone changes one or two words in a paragraph because it detects a match for the remaining text in the paragraph}} – wouldn't that still usually be a copyright violation, or do you mean the source is a [[w:WP:BACKWARDSCOPY|backwards copy]] (in which case it's not a copyvio at all)?
:::Assuming the cases are still valid, my opinion is that it's perfectly fine to have a backlog. While it's admirable to aim for completeness, you can only volunteer but so much time. If however you're seeing a lot of noise, with backwards copies, or otherwise too many cases that are right on the "borderline", etc., we certainly can work to improve that. [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 22:45, 10 April 2024 (UTC)
::::I'm seeing a lot of cases like [https://copypatrol.wmcloud.org/en?id=9052d5d4-19ef-41c1-837c-8071f944aa11], where someone copyedits a paragraph and then it matches the rest of the unchanged text to a backwards copy. We still had to deal with backwards copies in the old CopyPatrol, of course, but so far it feels like a lot more after the update. [[User:DanCherek|DanCherek]] ([[User talk:DanCherek|talk]]) 22:50, 10 April 2024 (UTC)
::::: <small>{{fixed}} —&thinsp;[[User:JJMC89|JJMC89]]&thinsp;<small>([[User talk:JJMC89|T]]'''·'''[[Special:Contributions/JJMC89|C]])</small> 17:25, 11 April 2024 (UTC)</small>
::::[https://copypatrol.wmcloud.org/en?id=a85453bc-2bc3-4017-9306-76875225f6d7 This report] flags an edit that just cleaned up references with no real new text added.  -- [[User:Whpq|Whpq]] ([[User talk:Whpq|talk]]) 22:56, 10 April 2024 (UTC)
::::: <small><del>{{fixed}}</del> —&thinsp;[[User:JJMC89|JJMC89]]&thinsp;<small>([[User talk:JJMC89|T]]'''·'''[[Special:Contributions/JJMC89|C]])</small> 06:44, 11 April 2024 (UTC) modified 16:19, 11 April 2024 (UTC)</small>
::::Due to the large number of Wikipedia mirrors, we will always have false positives. We can waste a lot of valuable time on those cases, attempting to determine who had it first. We do have a [[User:EranBot/Copyright/Blacklist| whitelist of Wikipedia mirrors]] but people who don't know Regex are warned not to edit it. Here's a few more false positives of various kinds. I don't know if these are useful examples or not:
::::*[https://copypatrol.wmcloud.org/en?id=932428dc-f169-4f16-b64d-68f19c2e7d96 Here's one] where an editor removed multiple occurrences of the word "current" from a list. The list itself is public domain of course.
::::*[https://copypatrol.wmcloud.org/en?id=932428dc-f169-4f16-b64d-68f19c2e7d96 Here's one] where an editor moved a paragraph that was reflected in a Wikipedia mirror. The material they added in the same edit is okay to keep.
::::*[https://copypatrol.wmcloud.org/en?id=5ae0d58a-93fc-434b-b37b-a56bc89b601d In this one], an editor actually removes text but since IMDb has copied our plot summary at some point, the item gets listed.
::::*[https://copypatrol.wmcloud.org/en?id=ad9efee3-51d1-456b-8c63-7fc1a45e931c Here's one] that illustrated DanCherek's point: only a few words are added. Purported source: an obvious Wikipedia mirror.
::::Another suggestion: Perhaps we can somehow teach the system to only show us the most likely cases? Maybe there's a way to reduce the threshold for inclusion, regarding the size of the edit or the amount of the overlap? It's not a question of having a backlog; if we don't reduce the fire hose of incoming cases there will be many that never get assessed at all. [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 23:25, 10 April 2024 (UTC)
::::: <small>{{fixed}} <del>first and fourth</del><ins>all</ins>. The second link is the same as the first. —&thinsp;[[User:JJMC89|JJMC89]]&thinsp;<small>([[User talk:JJMC89|T]]'''·'''[[Special:Contributions/JJMC89|C]])</small> 06:44, 11 April 2024 (UTC) modified 17:25, 11 April 2024 (UTC)</small>
::::::Sorry about the duplicate link; I am not going to bother to look for the missing example. New comments:
::::::*Community Tech bot used to remove listings of pages that were already deleted. This doesn't seem to be happening so far: [https://copypatrol.wmcloud.org/en?id=feb8de1f-acdb-4bb1-9656-2e6f423a37a6 deleted article], [https://copypatrol.wmcloud.org/en?id=9f949c62-ee2d-415d-8ec6-ec3e19fd5d32 deleted draft]
::::::*Cases so far at the halfway point of April 11 are a much more manageable 40, so if tweeks are underway, it's working.
::::::[[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 12:11, 11 April 2024 (UTC)
::::::: Unfortunately I had to revert one of the fixes due to poor performance causing the bot to buildup a large backlog that hasn't been processed yet. —&thinsp;[[User:JJMC89|JJMC89]]&thinsp;<small>([[User talk:JJMC89|T]]'''·'''[[Special:Contributions/JJMC89|C]])</small> 16:19, 11 April 2024 (UTC)
:One thing I've noticed is that I keep getting logged out everytime I close my browser-- is there a cookie persistence issue? I had no such issues with the old backend. [[User:Isochrone|Isochrone]] ([[User talk:Isochrone|talk]]) 13:38, 11 April 2024 (UTC)
::I will look into this. This seems this happens to every new [[w:Symfony|Symfony]] app that I create ([[phab:T224382]]). I managed to fix it before, so I'll attempt it again for CopyPatrol (the old CopyPatrol did not run on Symfony, FYI) [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 19:32, 11 April 2024 (UTC)
:::I just noticed that I can't view the iThenticate reports unless I am logged in to CopyPatrol. So that might be a feature rather than a bug. [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 23:14, 11 April 2024 (UTC)
:::: Logging in is required since each user must agree to the EULA to see the reports. The short login session should get worked on. —&thinsp;[[User:JJMC89|JJMC89]]&thinsp;<small>([[User talk:JJMC89|T]]'''·'''[[Special:Contributions/JJMC89|C]])</small> 22:25, 12 April 2024 (UTC)

{{tracked|T362457|resolved}}
New feedback: Some users are incorrectly being shown with redlinked user talk pages. [https://copypatrol.wmcloud.org/en?id=21a041be-eb65-42ae-8d00-082e4bfe7fbd Here], [https://copypatrol.wmcloud.org/en?id=b42cffb1-6129-450a-bd58-a2ff5f790c1b here], [https://copypatrol.wmcloud.org/en?id=3933eeb7-7454-41ff-ac5d-070f5ebf28bd here], for example. It appears this might be because they don't have a talk page on Meta, but that's immaterial; I would prefer to be able to see at a glance whether or not a user talk page exists at en.wiki for that username. [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 21:44, 12 April 2024 (UTC)

:{{fixed}} [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 19:17, 14 April 2024 (UTC)

== Moving ignore lists to the CopyPatrol UI ==

In the [[#Feedback|above]] discussion, it was noted how tedious it is to maintain [[User:CopyPatrolBot/UrlIgnoreList]] as it requires knowledge of [[w:regular expression|regular expressions]]. I had an idea that we could get rid of the on-wiki lists and instead have a button "Ignore URLs like this" directly in the CopyPatrol UI. We could do the same for users, too, so you don't have to edit [[User:CopyPatrolBot/UserIgnoreList]]. This is also nice because the new system has the ignore lists centralized on Meta, where not everyone is necessarily able to edit (the page could be semi-protected).

The only issue I foresee with this idea is the potential for abuse. For that, I was thinking we'd either restrict the ability to ingore URLs and users to "privileged" users – say at least 1,000 edits, or even restrict to sysops? Another option is to go ahead and shield all of CopyPatrol from newbies, as proposed at [[phab:T178700]].

Thoughts? [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 19:43, 11 April 2024 (UTC)
: I can't imagine any issues with this for URLs. With users, making it too easy, even for admins (who are humans), to exclude users may lead to unintentional removals of users who should be flagged, or people being too liberal with the ignore button.<br>When there ''are'' errors on the wikitext list, this can just be rectified by another user: would there be a way to "un-ignore" users in case of errors? [[User:Isochrone|Isochrone]] ([[User talk:Isochrone|talk]]) 20:28, 11 April 2024 (UTC)
::I think it makes sense to have an interface to manage the ignored URLs and users. [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 22:43, 14 April 2024 (UTC)

== CopyPatrol has stopped, but.. ==

CopyPatrol has stopped, because Turnitin is down for maintenance. Check https://turnitin.statuspage.io/ for updates. [[User:Diannaa|Diannaa]] ([[User talk:Diannaa|talk]]) 19:36, 20 April 2024 (UTC)

== I keep getting logged out ==

Maybe I'm losing my mind but I find myself logged out of copy patrol numerous times each week, even though I don't close the window or log out of OAuth at all. I swear the only time I had to log in to CopyPatrol on the old system was when I rebooted. Is there a setting somewhere I can change to keep me logged in or is this the new normal? Thanks [[User:L3X1|<small>en</small>L3X1]] ¡‹[[User talk:L3X1|delayed reaction]]›¡ 00:53, 28 April 2024 (UTC)

:@[[User:L3X1|L3X1]] This was brought up in the feedback above. I have just deployed a change that I hope will help. Please let me know if it does (same for @[[User:Diannaa|Diannaa]] and everyone else :). There larger issue is rather a mystery, I'm afraid. I hope to investigate it more soon. You can follow [[phab:T224382]] for updates. Best, [[User:MusikAnimal (WMF)|MusikAnimal (WMF)]] ([[User talk:MusikAnimal (WMF)|talk]]) 05:14, 28 April 2024 (UTC)

== Deborah Morris and John Franklin ==

I saw this in my watchlist...

:Potential copyright violation log b 22:10  CopyPatrolBot talk contribs marked revision 1221979003 on Deborah Morris and John Franklin as a potential copyright violation ‎ Tag: PageTriage

but the only thing that I am finding is the duplication of a long title in the Bibliography: ''The Morris family of Philadelphia, descendants of Anthony Morris, born 1654-1721 died''. It seems that I can post a comment somewhere related to this... but I forgot where. Where can I provide a comment on this? Thanks so much![[User:CaroleHenson|CaroleHenson]] ([[User talk:CaroleHenson|talk]]) 05:29, 3 May 2024 (UTC)

:I found the log here: https://copypatrol.wmcloud.org/en. It identifies a source I did not use, but it has content that is in the article in a quote from another source: "https://archive.org/details/havilandgenealog00fros/page/210/mode/1up?q=%22no+longer+able+to+hear%22". It's a quote - and the source is from 1914, so not a copyright violation.

:The source that I used was a 1893 newspaper article: "[https://www.newspapers.com/article/the-new-york-times-old-time-new-york-fri/146458941/ Old-Time New-York Friends: Services of the "Plain People" in Revolutionary Days]". The New York Times. November 11, 1893. p. 16. Retrieved May 2, 2024."

:I couldn't figure out how to add a comment that it's not a copyright violation.[[User:CaroleHenson|CaroleHenson]] ([[User talk:CaroleHenson|talk]]) 05:51, 3 May 2024 (UTC)
:: @[[User:CaroleHenson|CaroleHenson]] When using quotes it's normally enough to add the reference. If you use public domain content outside of quotes, then you need to add the attribution template. I've marked the raport as no action needed since you already added the reference. [[User:1AmNobody24|<span style="border:1px solid black;padding:1px;background-color: #4D4DFF;color: white">Nobody</span>]] ([[User talk:1AmNobody24|<span style="color: #4D4DFF">talk</span>]]) 08:15, 3 May 2024 (UTC)

:::Great thanks![[User:CaroleHenson|CaroleHenson]] ([[User talk:CaroleHenson|talk]]) 19:44, 3 May 2024 (UTC)