Commons:Bots/Requests

This project page in other languages:

If you want to run a bot on Commons, you must get permission first. To do so, file a request following the instructions below.

Please read Commons:Bots before making a request for bot permission.

I	Create a user account (while logged in to your normal account) and user page for the bot On the bot's userpage, add {{Bot}}, which automatically adds the page to Category:Commons bots. Then add the following information to the bot's userpage (all this is mandatory): Operator: Who the creator/operator is and how they can best be contacted Tasks: Details of the bot's task or tasks Operation: Whether the bot is manually assisted or runs automatically When: When it operates (continuously, intermittently, or at specified intervals) Maximum edit rate: The bot's maximum edit rate (eg edits per minute) Language: The language and/or program that it is running
II	Create your bot request: Replace "`YourBotName`" with your bot's username in the box below and click the button. Complete the questions on the resulting page and save it. Remember that your bot will be allowed to operate only for those tasks that you have specified in your request. Add your bot request to the list here: Edit the following request list, adding the following text to the top of the appropriate section (replacing "`YourBotName`" with your bot's name): `{{Commons:Bots/Requests/YourBotName}}`
III	Test run You can be demanded to make a short test run with your bot account (30–50 edits/uploads) to allow other users to review your bot's tasks. Unauthorized test run is not allowed.
IV	Waiting for approval. You now need to wait for community approval. A bureaucrat will close the request and will also grant a bot flag, where necessary. Closed requests are moved to Commons:Bots/Archive.

Requests made on this page are automatically transcluded in Commons:Requests and votes for wider comment.

Requests for permission to run a bot[edit]

watch

Before making a bot request, please read the new version of the Commons:Bots page. Read Commons:Bots#Information on bots and make sure you have added the required details to the bot's page. A good example can be found here.

When complete, pages listed here should be archived to Commons:Bots/Archive.

Any user may comment on the merits of the request to run a bot. Please give reasons, as that makes it easier for the closing bureaucrat. Read Commons:Bots before commenting.

DoggoBot (talk · contribs)[edit]

Operator: EpicPupper (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought: Recategorizing files in Category:San Antonio Express Vol. 39 to Category:San Antonio Express Vol. 49, recategorizing files in Category:San Antonio Express Vol. 45 to Category:San Antonio Express Vol. 55, renaming and editing files in Category:San Antonio Express Vol. 39 from "Vol. 39" to "Vol. 55", renaming and editing files in Category:San Antonio Express Vol. 45 from "Vol. 45" to "Vol. 49".

Automatic or manually assisted: Automatic

Edit type (e.g. Continuous, daily, one time run): One time run

Maximum edit rate (e.g. edits per minute): 1 / 5 seconds

Bot flag requested: (Y/N): Y

Programming language(s): Cat-a-lot, mwclient for renaming, VFC for editing

EpicPupper (talk) 03:15, 2 March 2022 (UTC)[reply]

Discussion

This was requested at bot requests.

Please make test runs for each task. Please use edit summaries similar to Help:Gadget-HotCat and User:CommonsDelinker. --EugeneZelenko (talk) 15:33, 2 March 2022 (UTC)[reply]

Hi @EugeneZelenko, I've run a trial for the recategorizing (18 edits). My bot needs filemover to do the other part; could that be given, please? Thanks! EpicPupper (talk) 21:51, 2 March 2022 (UTC)[reply]

Changing categories looks OK for me. I granted file mover right to bot account for week. --EugeneZelenko (talk) 15:31, 3 March 2022 (UTC)[reply]

EpicPupper, the files in 45 need to be renamed to 55 to match the match the recategorization. :) Also, can you make the small change so that the text changes from 39 to 49 like I did here. -- Ricky81682 (talk) 22:06, 3 March 2022 (UTC)[reply]
- Sure Ricky81682. Do the volume 45 files also need editing? EpicPupper (talk) 00:38, 4 March 2022 (UTC)[reply]
  - EpicPupper I started and completed the files like File:San Antonio Express. (San Antonio, Tex.), Vol. 55, No. 215, Ed. 1 Monday, August 2, 1920 - DPLA - c52d78ed9de6b2bf8f61baf9a77829a6 (page 1).jpg but it got beyond tedious by hand as you can imagine. This is an extreme level of correction I'm aware but I figure it's important. -- Ricky81682 (talk) 01:34, 4 March 2022 (UTC)[reply]
    - Hi Ricky81682, yep, I was planning to move the volume 45 files as well, but was wondering if they needed the title parameter in the wikitext edited. Cheers, EpicPupper (talk) 01:35, 4 March 2022 (UTC)[reply]
      - EpicPupper Sorry I wasn't clear but yeah, that would help. -- Ricky81682 (talk) 01:56, 4 March 2022 (UTC)[reply]

Hi EugeneZelenko, I've finished the trial (recategorization, renaming, edits). For some of the earlier edits I forgot to set an edit summary, but I did so for the later ones. Cheers, EpicPupper (talk) 01:57, 4 March 2022 (UTC)[reply]

Please omit - Doing 1 replacements from description changes. It would be reasonable to move unused files without leaving redirect. --EugeneZelenko (talk) 15:16, 4 March 2022 (UTC)[reply]

Dragons Bot (talk · contribs)[edit]

Category:Lingua Libre pronunciation contains 700,000 files, several thousands of them have known errors to fix by bot.

Operator: Yug (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought:

Rename files

Scope: Thousands files within the Category:Lingua Libre pronunciation have been found to have erroneous/misleading filenames. Dragons Bot would help to fix these issue. First push will be on Category:Lingua_Libre_pronunciation-zho (list), where about 200 files need naming corrections. One other category is known to have 2,000 misleading filenames. Others groups exist. The consistency of those filenames is necessary so complementary usages within Wiktionary operate properly.

Automatic or manually assisted: Automatic unsupervised.
Runs will be occasional and to be well prepared before hand we will :

Phase 1: discussion within the project's community
Phase 2: test with few cases <5 must be successful
Phase 3: production run, could involved between 20 to 3,000 file at once.

Edit type (e.g. Continuous, daily, one time run): occasional, for mass corrections.

API:Move: occasional. When a group of files needs renaming, Dragons Bot renames them.

Maximum edit rate (e.g. edits per minute): per community policy of non-urgent tasks (1/5 sec).

Bot flag requested: (Y/N): Yes.

Programming language(s): Javascript, NodeJS via Wikiapijs.

Yug (talk) 14:05, 18 January 2022 (UTC)[reply]

Discussion

Could you grant this bot account the relevant renaming rights so all my tests can proceed smoothly ? Yug (talk) 14:05, 18 January 2022 (UTC)[reply]

I granted file mover permissions for month. --EugeneZelenko (talk) 14:59, 18 January 2022 (UTC)[reply]

What are the requirements and best practices I should know of for moving files via bots ? My speed is fine (limited). Is there some rules on edits comments ? Yug (talk) 11:38, 20 January 2022 (UTC)[reply]

At least edit summary should provide clear explanation why file was moved. --EugeneZelenko (talk) 16:06, 20 January 2022 (UTC)[reply]

@Yug: Please provide some feedback. --Krd 05:49, 19 March 2022 (UTC)[reply]

WLKBot (talk · contribs)[edit]

Operator: WLKBot (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions) User:Kim Bach is the operator, he can be contacted through commons mail, User:MSanderhoff can also be contacted.

Bot's tasks for which permission is being sought: Upload of public domain images of artwork and related metadata, using the Template:Artwork of artwork provided through partnerships with Danish GLAMS.

The first partnership is with SMK - The National Gallery of Denmark a project page is created for the purpose Commons:SMK - Statens Museum for Kunst

For the SMK contribution, the images are downloaded and metadata is mapped to the Artwork template, utilising the Statens Museum for Kunst, SMK API: entry KMS1 and the wikilabskultur Artwork template preprocessor.

Automatic or manually assisted: The bot is manually assisted and will most likely be running from a stand alone computer

Edit type (e.g. Continuous, daily, one time run): One time run (several batches)

When: The bot operates at specified intervals (batches). Activity depends on the availability of new batches from GLAMs, it can be started on demand by the local operator, on a stand alone pc

Maximum edit rate (e.g. edits per minute): Most likely 10-50 edits per minute, but only in short bursts, and it can be set to a much lower rate. The first proposed upload will be in the form of approx. 500 files of 10-30MB in size, time to finish is not of the essence, the total size of the contribution from SMK currently is approx. 70.000 images, the collection is expected to be quite static.

Bot flag requested: (Y/N): Y

Programming language(s): The bot is written in Python using the pywikibot library

The source code is available on GitHub

WLKBot (talk) 17:13, 16 December 2021 (UTC)[reply]

Discussion

Please make test run. --EugeneZelenko (talk) 15:46, 17 December 2021 (UTC)[reply]

First test run, a total of 25 images uploaded. --WLKBot (talk) 09:44, 20 December 2021 (UTC)/User:Kim Bach[reply]

Could medium be internationalized with template or Wikidata item? If not, please use language tag. Same for object type like Blyant. Could bot add painting by or more detailed category? Please also make batch categories hidden. --EugeneZelenko (talk) 16:04, 20 December 2021 (UTC)[reply]

Example File:Christen Købke, Lille søstudie med en ø i den venezianske lagune, 1838, KMS7020, Statens Museum for Kunst.jpg.

This file should have a default sortkey (Defaultsort) "Købke, Christen, 1838" as we generally sort items by the creator's last name.

It should have a category of "Paintings by Christen Købke in Statens Museum for Kunst" with a local sortkey of "|1838" (after the category name). I did that manually.

It should have a category of "Paintings by Christen Købke" with a local sortkey of "|1838" (after the category name). Is this not redundant? No, because those paintings will eventually be divided up as landscapes, marine paintings, portraits and so on.

It might have a category of "19th-century paintings in the Statens Museum for Kunst". Note: Here it is the Statens Museum for Kunst. Don't ask.

It might have a category of "Landscape paintings in the Statens Museum for Kunst".

It might have a category of "1838 paintings from Denmark".

Happy programming. Cheers Rsteen (talk) 12:54, 21 December 2021 (UTC)[reply]

Thank you for your comment, and the detailed example, it's very helpful, I can definitely improve on the categorisation along the lines you suggested WLKBot (talk) 21:00, 22 December 2021 (UTC)[reply]

@Kim Bach: please don't use your bot account to make manual edits like the previous comment.

You're adding {{Statens Museum for Kunst collaboration project}}, so you shouldn't be adding Category:Images released under the CC0 1.0 Universal license by Statens Museum for Kunst
Please wrap the medium field in {{Da}} to make clear that this is in Danish. Makes it easier to later replace in internationalization.
I don't care that much about the categorization as long a you add some object type categories it should be fine.
Including the copyright and license template makes {{Artwork}} really big. Please create two sections example and put the permission part in the bottom section.
Please only use {{Creator}} if the template exists (or you're creating it) because otherwise we'll end up with broken links for years
Not sure if you plan to upload some 3D works, but in that case you can use {{Licensed-PD}}
Bonus points if you also add structured data ([https://github.com/multichill/toollabs/blob/master/bot/commons/wikidata_uploader.py some example code)

I enjoyed visiting the SMK and looking forward to having all this content on Commons! Multichill (talk) 18:29, 1 January 2022 (UTC)[reply]

@Kim Bach and MSanderhoff: ? --Krd 04:26, 5 February 2022 (UTC)[reply]

@Krd I assume that the "?" means that you'd like an update :-). We're busy implementing the changes suggested by the community, and we will not run another test until we're confident in the changes we're making, this should only be weeks away. Kim Bach (talk) 13:59, 6 February 2022 (UTC)[reply]

DigitaltMuseumBot (talk · contribs)[edit]

Operator: DigitaltMuseum (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought: Batch upload of photos from digitaltmuseum.org. Photos are manually selected by the publisher.

Automatic or manually assisted: manually assisted

Edit type (e.g. Continuous, daily, one time run): one time run

Maximum edit rate (e.g. edits per minute): maximum 10/min

Bot flag requested: (Y/N): Y

Programming language(s): Python (pywikibot)

DigitaltMuseum (talk) 09:24, 17 September 2021 (UTC)[reply]

Discussion

What about User:BotKulturIT? --Achim (talk) 11:18, 17 September 2021 (UTC)[reply]

@Achim55: We're new with Wikimedia and messed up by creating 2 bot users. Then later found out we couldn't delete. User:BotKulturIT won't be used. --DigitaltMuseum (talk) 10:35, 23 September 2021 (UTC)[reply]

Ok, I redirected it. Thanks for contributing here! --Achim (talk) 13:21, 23 September 2021 (UTC)[reply]

How many files are intended to be uploaded? Please make a few test uploads. --Krd 16:16, 23 September 2021 (UTC)[reply]

@Achim55: ? --Krd 09:15, 8 October 2021 (UTC)[reply]

I have no idea. I've had looked up their website and found some valuable content there. I sent a wikimail to them. --Achim (talk) 20:49, 8 October 2021 (UTC)[reply]

@Achim55: @Krd: We don't have an accurate number of files. I'll try to explain what we're trying to achieve: Digitaltmuseum currently has 6.8 million objects, many with images and some with multiple images. The objects are owned by an institution, usually a museum. Our plan is to develop a service which enables these owners to

collect images they want to upload to Wikimedia
generate mapping files based on the collected images and data from DigitaltMuseum. They must upload these to the institution's page on Wikimedia
upload the collection in the institutions's name, using DigitaltMuseumBot

The workflow and mapping is based on this project from Nordiska museet: https://github.com/NordicMuseum/Wikimedia-Commons-uploads

--DigitaltMuseum (talk) 10:44, 12 October 2021 (UTC)[reply]

DigitaltMuseum, that's fine. For to see that the bot is running correctly we need a few test uploads by the bot. Another thing: If you are editing personally please use your 'DigitaltMuseum' account and leave the 'DigitaltMuseumBot' account for the bot's edits only, thank you. --Achim (talk) 11:50, 12 October 2021 (UTC)[reply]

@Achim55: Thanks for the tip! We would like to do test uploads to the beta cluster. In the "Do a test upload" section of Guide to batch uploading there's a dead link to an explanation. Do you know if it's available somewhere? --DigitaltMuseum (talk) 13:41, 12 October 2021 (UTC)[reply]

@Achim55: @Krd: Created user & botuser on beta and copied the bot userpage from DigitaltMuseumBot. The abuse filter didn't like the content and both user & IP is now blocked ("New user adding external links in userspace") :/ Any tip on how to unblock? --DigitaltMuseum (talk) 07:02, 13 October 2021 (UTC)[reply]

. Please provide links to the blocked users. --Krd 13:44, 19 October 2021 (UTC)[reply]

@Krd: https://commons.wikimedia.beta.wmflabs.org/wiki/User:DigitaltMuseum & https://commons.wikimedia.beta.wmflabs.org/wiki/User:DigitaltMuseumBot --DigitaltMuseum (talk) 10:29, 26 October 2021 (UTC)[reply]

Now unblocked. --Krd 12:10, 26 October 2021 (UTC)[reply]

@DigitaltMuseum: Is this ready for a test run? --Krd 14:18, 9 November 2021 (UTC)[reply]

@DigitaltMuseum: ? --Krd 09:12, 23 November 2021 (UTC)[reply]

Stale. --Krd 08:59, 3 December 2021 (UTC)[reply]

Please make test uploads at Commons. --Krd 15:58, 8 December 2021 (UTC)[reply]

Hi @Krd: Tried an upload now but get this message:

WARNING: API error permissiondenied: The action you have requested is limited to users in one of the groups: *, [ [Commons:Users|Users]].

The logged-in user in pywikibot:

Name:

DigitaltMuseumBot

Id:

10624743

Groups:

['*', 'user', 'autoconfirmed']

Rights:

['read', 'writeapi', 'abusefilter-view', 'abusefilter-log', 'upload', 'upload_by_url', 'reupload-own', 'purge', 'reupload', 'autoconfirmed', 'editsemiprotected', 'skipcaptcha', 'abusefilter-log-detail', 'transcode-reset']

Don't know if this is related to pywikibot or if there's something wrong with the bot user. Any suggestions? DigitaltMuseum (talk) 09:53, 10 December 2021 (UTC)[reply]

Stuck with permissiondenied, any ideas @Achim55, @Krd? DigitaltMuseum (talk) 08:50, 15 December 2021 (UTC)[reply]

What is the action you tried to do? Do you use normal login or Special:BotPasswords? Krd 08:57, 15 December 2021 (UTC)[reply]

WARNING: API error permissiondenied is logged on every upload attempt. The bot user seems to be logged in ok, with the groups & rigths mentioned above, when we set a breakpoint in pywikibot. Don't know if you are familiar with bywikibot, here's the files related to login in case you see something useful:

user-config.py:

mylang = 'commons'

family = 'commons'

usernames['commons']['commons'] = 'DigitaltMuseumBot'

password_file = 'user-password.py'

user-password.py:

(u'DigitaltMuseumBot', BotPassword(u'DigitaltMuseumBot', u'PASSWORD'))

Appreciate your help @Krd DigitaltMuseum (talk) 10:36, 15 December 2021 (UTC)[reply]

Also, uploading works against beta and if we run pywikibot with -test argument DigitaltMuseum (talk) 10:39, 15 December 2021 (UTC)[reply]

Sadly I have no idea. I have now set the bot flag, please check if that helps. Krd 10:10, 16 December 2021 (UTC)[reply]

@Krd Finally got it to work! Might've been a cache problem. Updated the Bot password grants, then got a much longer list of rights on the next run. Please see https://commons.wikimedia.org/wiki/Special:ListFiles?limit=50&user=DigitaltMuseumBot&ilshowall=1 DigitaltMuseum (talk) 11:43, 17 December 2021 (UTC)[reply]

There are a lot of red links in the uploaded files. What is your intention about that? Krd 16:07, 17 December 2021 (UTC)[reply]

@Krd there were some missing templates. We've added those and made municipality mapping work. Links to the institutions's page on Wikimedia (which should exist prior to any real uploads through this bot) should be the only dead ones now. DigitaltMuseum (talk) 12:08, 22 December 2021 (UTC)[reply]

I still see e.g. Institution:Østfold fylkes billedarkiv as red link, and also Categories used during upload. Can this be fixed before mass uploads get started? --Krd 14:45, 22 December 2021 (UTC)[reply]

@Krd These are links to the Institution's page on Wikimedia, and as stated in the previous comment, they should exist prior to any upload. We can look into a simple ping to see if they exist before the job starts, but this is the institution's responsibility really. DigitaltMuseum (talk) 06:21, 23 December 2021 (UTC)[reply]

I'm still asking myself why these files are CC-by-sa with attribution to the archive. Is this correct? Or is this a question out of scope of this bot request? --Krd 19:09, 27 December 2021 (UTC)[reply]

@DigitaltMuseum: Can you please elaborate a bit on the copyright aspect? --Krd 04:27, 5 February 2022 (UTC)[reply]

@DigitaltMuseum: ? --Krd 05:48, 19 March 2022 (UTC)[reply]

Commons:Bots/Requests

Contents