User:SuggestBot

SuggestBot is a computer program that tries to help Wikipedia contributors find articles to edit. If you want to get some suggestions from the bot, here's how:

• To get a single set of suggestions:
  • …based on articles you've edited, please follow the instructions at User:SuggestBot/Requests.
  • …using WikiProjects you are interested in, go to the Teahouse's SuggestBot page, click on Get suggestions, and follow the instructions.
  • …based on a specific set of articles or categories of articles, see our instructions for that.
• You can also get suggestions posted periodically to your talk page (or another page of your choosing). How to do that is described here.

SuggestBot uses a variety of algorithms, including standard information retrieval and collaborative filtering techniques, to make suggestions. Most of it runs on Wikimedia Cloud Services' Cloud VPS, with parts also running on Toolforge. The recommendations are usually done based on downloading a list of a user's contributions (to avoid recommending articles they've recently edited), but it can also make recommendations based on a set of articles, categories, or WikiProjects. The bot was originally developed by ForteTuba and is now maintained by Nettrom. Seven Wikipedias have SuggestBot running: English, Norwegian, Swedish, Portuguese, Persian, Russian, and French.

If you have questions or concerns about SuggestBot, for instance if it made personalized recommendations for you, please get in touch on our talk page. Feedback is welcome and valuable, as it helps us improve SuggestBot so it does a better job of helping Wikipedia. Please note that due to the ongoing global pandemic, time and energy are somewhat scarce resources and responses are likely to be delayed.

Current status

SuggestBot is running normally, which means that one-time requests should be handled automatically in less than fifteen minutes, and we post suggestions to our subscribed users twice a day.

Approved tasks

SuggestBot has gone through several Bot Requests for Approval (BRFA) over the years. Here's a list of the tasks it has approval to do, and the corresponding BRFAs.

1. Post article suggestions to users: BRFA #4 for users who want them periodically, BRFA #6 for one-time requests.
2. Update the Community Portal's list of open tasks: BRFA #7
3. Update various task templates periodically: BRFA #8

In addition there's an archived discussion thread from 2005/06 where the idea of SuggestBot and its functionality was first discussed. About a year later BRFA #2 was submitted. We have also had two BRFAs in relation to research experiments, see BRFA #3 and BRFA #5.

Limitations/issues

• Due to the bot having difficulties editing large pages, it is currently limited to editing pages smaller than 250kB in size. If you suddenly stop receiving suggestions, it might be because of this. We're working on modifying the bot to use its own Lua module for the suggestions. This will reduce the amount of wikitext it uses for suggestions and hopefully also enable it to post to larger pages again. You might also want to look into how to automatically archive the page SuggestBot posts to (e.g. your talk page), as that takes the hassle out of keeping an eye on it.
• Some people would like wanted articles (redlinks). Hard because the only info we have on a redlink is a title and the pages that link to it -- no edit history to work from. Might be able to do this.
• Someone suggested removing section stubs from the stubs list. Probably the right thing to do.
• Only reads up to N (currently N=500) of a person's most recent edits when making recs. It tries to get older edits from a dump, in order to not recommend articles people have edited in the past, but this isn't perfect because dumps go out of date (there might be a gap between your last 500 edits and any edits it finds in the dump, and articles in that space might be recommended).
• Doesn't handle redirects (also leading to recommendation of already-edited pages). This appears to be a relatively minor issue based on a little bit of testing of recommended items. I'd like to do this on the back end, so that if a person has edited several versions of a page, SuggestBot would "know" that they were all the same page (and maybe do better).
• Ignores anything outside of main namespace (taking article talk pages into account might be interesting, a better representation of people's interests than just edits of articles directly. On the other hand, people often post on talk pages of articles they'd like to see deleted?)...

Changelog

• Switched to using the Pageview API for retrieving page views, and ORES for predicting article quality. 18:07, 27 May 2016 (UTC)
• Updated SuggestBot's way of posting suggestions so that it only tries to edit once in case something goes wrong, preventing the bot from editing the same page over and over. 22:00, 22 November 2013 (UTC)
• Switched from using {{Ntsh}} to {{Hs}} for sorting of the suggestion table due to MediaWiki having problems parsing a large page with many transclusions of {{Ntsh}}. SuggestBot now also automatically replaces transclusions of {{Ntsh}} with {{Hs}} when it posts. We've also added documentation of the columns in the suggestion table, and documentation of SuggestBot's task categories with listing of which specific Wikipedia categories are coved by each task category. 22:24, 6 November 2013 (UTC)
• Discovered we did not correctly check previous suggestions as we should, which meant specific articles might get suggested multiple times in succession. This bug has now been fixed and the bot should again start keeping track and not suggest the same articles over and over. 19:08, 14 July 2013 (UTC)
• Launched an improved design for users who receive suggestions regularly. This also meant a change in the configuration of categories SuggestBot fetches articles from, which also affects one-time requests. We added orphan and unencyclopaedic articles (NPOV disputes and original research), doubled the number of articles in need of more sources, and reduced the number of stubs. 20:35, 20 May 2013 (UTC)
• Switched our text-based recommender over to one built upon Apache Solr/Lucene to mitigate our performance issues. 07:14, 16 June 2012 (UTC)
• Added a new parameter "replace" to the template and userbox used for signing up to get suggestions regularly, makes the bot replace the latest existing set of suggestions (if present). We have also made changes to one of our recommenders to improve the quality of suggestions, as well as various minor bugfixes. 18:11, 26 July 2011 (UTC)
• Switched to a template-based system for signing up to get suggestions regularly. At the same time we also made it possible to get the suggestions delivered to a sub-page in your userspace for those who prefer them to stay away from their user talk page. We've also made sure the bot will not recommend the same articles over and over again. 15:54, 24 February 2011 (UTC)
• Fixed problems posting to talk pages for users with extended-char usernames by moving to the pywikibot framework. It also appears to have fixed the problem of not being able to post to some users talk pages. -- 16:17, 2 June 2010 (UTC)
• Try to improve profiles by ignoring minor and disambig edits. -- 11:28, 7 August 2006 (UTC)
• Kick over coedit recommender to 7-17 dump. -- 11:28, 7 August 2006 (UTC)
• Removed random recommendations, they were rarely followed. -- 05:01, 27 March 2006 (UTC)
• Eliminate most previously edited articles by looking at a relatively recent local dump. Many dumps fail on en, and processing them takes days, so for now we're on a mostly-processed version of the 2-19-06 dump. -- 16:24, 15 March 2006 (UTC)
• Maybe fixed all accented character issues? -- 15:58, 15 March 2006 (UTC)
• Add a filter to not recommend articles in the top N% (N=1) of edited articles -- a better way to handle the controversial article problem, and consistent across recommendation algorithms. -- 00:11, 15 March 2006 (UTC)
• Instead of recommending among all articles, focus on recommending articles tagged as stubs or needing work. (Somewhat like OpenTask but giving more weight to stubs since there are so many more of them.) -- 21:49, 14 March 2006 (UTC)
• Expand edit removing to include protection actions. -- ForteTuba 16:16, 14 March 2006 (UTC)
• Make some random recommendations, to make sure all articles get recommended eventually (a la User:Pearle's maintenance of Template:Opentask). -- 18:48, 13 March 2006 (UTC)
• Harshly penalize articles with lots of links in the link-based recommender, to recommend fewer popular pages (that presumably have less opportunity to contribute to). -- 16:35, 10 March 2006 (UTC)
• Remove many edits as input to recommendations, if the comment suggests they're reverting vandals. These edits appear to cause recommendations to zero in on controversial pages. -- 16:35, 10 March 2006 (UTC)
• Fix many accented character issues. -- 21:41, 7 March 2006 (UTC)

Source code

We have a publicly available code repository available on GitHub where most of the source code of SuggestBot is available: github.com/nettrom/suggestbot