https://wikitech.wikimedia.org/wiki/Main_Page Wikitech hosts technical documentation for [Foundation] infrastructure and services. To edit this wiki, you need an [account with a confirmed email address; unlike most other Wikimedia wikis, Wikitech does not permit editing without an account. https://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log The Server Admin Log (known as SAL) is a public collection of short messages, published from server administrators (in Toolforge, Cloud VPS projects, etc.) in order to track and share server activities (related to maintenance, upgrades, fixes, etc. Add from IRChttps://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log#Add_from_IRC Add from Toolforgehttps://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log#Add_from_Toolforge Exploringhttps://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log#Exploring See alsohttps://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log#See_also https://wikitech.wikimedia.org/wiki/Git-review https://wikitech.wikimedia.org/wiki/Terminology This is an overview of terminology used in technical documentation for Wikimedia Foundation infrastructure and software. Chttps://wikitech.wikimedia.org/wiki/Terminology#C Dhttps://wikitech.wikimedia.org/wiki/Terminology#D Fhttps://wikitech.wikimedia.org/wiki/Terminology#F Ghttps://wikitech.wikimedia.org/wiki/Terminology#G Nhttps://wikitech.wikimedia.org/wiki/Terminology#N Phttps://wikitech.wikimedia.org/wiki/Terminology#P Rhttps://wikitech.wikimedia.org/wiki/Terminology#R Thttps://wikitech.wikimedia.org/wiki/Terminology#T Whttps://wikitech.wikimedia.org/wiki/Terminology#W See alsohttps://wikitech.wikimedia.org/wiki/Terminology#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage The nova cli command can be used to examine and alter many settings related to a particular Cloud VPS project or the entire OpenStack cluster. These commands are typically run on the cloudcontrol* hosts (e. Credentialshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#Credentials List all nova subcommandshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#List_all_nova_subcommands List floating IPshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#List_floating_IPs Move a floating IP from one instance to anotherhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#Move_a_floating_IP_from_one_instance_to_another Add an IP to the poolhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#Add_an_IP_to_the_pool Manage project quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#Manage_project_quotas List current quotas for a projecthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#List_current_quotas_for_a_project Change a quota for a projecthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#Change_a_quota_for_a_project CPU, RAM, etchttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#CPU,_RAM,_etc Floating ipshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage#Floating_ips https://wikitech.wikimedia.org/wiki/Svn2git svn2git is a fun little tool we've forked from KDE in operations/software.git. https://wikitech.wikimedia.org/wiki/SAL SAL or Server Admin Log may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Wm-bot [is an IRC bot that participates in several developer-related wiki channels. wm-bot is currently running simultaneously on libera. All stars teamhttps://wikitech.wikimedia.org/wiki/Wm-bot#All_stars_team Where is ithttps://wikitech.wikimedia.org/wiki/Wm-bot#Where_is_it How does it workhttps://wikitech.wikimedia.org/wiki/Wm-bot#How_does_it_work Pathshttps://wikitech.wikimedia.org/wiki/Wm-bot#Paths Freenode (historical, not in operation)https://wikitech.wikimedia.org/wiki/Wm-bot#Freenode_(historical,_not_in_operation) Liberahttps://wikitech.wikimedia.org/wiki/Wm-bot#Libera How to start the bothttps://wikitech.wikimedia.org/wiki/Wm-bot#How_to_start_the_bot Troubleshootinghttps://wikitech.wikimedia.org/wiki/Wm-bot#Troubleshooting How to restart the bot core (fixes most problems)https://wikitech.wikimedia.org/wiki/Wm-bot#How_to_restart_the_bot_core_(fixes_most_problems) If you get permission deniedhttps://wikitech.wikimedia.org/wiki/Wm-bot#If_you_get_permission_denied How to shutdown the bothttps://wikitech.wikimedia.org/wiki/Wm-bot#How_to_shutdown_the_bot Complete shutdownhttps://wikitech.wikimedia.org/wiki/Wm-bot#Complete_shutdown Core onlyhttps://wikitech.wikimedia.org/wiki/Wm-bot#Core_only How to fix 1 or more disconnected instanceshttps://wikitech.wikimedia.org/wiki/Wm-bot#How_to_fix_1_or_more_disconnected_instances How to change the logshttps://wikitech.wikimedia.org/wiki/Wm-bot#How_to_change_the_logs How to patch the bothttps://wikitech.wikimedia.org/wiki/Wm-bot#How_to_patch_the_bot How to change the nickname of bothttps://wikitech.wikimedia.org/wiki/Wm-bot#How_to_change_the_nickname_of_bot Backupshttps://wikitech.wikimedia.org/wiki/Wm-bot#Backups See alsohttps://wikitech.wikimedia.org/wiki/Wm-bot#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Ryan_Lane Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DamianZaremba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dan-nl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DrTrigon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MF-Warburg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adamw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ebe123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stefan.petrea Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Milimetric Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tim_Landscheidt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hazard-SJ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cupco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Huji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mardetanha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Wikistats Disambiguation page: https://wikitech.wikimedia.org/wiki/Shell_Request/Louisdang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swalling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Massaf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reedy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jimmyxu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mono Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umherirrender Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nandakv4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vishal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rajiff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anth1y Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattflaschen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MZMcBride Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tim1357 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vogone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lwelling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bene Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Techman224 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mwalker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danmichaelo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jkroll Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ireas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pst Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fran_McCrory Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yurik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Celicni Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Itu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smccandlish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/John_F._Lewis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rubin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/X! Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ejcaputo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bennylin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request Prior to [new Cloud VPS users had to separately ask for "shell access" and be manually approved as members of the bastion project] before they could become a member of another Cloud VPS project (like [[Portal:Toolforge|Toolforge). The subpages of this page are the requests and record of their approval/denial from this process. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Russell_Blau Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emaus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/BeneBot* == Information == Informationhttps://wikitech.wikimedia.org/wiki/BeneBot*#Information https://wikitech.wikimedia.org/wiki/Shell_Request/Base Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mauro742 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vssun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RileyChilds Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brian_Wolff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vacation9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fox_Wilson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/UnwashedMeme Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spider8855 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Razimantv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ajraddatz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Unmovable Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rschen7754 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robertboloc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilaril Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Saravanan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jbuys Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fionnan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dispenser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taste1at Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Poke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ChongDae Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dev1985 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manzzup Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hypergrove Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lashtear Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lbenedix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cae Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hair Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bungonews Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ort43v Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swidmann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Plancalculus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shashankmehta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ayushchd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Bastion A bastion is the main host on any given network for external users to log into. From the bastion, system administrators access other hosts on the same internal subnets. See alsohttps://wikitech.wikimedia.org/wiki/Bastion#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Shirayuki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pickhardt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahul22 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nicolas_Raoul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arrbee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yoavd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Telshin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shaun9876 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kanchanthropoid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TTO Pretty sure you have an editable 'real name' field which you can fill in with whatever you want. I'd avoid the comma though; no telling how that would be treated. Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JanZerebecki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JackPotte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkdadaah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shuaib Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shanmugamp7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Franky1978 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rotebro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahul21 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Test123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Makecat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jnik5714 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Micke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Odder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thegeorgeous Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FastLizard4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lokal_Profil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Faidontest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stefanor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cboltz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ahamed5zal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ipstenu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Worden.lee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sjaljain Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adminrj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AlephNull Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geraki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PhbFkNty1iH5 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hazflex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Riley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lucy_Tech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Se4598 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Esanders Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SuchetaG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eranroz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankitgadgil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pauljherring Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sayak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rachel99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarbull Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cscott Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Subha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jitrixis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mancoolgunda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dhruvj_94 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wingsofcourage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cicalese Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bencmq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jaclu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beta16 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Greg_Grossmeier Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seanpc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seahorse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kausikram Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DGideas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ishitva Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fale Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mulialim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aubhav_iitr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shubinator Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CryoKey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuvals Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rohieb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeffslofish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/C_herse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HfA Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ahruss Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brandonl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hercule Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eseidel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gabrielchihonglee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jkneip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dfsdfsdf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atulag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Olivervs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mlpearc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asheeshtest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kunwar.sangram Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frussler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Adding_a_file_in_innodb edit /etc/my.cnf How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To MySQLhttps://wikitech.wikimedia.org/wiki/Category:MySQL https://wikitech.wikimedia.org/wiki/Application_servers The Application servers (or app servers) are the several hundred Apache servers that run MediaWiki (PHP application). Servicehttps://wikitech.wikimedia.org/wiki/Application_servers#Service Architecturehttps://wikitech.wikimedia.org/wiki/Application_servers#Architecture Logginghttps://wikitech.wikimedia.org/wiki/Application_servers#Logging Update our PHP packageshttps://wikitech.wikimedia.org/wiki/Application_servers#Update_our_PHP_packages Hardware repairhttps://wikitech.wikimedia.org/wiki/Application_servers#Hardware_repair See alsohttps://wikitech.wikimedia.org/wiki/Application_servers#See_also https://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps We want mirrors! For more information see Dumps/Mirror status. Setuphttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Setup Current architecturehttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Current_architecture Current hostshttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Current_hosts Adding a new snapshot hosthttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Adding_a_new_snapshot_host Starting dump runshttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Starting_dump_runs Deploying code updateshttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Deploying_code_updates Updating configuration fileshttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Updating_configuration_files Rerunning dumpshttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Rerunning_dumps NFS share and/or web server issueshttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#NFS_share_and/or_web_server_issues Out of space (Low)https://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Out_of_space_(Low) A dumpsdata host dies (Unlikely)https://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#A_dumpsdata_host_dies_(Unlikely) A dumpsdata host has NFS issues (Unlikely)https://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#A_dumpsdata_host_has_NFS_issues_(Unlikely) A labstore host dies (web or nfs server for dumps) (Unlikely)https://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#A_labstore_host_dies_(web_or_nfs_server_for_dumps)_(Unlikely) Notes on NFS issues and Toolforge loadhttps://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps#Notes_on_NFS_issues_and_Toolforge_load https://wikitech.wikimedia.org/wiki/Bacon Bacon was a Wikimedia server. It was working as a thumb server for Wikimedia Commons. Basicshttps://wikitech.wikimedia.org/wiki/Bacon#Basics Specificationshttps://wikitech.wikimedia.org/wiki/Bacon#Specifications https://wikitech.wikimedia.org/wiki/Checking_MySQL_replication ==Checking replication delay== Checking replication delayhttps://wikitech.wikimedia.org/wiki/Checking_MySQL_replication#Checking_replication_delay https://wikitech.wikimedia.org/wiki/Status_monitors * Log: Server admin log https://wikitech.wikimedia.org/wiki/DNS This page describes Wikimedia's [setup. Wikimedia use two separate kinds of DNS servers, authoritative nameservers (that respond to queries from third party nameservers for our domains) and recursive resolvers (that resolve DNS queries when any of our servers need to look up a name). Deploying DNS changeshttps://wikitech.wikimedia.org/wiki/DNS#Deploying_DNS_changes Change GeoDNS / Depool a Sitehttps://wikitech.wikimedia.org/wiki/DNS#Change_GeoDNS_/_Depool_a_Site Authoritative nameservershttps://wikitech.wikimedia.org/wiki/DNS#Authoritative_nameservers Debugging Public Nameserver IP mappinghttps://wikitech.wikimedia.org/wiki/DNS#Debugging_Public_Nameserver_IP_mapping Domain templateshttps://wikitech.wikimedia.org/wiki/DNS#Domain_templates Variables and macroshttps://wikitech.wikimedia.org/wiki/DNS#Variables_and_macros authdns-local-updatehttps://wikitech.wikimedia.org/wiki/DNS#authdns-local-update Geographic DNShttps://wikitech.wikimedia.org/wiki/DNS#Geographic_DNS How to make DNS changeshttps://wikitech.wikimedia.org/wiki/DNS#How_to_make_DNS_changes Changing records in a zonefilehttps://wikitech.wikimedia.org/wiki/DNS#Changing_records_in_a_zonefile Netbox-driven dynamic datahttps://wikitech.wikimedia.org/wiki/DNS#Netbox-driven_dynamic_data Adding a new zonehttps://wikitech.wikimedia.org/wiki/DNS#Adding_a_new_zone Removing a zonehttps://wikitech.wikimedia.org/wiki/DNS#Removing_a_zone Adding a new (language) wikihttps://wikitech.wikimedia.org/wiki/DNS#Adding_a_new_(language)_wiki If a certain nameserver is unreachablehttps://wikitech.wikimedia.org/wiki/DNS#If_a_certain_nameserver_is_unreachable Linting the zone fileshttps://wikitech.wikimedia.org/wiki/DNS#Linting_the_zone_files Know to which DC a specific IP is redirectedhttps://wikitech.wikimedia.org/wiki/DNS#Know_to_which_DC_a_specific_IP_is_redirected Know which IP the AuthDNS is seeing a query fromhttps://wikitech.wikimedia.org/wiki/DNS#Know_which_IP_the_AuthDNS_is_seeing_a_query_from Update DNS if gerrit or DNS are down (on an emergency only)https://wikitech.wikimedia.org/wiki/DNS#Update_DNS_if_gerrit_or_DNS_are_down_(on_an_emergency_only) Recursive Resolvershttps://wikitech.wikimedia.org/wiki/DNS#Recursive_Resolvers Wipe cacheshttps://wikitech.wikimedia.org/wiki/DNS#Wipe_caches How to manually remove, a record from the DNS resolver caches (flush / wipe / clear dns resolver cache)https://wikitech.wikimedia.org/wiki/DNS#How_to_manually_remove,_a_record_from_the_DNS_resolver_caches_(flush_/_wipe_/_clear_dns_resolver_cache) How to manually remove an entire domain from the DNS resolver cacheshttps://wikitech.wikimedia.org/wiki/DNS#How_to_manually_remove_an_entire_domain_from_the_DNS_resolver_caches Service Checkshttps://wikitech.wikimedia.org/wiki/DNS#Service_Checks authdns update runhttps://wikitech.wikimedia.org/wiki/DNS#authdns_update_run gdnsd checkconfhttps://wikitech.wikimedia.org/wiki/DNS#gdnsd_checkconf See alsohttps://wikitech.wikimedia.org/wiki/DNS#See_also External linkshttps://wikitech.wikimedia.org/wiki/DNS#External_links https://wikitech.wikimedia.org/wiki/Dsh DSH stands for dancer's shell / distributed shell and is a way to run commands via SSH on many hosts at once. Deploymenthttps://wikitech.wikimedia.org/wiki/Category:Deployment https://wikitech.wikimedia.org/wiki/How-To For a complete list of How-To guides, check :Category:How-To. Deploymenthttps://wikitech.wikimedia.org/wiki/How-To#Deployment Databasehttps://wikitech.wikimedia.org/wiki/How-To#Database Application servershttps://wikitech.wikimedia.org/wiki/How-To#Application_servers Wikifarmhttps://wikitech.wikimedia.org/wiki/How-To#Wikifarm Other operationshttps://wikitech.wikimedia.org/wiki/How-To#Other_operations https://wikitech.wikimedia.org/wiki/Esams_data_center esams (pronounced ee-sams) is a caching data center located at [Realty's] AMS9 data center in [The Netherlands. Historyhttps://wikitech.wikimedia.org/wiki/Esams_data_center#History Usagehttps://wikitech.wikimedia.org/wiki/Esams_data_center#Usage Layouthttps://wikitech.wikimedia.org/wiki/Esams_data_center#Layout Galleryhttps://wikitech.wikimedia.org/wiki/Esams_data_center#Gallery See alsohttps://wikitech.wikimedia.org/wiki/Esams_data_center#See_also https://wikitech.wikimedia.org/wiki/SRE/LDAP Wikimedia's LDAP configurations apply to logins in Toolforge and Cloud VPSes using sssd. However, some configurations come directly from Puppet's data. LDAP in Productionhttps://wikitech.wikimedia.org/wiki/SRE/LDAP#LDAP_in_Production Installing/Configuring the serverhttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Installing/Configuring_the_server Create indexeshttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Create_indexes Add a proxy agenthttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Add_a_proxy_agent Troubleshootinghttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Troubleshooting Where to find logshttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Where_to_find_logs Corrupt nscd cachehttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Corrupt_nscd_cache Invalid nscd cachehttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Invalid_nscd_cache Debugging sudo-ldaphttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Debugging_sudo-ldap Debugging autofshttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Debugging_autofs Common LDAP administrative actionshttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Common_LDAP_administrative_actions Display extended info about a userhttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Display_extended_info_about_a_user Show group members / check a user is already a member of a grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Show_group_members_/_check_a_user_is_already_a_member_of_a_group Find a user by email addresshttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Find_a_user_by_email_address Add a user to a grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Add_a_user_to_a_group Method 1https://wikitech.wikimedia.org/wiki/SRE/LDAP#Method_1 Method 2https://wikitech.wikimedia.org/wiki/SRE/LDAP#Method_2 Remove a user from a grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Remove_a_user_from_a_group Finding the shell name of a userhttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Finding_the_shell_name_of_a_user Editing info about a userhttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Editing_info_about_a_user Changing the password of a userhttps://wikitech.wikimedia.org/wiki/SRE/LDAP#Changing_the_password_of_a_user LDAP structurehttps://wikitech.wikimedia.org/wiki/SRE/LDAP#LDAP_structure See Alsohttps://wikitech.wikimedia.org/wiki/SRE/LDAP#See_Also https://wikitech.wikimedia.org/wiki/Lifetime_of_an_issue Issues are handled like this: Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Linux_Apache2_modsetproctitle /* The code for Apache1 can be found at dammit.lt */ How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To https://wikitech.wikimedia.org/wiki/Search/Old This infrastructure doesn't exist anymore Usagehttps://wikitech.wikimedia.org/wiki/Search/Old#Usage Overviewhttps://wikitech.wikimedia.org/wiki/Search/Old#Overview Softwarehttps://wikitech.wikimedia.org/wiki/Search/Old#Software Extension:MWSearchhttps://wikitech.wikimedia.org/wiki/Search/Old#Extension:MWSearch lsearchdhttps://wikitech.wikimedia.org/wiki/Search/Old#lsearchd Essentialshttps://wikitech.wikimedia.org/wiki/Search/Old#Essentials Installationhttps://wikitech.wikimedia.org/wiki/Search/Old#Installation Configurationhttps://wikitech.wikimedia.org/wiki/Search/Old#Configuration Indexinghttps://wikitech.wikimedia.org/wiki/Search/Old#Indexing Search Cluster: Shards, Pools, and Load Balancing Oh My!https://wikitech.wikimedia.org/wiki/Search/Old#Search_Cluster:_Shards,_Pools,_and_Load_Balancing_Oh_My! Index Shardinghttps://wikitech.wikimedia.org/wiki/Search/Old#Index_Sharding Poolshttps://wikitech.wikimedia.org/wiki/Search/Old#Pools Administrationhttps://wikitech.wikimedia.org/wiki/Search/Old#Administration Dependencieshttps://wikitech.wikimedia.org/wiki/Search/Old#Dependencies Health/Activity Monitoringhttps://wikitech.wikimedia.org/wiki/Search/Old#Health/Activity_Monitoring Software Updateshttps://wikitech.wikimedia.org/wiki/Search/Old#Software_Updates Stopping and fall back to MediaWiki's searchhttps://wikitech.wikimedia.org/wiki/Search/Old#Stopping_and_fall_back_to_MediaWiki's_search Adding new wikishttps://wikitech.wikimedia.org/wiki/Search/Old#Adding_new_wikis Troublehttps://wikitech.wikimedia.org/wiki/Search/Old#Trouble What to do if you get a page about a search poolhttps://wikitech.wikimedia.org/wiki/Search/Old#What_to_do_if_you_get_a_page_about_a_search_pool Main indexer on searchidx2/searchidx1001 is stuckhttps://wikitech.wikimedia.org/wiki/Search/Old#Main_indexer_on_searchidx2/searchidx1001_is_stuck Individual lsearchd processes are crashing or nonresponsivehttps://wikitech.wikimedia.org/wiki/Search/Old#Individual_lsearchd_processes_are_crashing_or_nonresponsive Space Issues on Cluster Hosthttps://wikitech.wikimedia.org/wiki/Search/Old#Space_Issues_on_Cluster_Host Cluster Host Hardware Failurehttps://wikitech.wikimedia.org/wiki/Search/Old#Cluster_Host_Hardware_Failure Indexer Host Hardware Failurehttps://wikitech.wikimedia.org/wiki/Search/Old#Indexer_Host_Hardware_Failure Excess Load on a Cluster Hosthttps://wikitech.wikimedia.org/wiki/Search/Old#Excess_Load_on_a_Cluster_Host https://wikitech.wikimedia.org/wiki/LVS/ha.cf <- back to LVS https://wikitech.wikimedia.org/wiki/LVS LVS, or Linux Virtual Server, is used at Wikimedia Foundation as a high-traffic Layer 4 load balancer. Introductionhttps://wikitech.wikimedia.org/wiki/LVS#Introduction Overviewhttps://wikitech.wikimedia.org/wiki/LVS#Overview IPIP encapsulation experimentshttps://wikitech.wikimedia.org/wiki/LVS#IPIP_encapsulation_experiments HOWTOhttps://wikitech.wikimedia.org/wiki/LVS#HOWTO Etcd as a backend to Pybal (All of production)https://wikitech.wikimedia.org/wiki/LVS#Etcd_as_a_backend_to_Pybal_(All_of_production) Planned reboot of LVS servershttps://wikitech.wikimedia.org/wiki/LVS#Planned_reboot_of_LVS_servers Planned reboots of Varnish frontendshttps://wikitech.wikimedia.org/wiki/LVS#Planned_reboots_of_Varnish_frontends Pool or depool hosts (for non-Etcd managed pools)https://wikitech.wikimedia.org/wiki/LVS#Pool_or_depool_hosts_(for_non-Etcd_managed_pools) Emergency situationshttps://wikitech.wikimedia.org/wiki/LVS#Emergency_situations See which LVS balancer is active for a given servicehttps://wikitech.wikimedia.org/wiki/LVS#See_which_LVS_balancer_is_active_for_a_given_service To see all LVS servers configured for a servicehttps://wikitech.wikimedia.org/wiki/LVS#To_see_all_LVS_servers_configured_for_a_service Deploy a change to an existing servicehttps://wikitech.wikimedia.org/wiki/LVS#Deploy_a_change_to_an_existing_service Add a new load balanced servicehttps://wikitech.wikimedia.org/wiki/LVS#Add_a_new_load_balanced_service Please read before we get started...https://wikitech.wikimedia.org/wiki/LVS#Please_read_before_we_get_started... A quick note about SSL/TLShttps://wikitech.wikimedia.org/wiki/LVS#A_quick_note_about_SSL/TLS Add data in etcdhttps://wikitech.wikimedia.org/wiki/LVS#Add_data_in_etcd etcd data for backend selectionhttps://wikitech.wikimedia.org/wiki/LVS#etcd_data_for_backend_selection etcd data for DNS Discoveryhttps://wikitech.wikimedia.org/wiki/LVS#etcd_data_for_DNS_Discovery DNS changes (svc zone only)https://wikitech.wikimedia.org/wiki/LVS#DNS_changes_(svc_zone_only) Create an entry in the service::cataloghttps://wikitech.wikimedia.org/wiki/LVS#Create_an_entry_in_the_service::catalog Add the IPs on the backend servershttps://wikitech.wikimedia.org/wiki/LVS#Add_the_IPs_on_the_backend_servers Configure the load balancershttps://wikitech.wikimedia.org/wiki/LVS#Configure_the_load_balancers Add discovery/DNS resourceshttps://wikitech.wikimedia.org/wiki/LVS#Add_discovery/DNS_resources Make the service page (Optional)https://wikitech.wikimedia.org/wiki/LVS#Make_the_service_page_(Optional) Add the DNS Discovery Recordhttps://wikitech.wikimedia.org/wiki/LVS#Add_the_DNS_Discovery_Record For active/active serviceshttps://wikitech.wikimedia.org/wiki/LVS#For_active/active_services For active/passive serviceshttps://wikitech.wikimedia.org/wiki/LVS#For_active/passive_services For both active/active and active/passivehttps://wikitech.wikimedia.org/wiki/LVS#For_both_active/active_and_active/passive You're done! Your service will be now correctly configured to work in productionhttps://wikitech.wikimedia.org/wiki/LVS#You're_done!_Your_service_will_be_now_correctly_configured_to_work_in_production Remove a load balanced servicehttps://wikitech.wikimedia.org/wiki/LVS#Remove_a_load_balanced_service Silence network probeshttps://wikitech.wikimedia.org/wiki/LVS#Silence_network_probes Remove the discovery DNS recordhttps://wikitech.wikimedia.org/wiki/LVS#Remove_the_discovery_DNS_record Remove network probes / monitoringhttps://wikitech.wikimedia.org/wiki/LVS#Remove_network_probes_/_monitoring Remove the service from the load-balancers and the backend servershttps://wikitech.wikimedia.org/wiki/LVS#Remove_the_service_from_the_load-balancers_and_the_backend_servers Final removalhttps://wikitech.wikimedia.org/wiki/LVS#Final_removal Cleanuphttps://wikitech.wikimedia.org/wiki/LVS#Cleanup LVS installationhttps://wikitech.wikimedia.org/wiki/LVS#LVS_installation LVS service configurationhttps://wikitech.wikimedia.org/wiki/LVS#LVS_service_configuration Classeshttps://wikitech.wikimedia.org/wiki/LVS#Classes BGP failover and load sharinghttps://wikitech.wikimedia.org/wiki/LVS#BGP_failover_and_load_sharing PyBal BGP configurationhttps://wikitech.wikimedia.org/wiki/LVS#PyBal_BGP_configuration Example BGP configuration for Juniper (cr1-esams)https://wikitech.wikimedia.org/wiki/LVS#Example_BGP_configuration_for_Juniper_(cr1-esams) SSH checkinghttps://wikitech.wikimedia.org/wiki/LVS#SSH_checking Diagnosing problemshttps://wikitech.wikimedia.org/wiki/LVS#Diagnosing_problems Incorrectly bound interfaceshttps://wikitech.wikimedia.org/wiki/LVS#Incorrectly_bound_interfaces LVSRealserverMSS alerthttps://wikitech.wikimedia.org/wiki/LVS#LVSRealserverMSS_alert Further readinghttps://wikitech.wikimedia.org/wiki/LVS#Further_reading https://wikitech.wikimedia.org/wiki/Mail == Overview of Wikimedia Mail == Overview of Wikimedia Mailhttps://wikitech.wikimedia.org/wiki/Mail#Overview_of_Wikimedia_Mail Product mailhttps://wikitech.wikimedia.org/wiki/Mail#Product_mail Listshttps://wikitech.wikimedia.org/wiki/Mail#Lists Foundation mailhttps://wikitech.wikimedia.org/wiki/Mail#Foundation_mail HowTohttps://wikitech.wikimedia.org/wiki/Mail#HowTo Modify aliaseshttps://wikitech.wikimedia.org/wiki/Mail#Modify_aliases IMAP account managementhttps://wikitech.wikimedia.org/wiki/Mail#IMAP_account_management Adding / removing a VRT System queue and mail addresseshttps://wikitech.wikimedia.org/wiki/Mail#Adding_/_removing_a_VRT_System_queue_and_mail_addresses Adding / removing mail domainshttps://wikitech.wikimedia.org/wiki/Mail#Adding_/_removing_mail_domains Searching the logshttps://wikitech.wikimedia.org/wiki/Mail#Searching_the_logs Design decisionshttps://wikitech.wikimedia.org/wiki/Mail#Design_decisions Softwarehttps://wikitech.wikimedia.org/wiki/Mail#Software Formats usedhttps://wikitech.wikimedia.org/wiki/Mail#Formats_used Mailbox storage and mail deliveryhttps://wikitech.wikimedia.org/wiki/Mail#Mailbox_storage_and_mail_delivery Authenticationhttps://wikitech.wikimedia.org/wiki/Mail#Authentication Layouthttps://wikitech.wikimedia.org/wiki/Mail#Layout Configuration detailshttps://wikitech.wikimedia.org/wiki/Mail#Configuration_details Account databasehttps://wikitech.wikimedia.org/wiki/Mail#Account_database Schemahttps://wikitech.wikimedia.org/wiki/Mail#Schema Mail relayhttps://wikitech.wikimedia.org/wiki/Mail#Mail_relay Resource limitshttps://wikitech.wikimedia.org/wiki/Mail#Resource_limits Aliaseshttps://wikitech.wikimedia.org/wiki/Mail#Aliases LDAP accounts and aliaseshttps://wikitech.wikimedia.org/wiki/Mail#LDAP_accounts_and_aliases IMAP mailhttps://wikitech.wikimedia.org/wiki/Mail#IMAP_mail RThttps://wikitech.wikimedia.org/wiki/Mail#RT VRTShttps://wikitech.wikimedia.org/wiki/Mail#VRTS @wikimedia.orghttps://wikitech.wikimedia.org/wiki/Mail#@wikimedia.org other domainshttps://wikitech.wikimedia.org/wiki/Mail#other_domains SpamAssassinhttps://wikitech.wikimedia.org/wiki/Mail#SpamAssassin System filterhttps://wikitech.wikimedia.org/wiki/Mail#System_filter Mailing listshttps://wikitech.wikimedia.org/wiki/Mail#Mailing_lists Wiki mailhttps://wikitech.wikimedia.org/wiki/Mail#Wiki_mail Postmasterhttps://wikitech.wikimedia.org/wiki/Mail#Postmaster Internal address rewritinghttps://wikitech.wikimedia.org/wiki/Mail#Internal_address_rewriting Secondary mail relayhttps://wikitech.wikimedia.org/wiki/Mail#Secondary_mail_relay Relay domainshttps://wikitech.wikimedia.org/wiki/Mail#Relay_domains IMAP serverhttps://wikitech.wikimedia.org/wiki/Mail#IMAP_server TLS supporthttps://wikitech.wikimedia.org/wiki/Mail#TLS_support Local mail submissionshttps://wikitech.wikimedia.org/wiki/Mail#Local_mail_submissions User filtershttps://wikitech.wikimedia.org/wiki/Mail#User_filters IMAP deliveryhttps://wikitech.wikimedia.org/wiki/Mail#IMAP_delivery User lefthttps://wikitech.wikimedia.org/wiki/Mail#User_left Vacation auto-replyhttps://wikitech.wikimedia.org/wiki/Mail#Vacation_auto-reply Smart hosthttps://wikitech.wikimedia.org/wiki/Mail#Smart_host SMTP authenticationhttps://wikitech.wikimedia.org/wiki/Mail#SMTP_authentication Dovecot deliverhttps://wikitech.wikimedia.org/wiki/Mail#Dovecot_deliver User database syncinghttps://wikitech.wikimedia.org/wiki/Mail#User_database_syncing Mail box cleanuphttps://wikitech.wikimedia.org/wiki/Mail#Mail_box_cleanup See alsohttps://wikitech.wikimedia.org/wiki/Mail#See_also Puppet configurationhttps://wikitech.wikimedia.org/wiki/Mail#Puppet_configuration Troubleshootinghttps://wikitech.wikimedia.org/wiki/Mail#Troubleshooting "Exim SMTP" Alertshttps://wikitech.wikimedia.org/wiki/Mail#"Exim_SMTP"_Alerts "Exim queue" Alertshttps://wikitech.wikimedia.org/wiki/Mail#"Exim_queue"_Alerts External documentationhttps://wikitech.wikimedia.org/wiki/Mail#External_documentation https://wikitech.wikimedia.org/wiki/Mailman == See also == See alsohttps://wikitech.wikimedia.org/wiki/Mailman#See_also Componentshttps://wikitech.wikimedia.org/wiki/Mailman#Components Who has access?https://wikitech.wikimedia.org/wiki/Mailman#Who_has_access? Mailman3https://wikitech.wikimedia.org/wiki/Mailman#Mailman3 How Tohttps://wikitech.wikimedia.org/wiki/Mailman#How_To Create a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman#Create_a_mailing_list Disable or re-enable a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman#Disable_or_re-enable_a_mailing_list Remove a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman#Remove_a_mailing_list Remove a message from the mailing list archiveshttps://wikitech.wikimedia.org/wiki/Mailman#Remove_a_message_from_the_mailing_list_archives Export a listing of all subscribers to a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman#Export_a_listing_of_all_subscribers_to_a_mailing_list Check if an email address is subscribed to any listshttps://wikitech.wikimedia.org/wiki/Mailman#Check_if_an_email_address_is_subscribed_to_any_lists Remove an individual from all mailing listshttps://wikitech.wikimedia.org/wiki/Mailman#Remove_an_individual_from_all_mailing_lists Reset a user's passwordhttps://wikitech.wikimedia.org/wiki/Mailman#Reset_a_user's_password Rename a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman#Rename_a_mailing_list Import from Google Groupshttps://wikitech.wikimedia.org/wiki/Mailman#Import_from_Google_Groups Add a list to Gmanehttps://wikitech.wikimedia.org/wiki/Mailman#Add_a_list_to_Gmane Docs and linkshttps://wikitech.wikimedia.org/wiki/Mailman#Docs_and_links Authorized recipients for ops@lists.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Mailman#Authorized_recipients_for_ops@lists.wikimedia.org Migrate servershttps://wikitech.wikimedia.org/wiki/Mailman#Migrate_servers Upgrading Mailman3https://wikitech.wikimedia.org/wiki/Mailman#Upgrading_Mailman3 Block abusive traffichttps://wikitech.wikimedia.org/wiki/Mailman#Block_abusive_traffic Configuration detailshttps://wikitech.wikimedia.org/wiki/Mailman#Configuration_details Packageshttps://wikitech.wikimedia.org/wiki/Mailman#Packages Mailman setuphttps://wikitech.wikimedia.org/wiki/Mailman#Mailman_setup Mail server setuphttps://wikitech.wikimedia.org/wiki/Mailman#Mail_server_setup Web server setuphttps://wikitech.wikimedia.org/wiki/Mailman#Web_server_setup Backupshttps://wikitech.wikimedia.org/wiki/Mailman#Backups Tested failure modeshttps://wikitech.wikimedia.org/wiki/Mailman#Tested_failure_modes Spamd not runninghttps://wikitech.wikimedia.org/wiki/Mailman#Spamd_not_running Mailman not runninghttps://wikitech.wikimedia.org/wiki/Mailman#Mailman_not_running Spam fightinghttps://wikitech.wikimedia.org/wiki/Mailman#Spam_fighting Templateshttps://wikitech.wikimedia.org/wiki/Mailman#Templates Monitoringhttps://wikitech.wikimedia.org/wiki/Mailman#Monitoring Mailman2 datahttps://wikitech.wikimedia.org/wiki/Mailman#Mailman2_data https://wikitech.wikimedia.org/wiki/Maurus maurus was the lead lucene search server in pmtpa. Serviceshttps://wikitech.wikimedia.org/wiki/Maurus#Services Batch jobshttps://wikitech.wikimedia.org/wiki/Maurus#Batch_jobs https://wikitech.wikimedia.org/wiki/MediaWiki_HTTP_cache_headers Varnish and Apache Traffic Server cache Wikipedia content. Cachinghttps://wikitech.wikimedia.org/wiki/Category:Caching Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation SRE Traffichttps://wikitech.wikimedia.org/wiki/Category:SRE_Traffic https://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki This page is about Memcached for MediaWiki. Magic numbershttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Magic_numbers WANObjectCachehttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#WANObjectCache High levelhttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#High_level Memcached commandshttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Memcached_commands Getting revision/page from WANCache keyhttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Getting_revision/page_from_WANCache_key Infrastructurehttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Infrastructure Mcrouterhttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Mcrouter Mcrouter Routeshttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Mcrouter_Routes Examplehttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Example Servershttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Servers Runbookshttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Runbooks Dashboardshttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Dashboards Linkshttps://wikitech.wikimedia.org/wiki/Memcached_for_MediaWiki#Links https://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging HTCP] purging was the dominant method of purging Varnish/ATS HTTP cache objects in our Traffic infrastructure fro 2013 until July 2020, which is when we switched to [[Kafka HTTP purging|Kafka-based CDN purging. See Typical Purge Flowhttps://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#Typical_Purge_Flow Risks for loss of purge requestshttps://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#Risks_for_loss_of_purge_requests MediaWikihttps://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#MediaWiki One-off purgehttps://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#One-off_purge Troubleshootinghttps://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#Troubleshooting External linkshttps://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#External_links https://wikitech.wikimedia.org/wiki/MySQL See also MariaDB. Editing db.phphttps://wikitech.wikimedia.org/wiki/MySQL#Editing_db.php Common taskshttps://wikitech.wikimedia.org/wiki/MySQL#Common_tasks Comprehensive documentationhttps://wikitech.wikimedia.org/wiki/MySQL#Comprehensive_documentation Replication laghttps://wikitech.wikimedia.org/wiki/MySQL#Replication_lag Long-running readshttps://wikitech.wikimedia.org/wiki/MySQL#Long-running_reads General overloadhttps://wikitech.wikimedia.org/wiki/MySQL#General_overload Listing querieshttps://wikitech.wikimedia.org/wiki/MySQL#Listing_queries Killing querieshttps://wikitech.wikimedia.org/wiki/MySQL#Killing_queries High write ratehttps://wikitech.wikimedia.org/wiki/MySQL#High_write_rate Broken replicationhttps://wikitech.wikimedia.org/wiki/MySQL#Broken_replication Maintenance Recipeshttps://wikitech.wikimedia.org/wiki/MySQL#Maintenance_Recipes clear out old binlogs to free up spacehttps://wikitech.wikimedia.org/wiki/MySQL#clear_out_old_binlogs_to_free_up_space misc. snippetshttps://wikitech.wikimedia.org/wiki/MySQL#misc._snippets show database / table sizeshttps://wikitech.wikimedia.org/wiki/MySQL#show_database_/_table_sizes size of one database, tables in detailhttps://wikitech.wikimedia.org/wiki/MySQL#size_of_one_database,_tables_in_detail all databaseshttps://wikitech.wikimedia.org/wiki/MySQL#all_databases https://wikitech.wikimedia.org/wiki/Icinga Icinga ( http://www.icinga. Paging / Alert System Detailshttps://wikitech.wikimedia.org/wiki/Icinga#Paging_/_Alert_System_Details Configurationhttps://wikitech.wikimedia.org/wiki/Icinga#Configuration Puppethttps://wikitech.wikimedia.org/wiki/Icinga#Puppet Custom Checkshttps://wikitech.wikimedia.org/wiki/Icinga#Custom_Checks Grafanahttps://wikitech.wikimedia.org/wiki/Icinga#Grafana IRC notificationhttps://wikitech.wikimedia.org/wiki/Icinga#IRC_notification Updating channels where notifications are senthttps://wikitech.wikimedia.org/wiki/Icinga#Updating_channels_where_notifications_are_sent Acknowledgement logichttps://wikitech.wikimedia.org/wiki/Icinga#Acknowledgement_logic Scheduling downtimes with a shell commandhttps://wikitech.wikimedia.org/wiki/Icinga#Scheduling_downtimes_with_a_shell_command Removing downtimes with a shell commandhttps://wikitech.wikimedia.org/wiki/Icinga#Removing_downtimes_with_a_shell_command Disabling notifications programmaticallyhttps://wikitech.wikimedia.org/wiki/Icinga#Disabling_notifications_programmatically Failover Icinga between the active and passive servershttps://wikitech.wikimedia.org/wiki/Icinga#Failover_Icinga_between_the_active_and_passive_servers Check validity of the Icinga's confighttps://wikitech.wikimedia.org/wiki/Icinga#Check_validity_of_the_Icinga's_config Meta-monitoring of Icinga itselfhttps://wikitech.wikimedia.org/wiki/Icinga#Meta-monitoring_of_Icinga_itself Restartinghttps://wikitech.wikimedia.org/wiki/Icinga#Restarting IRC bothttps://wikitech.wikimedia.org/wiki/Icinga#IRC_bot Avoid Icinga spam on new server installshttps://wikitech.wikimedia.org/wiki/Icinga#Avoid_Icinga_spam_on_new_server_installs How to handle active alertshttps://wikitech.wikimedia.org/wiki/Icinga#How_to_handle_active_alerts Conceptshttps://wikitech.wikimedia.org/wiki/Icinga#Concepts Statementshttps://wikitech.wikimedia.org/wiki/Icinga#Statements Runbookhttps://wikitech.wikimedia.org/wiki/Icinga#Runbook Operationshttps://wikitech.wikimedia.org/wiki/Icinga#Operations IcingaOverloadhttps://wikitech.wikimedia.org/wiki/Icinga#IcingaOverload https://wikitech.wikimedia.org/wiki/Network_design_(historic) == AS 14907 == AS 14907https://wikitech.wikimedia.org/wiki/Network_design_(historic)#AS_14907 Subnetshttps://wikitech.wikimedia.org/wiki/Network_design_(historic)#Subnets eqiadhttps://wikitech.wikimedia.org/wiki/Network_design_(historic)#eqiad AS 43821https://wikitech.wikimedia.org/wiki/Network_design_(historic)#AS_43821 2010https://wikitech.wikimedia.org/wiki/Network_design_(historic)#2010 2009https://wikitech.wikimedia.org/wiki/Network_design_(historic)#2009 2008https://wikitech.wikimedia.org/wiki/Network_design_(historic)#2008 See alsohttps://wikitech.wikimedia.org/wiki/Network_design_(historic)#See_also https://wikitech.wikimedia.org/wiki/NTP All servers are time-synchronised using the NTP protocol. In pmtpa, this is managed by Puppet, with the ntp::client class in ntp. Testinghttps://wikitech.wikimedia.org/wiki/NTP#Testing Monitoringhttps://wikitech.wikimedia.org/wiki/NTP#Monitoring Service Restart Checkhttps://wikitech.wikimedia.org/wiki/NTP#Service_Restart_Check https://wikitech.wikimedia.org/wiki/VRT_System Znuny, a community fork of OTRS which went closed source in version 7.x, forcing us to adopt Znuny, is installed on vtrs1001. Termshttps://wikitech.wikimedia.org/wiki/VRT_System#Terms Noteshttps://wikitech.wikimedia.org/wiki/VRT_System#Notes Backupshttps://wikitech.wikimedia.org/wiki/VRT_System#Backups https://wikitech.wikimedia.org/wiki/DNS/PowerDNS http://www.powerdns. Configurationhttps://wikitech.wikimedia.org/wiki/DNS/PowerDNS#Configuration Geobackend configurationhttps://wikitech.wikimedia.org/wiki/DNS/PowerDNS#Geobackend_configuration Provisioninghttps://wikitech.wikimedia.org/wiki/DNS/PowerDNS#Provisioning External linkshttps://wikitech.wikimedia.org/wiki/DNS/PowerDNS#External_links https://wikitech.wikimedia.org/wiki/Reattribute_edits Not usually done anymore, Special:Renameuser is good enough for most people. How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To MediaWiki productionhttps://wikitech.wikimedia.org/wiki/Category:MediaWiki_production Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive This page is about the removal of a message sent to a Wikimedia Foundation mailing list. Please read all this before doing anything. Current situationhttps://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive#Current_situation How-tohttps://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive#How-to Private mailhttps://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive#Private_mail Mailman archiveshttps://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive#Mailman_archives Gmanehttps://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive#Gmane Other archiveshttps://wikitech.wikimedia.org/wiki/Remove_a_message_from_mailing_list_archive#Other_archives https://wikitech.wikimedia.org/wiki/Sandbox List: Pages with FIXME on themhttps://wikitech.wikimedia.org/wiki/Category:Pages_with_FIXME_on_them https://wikitech.wikimedia.org/wiki/Screen screen is a terminal multiplexer. Multiple windows inside one "screen"https://wikitech.wikimedia.org/wiki/Screen#Multiple_windows_inside_one_"screen" Splitting windowshttps://wikitech.wikimedia.org/wiki/Screen#Splitting_windows Detaching and Re-attachinghttps://wikitech.wikimedia.org/wiki/Screen#Detaching_and_Re-attaching Attaching a shared "screen"https://wikitech.wikimedia.org/wiki/Screen#Attaching_a_shared_"screen" Troubleshootinghttps://wikitech.wikimedia.org/wiki/Screen#Troubleshooting External linkhttps://wikitech.wikimedia.org/wiki/Screen#External_link https://wikitech.wikimedia.org/wiki/Scripts * Sync scripts Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Security Wikitech is meant to host procedural or instructional material that is not training. Content on this wiki is likely to relate to the Wikimedia Foundation hosted wikis, and related ecosystem. How Tohttps://wikitech.wikimedia.org/wiki/Security#How_To Security mailing lists to followhttps://wikitech.wikimedia.org/wiki/Security#Security_mailing_lists_to_follow Related Security Contenthttps://wikitech.wikimedia.org/wiki/Security#Related_Security_Content https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1 __NOTOC__ 28 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#28_September 25 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#25_September 24 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#24_September 23 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#23_September 21 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#21_September 20 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#20_September 19 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#19_September 18 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#18_September 17 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#17_September 16 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#16_September 15 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#15_September 14 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#14_September 13 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#13_September 12 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#12_September 11 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#11_September 10 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#10_September 9 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#9_September 8 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#8_September 7 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#7_September 6 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#6_September 5 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#5_September 3 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#3_September 2 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#2_September 1 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#1_September 31 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#31_August 30 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#30_August 28 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#28_August 27 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#27_August 26 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#26_August 25 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#25_August 24 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#24_August 22 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#22_August 21 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#21_August 20 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#20_August 19 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#19_August 18 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#18_August 17 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#17_August 13 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#13_August 12 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#12_August 11 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#11_August 10 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#10_August 09 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#09_August 06 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#06_August 05 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#05_August 04 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#04_August 03 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#03_August 02 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#02_August 01 Augusthttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#01_August 31 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#31_July 30 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#30_July 29 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#29_July 28 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#28_July 27 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#27_July 26 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#26_July 24 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#24_July 21 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#21_July 20 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#20_July 19 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#19_July 18 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#18_July 16 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#16_July 15 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#15_July 14 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#14_July 13 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#13_July 12 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#12_July 11 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#11_July 10 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#10_July 9 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#9_July 8 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#8_July 4 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#4_July 3 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#3_July 2 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#2_July 30 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#30_June 29 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#29_June 28 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#28_June 27 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#27_June 26 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#26_June 25 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#25_June June 24 2004https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#June_24_2004 June 23 2004https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#June_23_2004 before 2004-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_1#before_2004-06-23 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2 == 30 November == 30 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#30_November 28 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#28_November 27 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#27_November 26 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#26_November 24 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#24_November 23 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#23_November 22 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#22_November 21 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#21_November 20 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#20_November 19 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#19_November 18 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#18_November 17 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#17_November 16 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#16_November 15 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#15_November 13 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#13_November 12 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#12_November 11 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#11_November 10 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#10_November 9 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#9_November 8 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#8_November 6 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#6_November 5 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#5_November 3 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#3_November 2 Novemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#2_November 31 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#31_October 30 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#30_October 29 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#29_October 28 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#28_October 27 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#27_October 26 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#26_October 25 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#25_October 24 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#24_October 23 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#23_October 22 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#22_October 21 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#21_October 20 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#20_October 18 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#18_October 17 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#17_October 16 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#16_October 14 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#14_October 13 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#13_October 12 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#12_October 11 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#11_October 10 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#10_October 09 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#09_October 08 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#08_October 07 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#07_October 05 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#05_October 04 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#04_October 03 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#03_October 01 Octoberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#01_October 30 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#30_September 29 Septemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_2#29_September https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3 == 30 March == 30 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#30_March 29 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#29_March 28 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#28_March 27 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#27_March 26 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#26_March 25 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#25_March 24 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#24_March 23 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#23_March 22 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#22_March 19 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#19_March 18 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#18_March 17 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#17_March 16 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#16_March 14 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#14_March 13 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#13_March 11 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#11_March 10 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#10_March 9 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#9_March 8 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#8_March 7 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#7_March 6 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#6_March 5 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#5_March 4 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#4_March 3 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#3_March 2 Marchhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#2_March 28 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#28_February 27 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#27_February 26 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#26_February 25 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#25_February 24 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#24_February 22-23 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#22-23_February 21 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#21_February 19 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#19_February 18 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#18_February 16 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#16_February 14 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#14_February 12 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#12_February 10 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#10_February 9 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#9_February 8 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#8_February 7 Februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#7_February 6 februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#6_february 5 februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#5_february 4 februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#4_february 3 februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#3_february 1 februaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#1_february 30 januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#30_january 29 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#29_January 28 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#28_January 27 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#27_January 25 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#25_January 24 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#24_January 23 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#23_January 22 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#22_January 21 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#21_January 20 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#20_January 19 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#19_January 18 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#18_January 17 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#17_January 16 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#16_January 15 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#15_January 14 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#14_January 13 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#13_January 12 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#12_January 11 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#11_January 10 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#10_January 9 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#9_January 8 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#8_January 6 Januaryhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#6_January 5 January 2005https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#5_January_2005 4 January 2005https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#4_January_2005 3 January 2005https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#3_January_2005 29 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#29_December 28 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#28_December 27 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#27_December 26 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#26_December 25 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#25_December 23 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#23_December 22 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#22_December 21 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#21_December 19 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#19_December 18 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#18_December 17 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#17_December 15 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#15_December 14 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#14_December 12 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#12_December 11 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#11_December 10 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#10_December 8 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#8_December 7 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#7_December 6 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#6_December 3 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#3_December 1 Decemberhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_3#1_December https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4 == July 31 == July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_31 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_24 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_19 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_16 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#July_4 3 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#3_July 2 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#2_July 1 Julyhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#1_July 30 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#30_June 29 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#29_June 28 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#28_June 27 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#27_June 26 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#26_June 24 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#24_June 23 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#23_June 22 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#22_June 21 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#21_June 19 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#19_June 18 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#18_June 16 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#16_June 15 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#15_June 14 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#14_June 13 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#13_June 12 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#12_June 11 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#11_June 10 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#10_June 9 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#9_June 8 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#8_June 7 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#7_June 6 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#6_June 5 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#5_June 4 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#4_June 3 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#3_June 2 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#2_June 1 Junehttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#1_June 31 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#31_May 30 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#30_May 29 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#29_May 28 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#28_May 27 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#27_May 26 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#26_May 25 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#25_May 24 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#24_May 23 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#23_May 22 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#22_May 21 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#21_May 20 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#20_May 19 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#19_May 18 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#18_May 17 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#17_May 16 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#16_May 15 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#15_May 14 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#14_May 13 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#13_May 12 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#12_May 11 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#11_May 10 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#10_May 9 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#9_May 8 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#8_May 7 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#7_May 6 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#6_May 5 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#5_May 4 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#4_May 3 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#3_May 2 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#2_May 1 Mayhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#1_May 30 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#30_April 29 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#29_April 28 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#28_April 27 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#27_April 26 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#26_April 25 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#25_April 24 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#24_April 23 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#23_April 22 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#22_April 21 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#21_April 20 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#20_April 19 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#19_April 17 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#17_April 14 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#14_April 13 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#13_April 12 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#12_April 11 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#11_April 10 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#10_April 9 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#9_April 8 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#8_April 7 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#7_April 6 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#6_April 4 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#4_April 3 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#3_April 1 Aprilhttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_4#1_April https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5 == October 31 == October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_15 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#September_1 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_11 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_9 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_8 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_7 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_5#August_1 https://wikitech.wikimedia.org/wiki/Spider_blocks To block a spider, edit the spider list in text-acls.conf, upload-acls. How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Wikimedia.org_zone_file < DNS alterations to be madehttps://wikitech.wikimedia.org/wiki/Wikimedia.org_zone_file#alterations_to_be_made to addhttps://wikitech.wikimedia.org/wiki/Wikimedia.org_zone_file#to_add to removehttps://wikitech.wikimedia.org/wiki/Wikimedia.org_zone_file#to_remove https://wikitech.wikimedia.org/wiki/Zedler/kernel_panic kernel panic at boot on 2005-09-23, kernel 2.6. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/IRCD This page contained information about a service which is no longer in active use and has been replaced by Ircstream. https://wikitech.wikimedia.org/wiki/Pascal Pascal is the management server of the Kennisnet cluster. It is a Sun V40z dual CPU, 2 GB memory and 2 disks. Serviceshttps://wikitech.wikimedia.org/wiki/Pascal#Services Failurehttps://wikitech.wikimedia.org/wiki/Pascal#Failure https://wikitech.wikimedia.org/wiki/IRC == About IRC and Wikitech == About IRC and Wikitechhttps://wikitech.wikimedia.org/wiki/IRC#About_IRC_and_Wikitech Why IRC?https://wikitech.wikimedia.org/wiki/IRC#Why_IRC? IRC Channels in Usehttps://wikitech.wikimedia.org/wiki/IRC#IRC_Channels_in_Use Planninghttps://wikitech.wikimedia.org/wiki/IRC#Planning Winter/Spring 2019 SRE-related channels Cleanup efforthttps://wikitech.wikimedia.org/wiki/IRC#Winter/Spring_2019_SRE-related_channels_Cleanup_effort See alsohttps://wikitech.wikimedia.org/wiki/IRC#See_also https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9 == January 30 == January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_29 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_26 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_19 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_16 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_13 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#January_1 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_25 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_20 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_14 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_9#October_1 https://wikitech.wikimedia.org/wiki/Sage Knams data centerhttps://wikitech.wikimedia.org/wiki/Category:Knams_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Squids_deployment The 10 new Squid servers (single opterons with 4 disks) have been deployed as follows. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/HTTPS/CAcert http://www.cacert. Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Slow_require_once Here are the syscalls made on the second and subsequent invocations of require_once("Setup.php"): Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/PyBal PyBal is an automated manager for LVS. We use it to continously monitor Varnish or Apache servers and change the LVS load balancer pooling and weights accordingly. Featureshttps://wikitech.wikimedia.org/wiki/PyBal#Features Setuphttps://wikitech.wikimedia.org/wiki/PyBal#Setup How tohttps://wikitech.wikimedia.org/wiki/PyBal#How_to Updating PyBal on LVS instanceshttps://wikitech.wikimedia.org/wiki/PyBal#Updating_PyBal_on_LVS_instances Testinghttps://wikitech.wikimedia.org/wiki/PyBal#Testing Alertshttps://wikitech.wikimedia.org/wiki/PyBal#Alerts PyBal IPVS diff checkhttps://wikitech.wikimedia.org/wiki/PyBal#PyBal_IPVS_diff_check Services in IPVS but unknown to PyBalhttps://wikitech.wikimedia.org/wiki/PyBal#Services_in_IPVS_but_unknown_to_PyBal Services known to PyBal but not to IPVShttps://wikitech.wikimedia.org/wiki/PyBal#Services_known_to_PyBal_but_not_to_IPVS Pybal service has not been restartedhttps://wikitech.wikimedia.org/wiki/PyBal#Pybal_service_has_not_been_restarted See alsohttps://wikitech.wikimedia.org/wiki/PyBal#See_also External linkshttps://wikitech.wikimedia.org/wiki/PyBal#External_links https://wikitech.wikimedia.org/wiki/Fundraising This is the homepage for fundraising-tech documentation. If you can't find what you are looking from from here then take a look at our [plan] and add the appropriate header & links. External-facinghttps://wikitech.wikimedia.org/wiki/Fundraising#External-facing Paymentshttps://wikitech.wikimedia.org/wiki/Fundraising#Payments Mediawiki extensionshttps://wikitech.wikimedia.org/wiki/Fundraising#Mediawiki_extensions DonationInterfacehttps://wikitech.wikimedia.org/wiki/Fundraising#DonationInterface FundraisingEmailUnsubscribehttps://wikitech.wikimedia.org/wiki/Fundraising#FundraisingEmailUnsubscribe Central Noticehttps://wikitech.wikimedia.org/wiki/Fundraising#Central_Notice Fundraiser Landing Pagehttps://wikitech.wikimedia.org/wiki/Fundraising#Fundraiser_Landing_Page Landing Checkhttps://wikitech.wikimedia.org/wiki/Fundraising#Landing_Check Public reportinghttps://wikitech.wikimedia.org/wiki/Fundraising#Public_reporting Email Preference Centerhttps://wikitech.wikimedia.org/wiki/Fundraising#Email_Preference_Center CiviProxyhttps://wikitech.wikimedia.org/wiki/Fundraising#CiviProxy Donor Data Delivery Toolhttps://wikitech.wikimedia.org/wiki/Fundraising#Donor_Data_Delivery_Tool Internal-facinghttps://wikitech.wikimedia.org/wiki/Fundraising#Internal-facing CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising#CiviCRM End of year emails (EOY)https://wikitech.wikimedia.org/wiki/Fundraising#End_of_year_emails_(EOY) Matching Gifts HEP Integrationhttps://wikitech.wikimedia.org/wiki/Fundraising#Matching_Gifts_HEP_Integration Librarieshttps://wikitech.wikimedia.org/wiki/Fundraising#Libraries SmashPighttps://wikitech.wikimedia.org/wiki/Fundraising#SmashPig Service Providershttps://wikitech.wikimedia.org/wiki/Fundraising#Service_Providers Cluster layout, deployment, codebaseshttps://wikitech.wikimedia.org/wiki/Fundraising#Cluster_layout,_deployment,_codebases Analyticshttps://wikitech.wikimedia.org/wiki/Fundraising#Analytics Deploymenthttps://wikitech.wikimedia.org/wiki/Fundraising#Deployment Staging serverhttps://wikitech.wikimedia.org/wiki/Fundraising#Staging_server Redishttps://wikitech.wikimedia.org/wiki/Fundraising#Redis Grafanahttps://wikitech.wikimedia.org/wiki/Fundraising#Grafana Data and flowhttps://wikitech.wikimedia.org/wiki/Fundraising#Data_and_flow Gateway Chooserhttps://wikitech.wikimedia.org/wiki/Fundraising#Gateway_Chooser Payment processorshttps://wikitech.wikimedia.org/wiki/Fundraising#Payment_processors Instant Payment Notification (IPN) Listenerhttps://wikitech.wikimedia.org/wiki/Fundraising#Instant_Payment_Notification_(IPN)_Listener Email integration - Acoustic (Also known as Silverpop)https://wikitech.wikimedia.org/wiki/Fundraising#Email_integration_-_Acoustic_(Also_known_as_Silverpop) Message queueshttps://wikitech.wikimedia.org/wiki/Fundraising#Message_queues Stats Pipelinehttps://wikitech.wikimedia.org/wiki/Fundraising#Stats_Pipeline Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising#Recurring Monthly Converthttps://wikitech.wikimedia.org/wiki/Fundraising#Monthly_Convert Auditshttps://wikitech.wikimedia.org/wiki/Fundraising#Audits Fundraising/Data and flow/Transaction IDshttps://wikitech.wikimedia.org/wiki/Fundraising#Fundraising/Data_and_flow/Transaction_IDs Fraud filteringhttps://wikitech.wikimedia.org/wiki/Fundraising#Fraud_filtering Fail mailhttps://wikitech.wikimedia.org/wiki/Fundraising#Fail_mail Geolocationhttps://wikitech.wikimedia.org/wiki/Fundraising#Geolocation Fundraising Tech Opshttps://wikitech.wikimedia.org/wiki/Fundraising#Fundraising_Tech_Ops How we work (Team Processes)https://wikitech.wikimedia.org/wiki/Fundraising#How_we_work_(Team_Processes) Fundraising Emergencieshttps://wikitech.wikimedia.org/wiki/Fundraising#Fundraising_Emergencies Fundraising On-Call documentationhttps://wikitech.wikimedia.org/wiki/Fundraising#Fundraising_On-Call_documentation Feature / Bug Trackershttps://wikitech.wikimedia.org/wiki/Fundraising#Feature_/_Bug_Trackers PCI Compliancehttps://wikitech.wikimedia.org/wiki/Fundraising#PCI_Compliance Development Toolshttps://wikitech.wikimedia.org/wiki/Fundraising#Development_Tools Getting Startedhttps://wikitech.wikimedia.org/wiki/Fundraising#Getting_Started Dockerhttps://wikitech.wikimedia.org/wiki/Fundraising#Docker Gerrithttps://wikitech.wikimedia.org/wiki/Fundraising#Gerrit Gitlabhttps://wikitech.wikimedia.org/wiki/Fundraising#Gitlab CIhttps://wikitech.wikimedia.org/wiki/Fundraising#CI Testinghttps://wikitech.wikimedia.org/wiki/Fundraising#Testing HTML Email Development (under construction)https://wikitech.wikimedia.org/wiki/Fundraising#HTML_Email_Development_(under_construction) Logdoghttps://wikitech.wikimedia.org/wiki/Fundraising#Logdog All Subpageshttps://wikitech.wikimedia.org/wiki/Fundraising#All_Subpages https://wikitech.wikimedia.org/wiki/Piperate Piperate is a handy tool written by Michael Lyle to limit the bandwidth of a unix pipe. Adapted to use nanosleep() instead of sleep() by Tim Starling. https://wikitech.wikimedia.org/wiki/Debugging_memmove ==debug_memmove.c== debug_memmove.chttps://wikitech.wikimedia.org/wiki/Debugging_memmove#debug_memmove.c test.chttps://wikitech.wikimedia.org/wiki/Debugging_memmove#test.c Outputhttps://wikitech.wikimedia.org/wiki/Debugging_memmove#Output Samplehttps://wikitech.wikimedia.org/wiki/Debugging_memmove#Sample https://wikitech.wikimedia.org/wiki/Switch sup720 $28,000 Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6 == February 28 == February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#January_1 December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_28 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_6 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6# December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_6#November_1 https://wikitech.wikimedia.org/wiki/Mailman/Mailman2/Mailman_encoding_bug Two messages in mediawiki-l archives from February 2006 triggered this exciting error when rebuilding archives with 'wipe': Mailhttps://wikitech.wikimedia.org/wiki/Category:Mail https://wikitech.wikimedia.org/wiki/Cron_jobs More up-to-date information may be found on Maintenance server. Note that job queue jobs run continuously on many servers and are not a cron jobs. manual cron jobshttps://wikitech.wikimedia.org/wiki/Cron_jobs#manual_cron_jobs QueryPage updatehttps://wikitech.wikimedia.org/wiki/Cron_jobs#QueryPage_update Tor exit list updatehttps://wikitech.wikimedia.org/wiki/Cron_jobs#Tor_exit_list_update FlaggedRevs stats updatehttps://wikitech.wikimedia.org/wiki/Cron_jobs#FlaggedRevs_stats_update Ganglia RRD commithttps://wikitech.wikimedia.org/wiki/Cron_jobs#Ganglia_RRD_commit LDAP server backupshttps://wikitech.wikimedia.org/wiki/Cron_jobs#LDAP_server_backups SVN cronshttps://wikitech.wikimedia.org/wiki/Cron_jobs#SVN_crons puppetized cron jobshttps://wikitech.wikimedia.org/wiki/Cron_jobs#puppetized_cron_jobs Apachehttps://wikitech.wikimedia.org/wiki/Cron_jobs#Apache apaches::cronhttps://wikitech.wikimedia.org/wiki/Cron_jobs#apaches::cron Backuphttps://wikitech.wikimedia.org/wiki/Cron_jobs#Backup backup::serverhttps://wikitech.wikimedia.org/wiki/Cron_jobs#backup::server backup::mysqlhttps://wikitech.wikimedia.org/wiki/Cron_jobs#backup::mysql Puppethttps://wikitech.wikimedia.org/wiki/Cron_jobs#Puppet base::puppethttps://wikitech.wikimedia.org/wiki/Cron_jobs#base::puppet misc:puppetmasterhttps://wikitech.wikimedia.org/wiki/Cron_jobs#misc:puppetmaster DNShttps://wikitech.wikimedia.org/wiki/Cron_jobs#DNS dns::auth-serverhttps://wikitech.wikimedia.org/wiki/Cron_jobs#dns::auth-server dns::recursorhttps://wikitech.wikimedia.org/wiki/Cron_jobs#dns::recursor image scalerhttps://wikitech.wikimedia.org/wiki/Cron_jobs#image_scaler imagescaler::cronhttps://wikitech.wikimedia.org/wiki/Cron_jobs#imagescaler::cron LDAPhttps://wikitech.wikimedia.org/wiki/Cron_jobs#LDAP ldap::serverhttps://wikitech.wikimedia.org/wiki/Cron_jobs#ldap::server MediaWikihttps://wikitech.wikimedia.org/wiki/Cron_jobs#MediaWiki mediawiki::maintenancehttps://wikitech.wikimedia.org/wiki/Cron_jobs#mediawiki::maintenance Mischttps://wikitech.wikimedia.org/wiki/Cron_jobs#Misc misc::extension-distributorhttps://wikitech.wikimedia.org/wiki/Cron_jobs#misc::extension-distributor misc::nfs-server::homehttps://wikitech.wikimedia.org/wiki/Cron_jobs#misc::nfs-server::home ubuntu:mirrorhttps://wikitech.wikimedia.org/wiki/Cron_jobs#ubuntu:mirror misc::kiwix-mirrorhttps://wikitech.wikimedia.org/wiki/Cron_jobs#misc::kiwix-mirror https://wikitech.wikimedia.org/wiki/Backup * Bacula Backupshttps://wikitech.wikimedia.org/wiki/Category:Backups https://wikitech.wikimedia.org/wiki/External_storage The External Storage (ES) hosts are used to store the compressed text content of wiki page revisions in MariaDB databases. When a user asks for a page or a diff to an older version of a page, Mediawiki grabs the compressed content from the external store database and uses it to display the user's request. Servershttps://wikitech.wikimedia.org/wiki/External_storage#Servers Reading db.phphttps://wikitech.wikimedia.org/wiki/External_storage#Reading_db.php Nagios, Monitoring, and Healthhttps://wikitech.wikimedia.org/wiki/External_storage#Nagios,_Monitoring,_and_Health Nagioshttps://wikitech.wikimedia.org/wiki/External_storage#Nagios Healthhttps://wikitech.wikimedia.org/wiki/External_storage#Health Switching Icinga to OK read onlyhttps://wikitech.wikimedia.org/wiki/External_storage#Switching_Icinga_to_OK_read_only Backups and Snapshotshttps://wikitech.wikimedia.org/wiki/External_storage#Backups_and_Snapshots Database Schemahttps://wikitech.wikimedia.org/wiki/External_storage#Database_Schema See alsohttps://wikitech.wikimedia.org/wiki/External_storage#See_also https://wikitech.wikimedia.org/wiki/Ircecho ircecho is a python script used to read from a file and emit it to an IRC channel. It should be configure and deployed through puppet. Botshttps://wikitech.wikimedia.org/wiki/Category:Bots https://wikitech.wikimedia.org/wiki/UDP_based_profiling == What and Where == What and Wherehttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#What_and_Where Using The Graphite Dashboardhttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#Using_The_Graphite_Dashboard Finding Metricshttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#Finding_Metrics Combining Metricshttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#Combining_Metrics Types of Metricshttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#Types_of_Metrics Exampleshttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#Examples See alsohttps://wikitech.wikimedia.org/wiki/UDP_based_profiling#See_also https://wikitech.wikimedia.org/wiki/Foundry_Crossover_Procedure Lets figure out what steps we want to take in order to integrate the Foundry switch. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7 == June 30 == June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_14 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_7#March_1 https://wikitech.wikimedia.org/wiki/Debian Debian is the [distribution|GNU/Linux] distribution used on Wikimedia production servers and Cloud VPS instances. It replaced our previous usage of Ubuntu. Documentationhttps://wikitech.wikimedia.org/wiki/Debian#Documentation See alsohttps://wikitech.wikimedia.org/wiki/Debian#See_also https://wikitech.wikimedia.org/wiki/Switches/Vlan-change csw1: https://wikitech.wikimedia.org/wiki/Ubuntu_installer The ubuntu-installer is an older version of the Debian installer. This page describes how it works in the Automated installation setup of Wikimedia. Netboothttps://wikitech.wikimedia.org/wiki/Ubuntu_installer#Netboot TFTPhttps://wikitech.wikimedia.org/wiki/Ubuntu_installer#TFTP Download preseed configurationhttps://wikitech.wikimedia.org/wiki/Ubuntu_installer#Download_preseed_configuration Static network configurationhttps://wikitech.wikimedia.org/wiki/Ubuntu_installer#Static_network_configuration https://wikitech.wikimedia.org/wiki/APT_repository Wikimedia maintains its own APT repository available at https://apt.wikimedia. Repository Structurehttps://wikitech.wikimedia.org/wiki/APT_repository#Repository_Structure External Accesshttps://wikitech.wikimedia.org/wiki/APT_repository#External_Access Securityhttps://wikitech.wikimedia.org/wiki/APT_repository#Security See alsohttps://wikitech.wikimedia.org/wiki/APT_repository#See_also https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8 == September 30 == September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_24 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_17 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_9 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_28 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_9 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#August_1 July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_16 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_11 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_4 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_8#July_1 https://wikitech.wikimedia.org/wiki/Mailman-htdig This is a patched version of GNU Mailman which integrates support for searching list archives using htdig. This is integrated in the Wikimedia Mailman . Mailman patcheshttps://wikitech.wikimedia.org/wiki/Mailman-htdig#Mailman_patches htdighttps://wikitech.wikimedia.org/wiki/Mailman-htdig#htdig Index updatinghttps://wikitech.wikimedia.org/wiki/Mailman-htdig#Index_updating Setup noteshttps://wikitech.wikimedia.org/wiki/Mailman-htdig#Setup_notes https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation This page contains links to documentation about specific hardware platforms that are currently in use within the Wikimedia datacenter space. This page and sub-pages are currently maintained by the DC Operations team. Hardwarehttps://wikitech.wikimedia.org/wiki/Category:Hardware Management interfaceshttps://wikitech.wikimedia.org/wiki/Category:Management_interfaces Platform-specific documentationhttps://wikitech.wikimedia.org/wiki/Category:Platform-specific_documentation https://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive == The MHA Way == The MHA Wayhttps://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#The_MHA_Way Some backgroundhttps://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#Some_background Using mha for planned failovershttps://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#Using_mha_for_planned_failovers Using mha for emergency failovershttps://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#Using_mha_for_emergency_failovers Known Issueshttps://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#Known_Issues The Fairly Easy Way (asher uses this, domas did something similar)https://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#The_Fairly_Easy_Way_(asher_uses_this,_domas_did_something_similar) The easy way (needs some updating)https://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#The_easy_way_(needs_some_updating) The hard wayhttps://wikitech.wikimedia.org/wiki/Primary_database_switchover/Archive#The_hard_way https://wikitech.wikimedia.org/wiki/Knsq15 == Defect == Defecthttps://wikitech.wikimedia.org/wiki/Knsq15#Defect https://wikitech.wikimedia.org/wiki/GDB_with_PHP Some handy things to know about using GDB to debug PHP. Basicshttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#Basics Backtraces by calling functionshttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#Backtraces_by_calling_functions Backtraces by inspecting datahttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#Backtraces_by_inspecting_data Function nameshttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#Function_names Symbol table variable nameshttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#Symbol_table_variable_names Symbol table datahttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#Symbol_table_data See alsohttps://wikitech.wikimedia.org/wiki/GDB_with_PHP#See_also https://wikitech.wikimedia.org/wiki/Storage1 ==History== Historyhttps://wikitech.wikimedia.org/wiki/Storage1#History https://wikitech.wikimedia.org/wiki/WikiSVN #!/usr/bin/perl -w Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Botshttps://wikitech.wikimedia.org/wiki/Category:Bots https://wikitech.wikimedia.org/wiki/Knsq6 == Hardware problems == Hardware problemshttps://wikitech.wikimedia.org/wiki/Knsq6#Hardware_problems https://wikitech.wikimedia.org/wiki/Cache_log_format The Wikimedia cache log format is a custom format which is used on webserver caches to provide logs in a uniform format. See also Apache log format for Apache logs. Format used in cache config fileshttps://wikitech.wikimedia.org/wiki/Cache_log_format#Format_used_in_cache_config_files Nginx Formathttps://wikitech.wikimedia.org/wiki/Cache_log_format#Nginx_Format Squid Formathttps://wikitech.wikimedia.org/wiki/Cache_log_format#Squid_Format Varnishncsa Formathttps://wikitech.wikimedia.org/wiki/Cache_log_format#Varnishncsa_Format Varnishkafka Formathttps://wikitech.wikimedia.org/wiki/Cache_log_format#Varnishkafka_Format Log entryhttps://wikitech.wikimedia.org/wiki/Cache_log_format#Log_entry Fieldshttps://wikitech.wikimedia.org/wiki/Cache_log_format#Fields Examplehttps://wikitech.wikimedia.org/wiki/Cache_log_format#Example Nginx examplehttps://wikitech.wikimedia.org/wiki/Cache_log_format#Nginx_example Squid examplehttps://wikitech.wikimedia.org/wiki/Cache_log_format#Squid_example Varnishncsa examplehttps://wikitech.wikimedia.org/wiki/Cache_log_format#Varnishncsa_example Varnishkafka examplehttps://wikitech.wikimedia.org/wiki/Cache_log_format#Varnishkafka_example Usagehttps://wikitech.wikimedia.org/wiki/Cache_log_format#Usage Issueshttps://wikitech.wikimedia.org/wiki/Cache_log_format#Issues https://wikitech.wikimedia.org/wiki/Storage2 storage2 is a 16 GB box with a 3ware 9550SX-16ML storage controller, and 16 500 GB SATA drives. Serviceshttps://wikitech.wikimedia.org/wiki/Storage2#Services Bonnie resultshttps://wikitech.wikimedia.org/wiki/Storage2#Bonnie_results External linkshttps://wikitech.wikimedia.org/wiki/Storage2#External_links https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20 == June 30 == June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_23 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#March_1 February 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_29 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_20#January_1 https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org == What is planet? == What is planet?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#What_is_planet? How do I access it?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_do_I_access_it? Which languages exist?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Which_languages_exist? How to add a new language?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_to_add_a_new_language? Where should I report issues?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Where_should_I_report_issues? Where does it run?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Where_does_it_run? Where's the code?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#Where's_the_code? How are planets being updated?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_are_planets_being_updated? How do I add or remove feed URLs?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_do_I_add_or_remove_feed_URLs? How do I change HTML of the index pages?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_do_I_change_HTML_of_the_index_pages? How do I add/change translations in the index pages or add a new language?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_do_I_add/change_translations_in_the_index_pages_or_add_a_new_language? How do I request changes if I can't or don't want to submit a change set myself?https://wikitech.wikimedia.org/wiki/Planet.wikimedia.org#How_do_I_request_changes_if_I_can't_or_don't_want_to_submit_a_change_set_myself? https://wikitech.wikimedia.org/wiki/Zedler/Replication The replication is done with 2 different programs. At first with the normal mysql-replication-program and at secound with a tool programmed by river (trainwreck). Passwordhttps://wikitech.wikimedia.org/wiki/Zedler/Replication#Password MySQL-Replicationhttps://wikitech.wikimedia.org/wiki/Zedler/Replication#MySQL-Replication DaB.s Replication-Programhttps://wikitech.wikimedia.org/wiki/Zedler/Replication#DaB.s_Replication-Program Howto to restart replication after the master-db-server changedhttps://wikitech.wikimedia.org/wiki/Zedler/Replication#Howto_to_restart_replication_after_the_master-db-server_changed Stoppinghttps://wikitech.wikimedia.org/wiki/Zedler/Replication#Stopping Changinghttps://wikitech.wikimedia.org/wiki/Zedler/Replication#Changing Startinghttps://wikitech.wikimedia.org/wiki/Zedler/Replication#Starting https://wikitech.wikimedia.org/wiki/Server_history * 2001-05-02 Wikipedia moves to a new server https://wikitech.wikimedia.org/wiki/Schema_changes/old == What? == What?https://wikitech.wikimedia.org/wiki/Schema_changes/old#What? Guidelineshttps://wikitech.wikimedia.org/wiki/Schema_changes/old#Guidelines See alsohttps://wikitech.wikimedia.org/wiki/Schema_changes/old#See_also https://wikitech.wikimedia.org/wiki/NIS NIS (formerly YP) is a directory service for Unix databases (passwd, group, hosts, etc). it's like LDAP but more simpler and more limited. Adding a userhttps://wikitech.wikimedia.org/wiki/NIS#Adding_a_user Client setuphttps://wikitech.wikimedia.org/wiki/NIS#Client_setup https://wikitech.wikimedia.org/wiki/Dovecot Dovecot is an IMAP and POP3 server, and is used on Wikimedia's IMAP server sanger. Configurationhttps://wikitech.wikimedia.org/wiki/Dovecot#Configuration Main configurationhttps://wikitech.wikimedia.org/wiki/Dovecot#Main_configuration Protocolshttps://wikitech.wikimedia.org/wiki/Dovecot#Protocols SSLhttps://wikitech.wikimedia.org/wiki/Dovecot#SSL login max processes counthttps://wikitech.wikimedia.org/wiki/Dovecot#login_max_processes_count Mail locationhttps://wikitech.wikimedia.org/wiki/Dovecot#Mail_location Mail extra groupshttps://wikitech.wikimedia.org/wiki/Dovecot#Mail_extra_groups Maildir optimizationshttps://wikitech.wikimedia.org/wiki/Dovecot#Maildir_optimizations Mail processeshttps://wikitech.wikimedia.org/wiki/Dovecot#Mail_processes Protocol IMAPhttps://wikitech.wikimedia.org/wiki/Dovecot#Protocol_IMAP Authorizationhttps://wikitech.wikimedia.org/wiki/Dovecot#Authorization SQL configurationhttps://wikitech.wikimedia.org/wiki/Dovecot#SQL_configuration See alsohttps://wikitech.wikimedia.org/wiki/Dovecot#See_also External documentationhttps://wikitech.wikimedia.org/wiki/Dovecot#External_documentation https://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P == Setup == Setuphttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#Setup Authenticationhttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#Authentication VLANshttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#VLANs Logginghttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#Logging SNMPhttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#SNMP SNTPhttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#SNTP Spanning-treehttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#Spanning-tree Multicasthttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#Multicast RANCIDhttps://wikitech.wikimedia.org/wiki/Foundry_FastIron_GS_FGS648P#RANCID https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10 == June 30 == June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_24 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_14 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_30 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_24 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_9 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_4 May 02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#May_02 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_29 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_26 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_22 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_15 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_9 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_20 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_18 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_5 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#March_1 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_28 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_22 Feburary 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#Feburary_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_10#February_1 https://wikitech.wikimedia.org/wiki/Ubuntu_todo * new tidy Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Ubuntuhttps://wikitech.wikimedia.org/wiki/Category:Ubuntu https://wikitech.wikimedia.org/wiki/RANCID RANCID is a tool that can monitor configuration changes on network devices, and mail the diffs periodically. It's installed on netmon1003 from the (rather alpha-quality) Debian/Ubuntu packages. Equipment noteshttps://wikitech.wikimedia.org/wiki/RANCID#Equipment_notes Juniperhttps://wikitech.wikimedia.org/wiki/RANCID#Juniper OpenGearhttps://wikitech.wikimedia.org/wiki/RANCID#OpenGear https://wikitech.wikimedia.org/wiki/Knsq1 Knams data centerhttps://wikitech.wikimedia.org/wiki/Category:Knams_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11 == December 31 == December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_30 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_16 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_9 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_22 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_13 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_10 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_8 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_4 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_29 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_25 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_20 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_16 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_7 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_24 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_15 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_27 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_20 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_13 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_11 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_8 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#August_4 Aug 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#Aug_2 Aug 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#Aug_1 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_29 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_27 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_24 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_21 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_17 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_4 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_11#July_1 https://wikitech.wikimedia.org/wiki/Live_hacks/internalParse Index: includes/Parser.php https://wikitech.wikimedia.org/wiki/Live_hacks/internalParse# https://wikitech.wikimedia.org/wiki/Search.wikimedia.org search.wikimedia. Historyhttps://wikitech.wikimedia.org/wiki/Search.wikimedia.org#History External linkhttps://wikitech.wikimedia.org/wiki/Search.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Bugzilla Bugzilla may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/External_storage/Maintenance How to safety perform maintenance on external storage boxes... How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org The pdf1.wikimedia. Hardwarehttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Hardware Softwarehttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Software Usagehttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Usage Noteshttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Notes Setup / Recoveryhttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Setup_/_Recovery Upgrading mwlibhttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Upgrading_mwlib Software referencehttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Software_reference Starting the serverhttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Starting_the_server Maintenance and cleanuphttps://wikitech.wikimedia.org/wiki/Pdf1.wikimedia.org#Maintenance_and_cleanup https://wikitech.wikimedia.org/wiki/IPv6_deployment [the successor to IPv4], features a greatly-enlarged address space. Despite its age and feature maturity, deployment of IPv6 on the public Internet is still ongoing. Current IPv6 deployment statushttps://wikitech.wikimedia.org/wiki/IPv6_deployment#Current_IPv6_deployment_status IPv6 network status at Wikimediahttps://wikitech.wikimedia.org/wiki/IPv6_deployment#IPv6_network_status_at_Wikimedia DNS servershttps://wikitech.wikimedia.org/wiki/IPv6_deployment#DNS_servers IPv6 production testing at Wikimediahttps://wikitech.wikimedia.org/wiki/IPv6_deployment#IPv6_production_testing_at_Wikimedia Fully IPv6 enabled services at Wikimediahttps://wikitech.wikimedia.org/wiki/IPv6_deployment#Fully_IPv6_enabled_services_at_Wikimedia Known outstanding technical issueshttps://wikitech.wikimedia.org/wiki/IPv6_deployment#Known_outstanding_technical_issues Useful IPv6 enhancementshttps://wikitech.wikimedia.org/wiki/IPv6_deployment#Useful_IPv6_enhancements statistics related to deploying AAAA recordshttps://wikitech.wikimedia.org/wiki/IPv6_deployment#statistics_related_to_deploying_AAAA_records How to add IPv6 to a nodehttps://wikitech.wikimedia.org/wiki/IPv6_deployment#How_to_add_IPv6_to_a_node https://wikitech.wikimedia.org/wiki/Server_replacements_mid_2008 Servers that are out of warranty, and the services they are running: https://wikitech.wikimedia.org/wiki/ExtensionDistributor See ExtensionDistributor extension for MediaWiki https://wikitech.wikimedia.org/wiki/OSM-Test ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/OSM-Test#Summary General remarkshttps://wikitech.wikimedia.org/wiki/OSM-Test#General_remarks First testhttps://wikitech.wikimedia.org/wiki/OSM-Test#First_test Second testhttps://wikitech.wikimedia.org/wiki/OSM-Test#Second_test https://wikitech.wikimedia.org/wiki/Civicrm.wikimedia.org CRM and donations records. Mailhttps://wikitech.wikimedia.org/wiki/Civicrm.wikimedia.org#Mail Periodic Automated Taskshttps://wikitech.wikimedia.org/wiki/Civicrm.wikimedia.org#Periodic_Automated_Tasks Upgradeshttps://wikitech.wikimedia.org/wiki/Civicrm.wikimedia.org#Upgrades Public Data Dumpshttps://wikitech.wikimedia.org/wiki/Civicrm.wikimedia.org#Public_Data_Dumps Issueshttps://wikitech.wikimedia.org/wiki/Civicrm.wikimedia.org#Issues https://wikitech.wikimedia.org/wiki/Donate.wikipedia.org donate.wikipedia. Servicehttps://wikitech.wikimedia.org/wiki/Donate.wikipedia.org#Service Historyhttps://wikitech.wikimedia.org/wiki/Donate.wikipedia.org#History External linkhttps://wikitech.wikimedia.org/wiki/Donate.wikipedia.org#External_link https://wikitech.wikimedia.org/wiki/Donate.wikimedia.org donate.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Donate.wikimedia.org#Service Chapter Redirectshttps://wikitech.wikimedia.org/wiki/Donate.wikimedia.org#Chapter_Redirects Changing Chapter Redirectshttps://wikitech.wikimedia.org/wiki/Donate.wikimedia.org#Changing_Chapter_Redirects FundraiserLandingPage Extension Changeshttps://wikitech.wikimedia.org/wiki/Donate.wikimedia.org#FundraiserLandingPage_Extension_Changes LandingCheck Extension Changeshttps://wikitech.wikimedia.org/wiki/Donate.wikimedia.org#LandingCheck_Extension_Changes https://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org CRM and donations records. Hardwarehttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#Hardware Softwarehttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#Software Usagehttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#Usage Installationhttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#Installation Databaseshttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#Databases Updating development copy paths following a database clonehttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#Updating_development_copy_paths_following_a_database_clone CiviCRM codehttps://wikitech.wikimedia.org/wiki/Civicrm-dev.wikimedia.org#CiviCRM_code https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12 == July 31 == July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_21 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_17 Jul 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#Jul_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_14 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_7 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_5 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#July_1 June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_29 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_26 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_24 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_19 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_16 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#June_2 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_18 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_11 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_5 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_3 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_30 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_28 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_31 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_28 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_24 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_16 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_10 Marc 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#Marc_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#March_2 February 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_29 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_25 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_20 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_17 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_13 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_10 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_6 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_28 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_18 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_6 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12#January_3 https://wikitech.wikimedia.org/wiki/Mobile == This page has been deprecated, please see MobileFrontend == This page has been deprecated, please see MobileFrontendhttps://wikitech.wikimedia.org/wiki/Mobile#This_page_has_been_deprecated,_please_see_MobileFrontend Softwarehttps://wikitech.wikimedia.org/wiki/Mobile#Software Libraries Usedhttps://wikitech.wikimedia.org/wiki/Mobile#Libraries_Used Service Opshttps://wikitech.wikimedia.org/wiki/Mobile#Service_Ops Servershttps://wikitech.wikimedia.org/wiki/Mobile#Servers Supported Platforms/Languageshttps://wikitech.wikimedia.org/wiki/Mobile#Supported_Platforms/Languages Devices currently supportedhttps://wikitech.wikimedia.org/wiki/Mobile#Devices_currently_supported Language Supporthttps://wikitech.wikimedia.org/wiki/Mobile#Language_Support Contacthttps://wikitech.wikimedia.org/wiki/Mobile#Contact Bug Reportshttps://wikitech.wikimedia.org/wiki/Mobile#Bug_Reports https://wikitech.wikimedia.org/wiki/Php-wmerrors php-wmerrors is a PHP extension that extends how PHP errors are handled and displayed. It is specifically designed for situations where the standard PHP API is not sufficient for userland code to render an error page and log stacktraces (e. Service at WMFhttps://wikitech.wikimedia.org/wiki/Php-wmerrors#Service_at_WMF Configurationhttps://wikitech.wikimedia.org/wiki/Php-wmerrors#Configuration Deploymenthttps://wikitech.wikimedia.org/wiki/Php-wmerrors#Deployment Code stewardshiphttps://wikitech.wikimedia.org/wiki/Php-wmerrors#Code_stewardship External linkshttps://wikitech.wikimedia.org/wiki/Php-wmerrors#External_links https://wikitech.wikimedia.org/wiki/MediaWiki_UDP_logging All of the MediaWiki error logs should now be configured to be sent to udp://10.0. /etc/udp2loghttps://wikitech.wikimedia.org/wiki/MediaWiki_UDP_logging#/etc/udp2log /etc/logrotate.d/mw-udp2loghttps://wikitech.wikimedia.org/wiki/MediaWiki_UDP_logging#/etc/logrotate.d/mw-udp2log /usr/local/bin/demux.pyhttps://wikitech.wikimedia.org/wiki/MediaWiki_UDP_logging#/usr/local/bin/demux.py https://wikitech.wikimedia.org/wiki/UDP_logging * Squid logging https://wikitech.wikimedia.org/wiki/Database_management_wishlist Safety: MySQLhttps://wikitech.wikimedia.org/wiki/Category:MySQL https://wikitech.wikimedia.org/wiki/Logmsgbot logmsgbot is udprec piped into ircecho. It outputs ! Set uphttps://wikitech.wikimedia.org/wiki/Logmsgbot#Set_up Restarthttps://wikitech.wikimedia.org/wiki/Logmsgbot#Restart See alsohttps://wikitech.wikimedia.org/wiki/Logmsgbot#See_also https://wikitech.wikimedia.org/wiki/Udprec Simple UDP receiver, outputs on stdout. Probably written by River. https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a == August 31 == August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_24 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_16 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_10 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_8 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_3 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12a#August_1 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b == September 30 == September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_14 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_12b#September_1 https://wikitech.wikimedia.org/wiki/CentralNotice CentralNotice is the MediaWiki extension that delivers announcements (usually in the form of banners) to WMF wikis. It is used by the Advancement team to solicit donations, and for announcements of interest to Wikimedia communities and users. Deploymenthttps://wikitech.wikimedia.org/wiki/CentralNotice#Deployment Train deployshttps://wikitech.wikimedia.org/wiki/CentralNotice#Train_deploys SWAT deployshttps://wikitech.wikimedia.org/wiki/CentralNotice#SWAT_deploys https://wikitech.wikimedia.org/wiki/Survey.wikimedia.org This software is presently running on singer and is not using puppet. It will shortly move to hooper and use puppet for its apache vhost configuration shortly. Usagehttps://wikitech.wikimedia.org/wiki/Survey.wikimedia.org#Usage Installation instructionshttps://wikitech.wikimedia.org/wiki/Survey.wikimedia.org#Installation_instructions OLD/OUTDATED: How to recover in a hurryhttps://wikitech.wikimedia.org/wiki/Survey.wikimedia.org#OLD/OUTDATED:_How_to_recover_in_a_hurry https://wikitech.wikimedia.org/wiki/FlaggedRevs_setup == General FlaggedRev installation instructions == General FlaggedRev installation instructionshttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup#General_FlaggedRev_installation_instructions enwiki instructionshttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup#enwiki_instructions Open requestshttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup#Open_requests https://wikitech.wikimedia.org/wiki/Brady Amsterdam last label id: check memory slot 10 on the Brady label printer. https://wikitech.wikimedia.org/wiki/Esams/patches Cross connects at esams Fiberhttps://wikitech.wikimedia.org/wiki/Esams/patches#Fiber https://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup == Server Install == Server Installhttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#Server_Install Application Installhttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#Application_Install Ruby Basehttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#Ruby_Base Librarieshttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#Libraries VChttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#VC Gemshttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#Gems Apachehttps://wikitech.wikimedia.org/wiki/MobileServer/ServerSetup#Apache https://wikitech.wikimedia.org/wiki/Varnish Varnish is a caching HTTP proxy used as the frontend (in-memory) component of Wikimedia's CDN. On-disk, persistent caching is done by cache backends running Apache Traffic Server. TTLhttps://wikitech.wikimedia.org/wiki/Varnish#TTL Historical TTLhttps://wikitech.wikimedia.org/wiki/Varnish#Historical_TTL Requests coalescinghttps://wikitech.wikimedia.org/wiki/Varnish#Requests_coalescing hit-for-passhttps://wikitech.wikimedia.org/wiki/Varnish#hit-for-pass hit-for-misshttps://wikitech.wikimedia.org/wiki/Varnish#hit-for-miss Cache admission policieshttps://wikitech.wikimedia.org/wiki/Varnish#Cache_admission_policies HOWTOhttps://wikitech.wikimedia.org/wiki/Varnish#HOWTO Diagnose connection count floodinghttps://wikitech.wikimedia.org/wiki/Varnish#Diagnose_connection_count_flooding See request logshttps://wikitech.wikimedia.org/wiki/Varnish#See_request_logs Block requests from public cloudshttps://wikitech.wikimedia.org/wiki/Varnish#Block_requests_from_public_clouds Rate limitinghttps://wikitech.wikimedia.org/wiki/Varnish#Rate_limiting Blacklist an IPhttps://wikitech.wikimedia.org/wiki/Varnish#Blacklist_an_IP See backend healthhttps://wikitech.wikimedia.org/wiki/Varnish#See_backend_health Force your requests through a specific Varnish frontendhttps://wikitech.wikimedia.org/wiki/Varnish#Force_your_requests_through_a_specific_Varnish_frontend Package a new Varnish releasehttps://wikitech.wikimedia.org/wiki/Varnish#Package_a_new_Varnish_release Build and upload the new releasehttps://wikitech.wikimedia.org/wiki/Varnish#Build_and_upload_the_new_release Deploy the new release on Betahttps://wikitech.wikimedia.org/wiki/Varnish#Deploy_the_new_release_on_Beta Deploy the new release to Prodhttps://wikitech.wikimedia.org/wiki/Varnish#Deploy_the_new_release_to_Prod Diagnosing Varnish alertshttps://wikitech.wikimedia.org/wiki/Varnish#Diagnosing_Varnish_alerts Some more trickshttps://wikitech.wikimedia.org/wiki/Varnish#Some_more_tricks Configurationhttps://wikitech.wikimedia.org/wiki/Varnish#Configuration One-off purges (bans)https://wikitech.wikimedia.org/wiki/Varnish#One-off_purges_(bans) How to execute a ban (on one machine)https://wikitech.wikimedia.org/wiki/Varnish#How_to_execute_a_ban_(on_one_machine) Examples of ban conditionshttps://wikitech.wikimedia.org/wiki/Varnish#Examples_of_ban_conditions Execute a ban on a clusterhttps://wikitech.wikimedia.org/wiki/Varnish#Execute_a_ban_on_a_cluster Ban condition for MediaWiki outputs by datestamp of generationhttps://wikitech.wikimedia.org/wiki/Varnish#Ban_condition_for_MediaWiki_outputs_by_datestamp_of_generation External linkshttps://wikitech.wikimedia.org/wiki/Varnish#External_links See alsohttps://wikitech.wikimedia.org/wiki/Varnish#See_also https://wikitech.wikimedia.org/wiki/Ms3 Linux setup with 14 RAID-1 volumes of 3 disks each (spread over controllers), striped together in an LVM volume group. Disk setuphttps://wikitech.wikimedia.org/wiki/Ms3#Disk_setup bonnie++https://wikitech.wikimedia.org/wiki/Ms3#bonnie++ https://wikitech.wikimedia.org/wiki/Swap-watchdog Quickie script Domas threw together for the PDF service to reboot the box when memory leaks start killing swap. Ideally we'll get the leak sorted out soon! https://wikitech.wikimedia.org/wiki/Close_a_wiki In order to lock a wiki, do the following. Wikimedia configurationhttps://wikitech.wikimedia.org/wiki/Close_a_wiki#Wikimedia_configuration Parsoidhttps://wikitech.wikimedia.org/wiki/Close_a_wiki#Parsoid Cxserverhttps://wikitech.wikimedia.org/wiki/Close_a_wiki#Cxserver CentralAuthhttps://wikitech.wikimedia.org/wiki/Close_a_wiki#CentralAuth See alsohttps://wikitech.wikimedia.org/wiki/Close_a_wiki#See_also https://wikitech.wikimedia.org/wiki/Monitoring_package_survey An exhaustive list of monitoring tools and services evaluated or used at WMF Open Sourcehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Open_Source Alertahttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Alerta Cabothttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Cabot Centreonhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Centreon Check_graphitehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Check_graphite Check_mkhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Check_mk Collectdhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Collectd Cucumber-nagioshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Cucumber-nagios Cyanitehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Cyanite Dashinghttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Dashing Dbeaconhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Dbeacon Diamondhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Diamond Fail2banhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Fail2ban Fireflyhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Firefly Gangliahttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Ganglia Ganglioshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Ganglios Grafanahttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Grafana Graphioshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Graphios Graphitehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Graphite Graphskyhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Graphsky Groundworkhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Groundwork Hyperichttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Hyperic Icingahttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Icinga IDOUtils (NDOUtils)https://wikitech.wikimedia.org/wiki/Monitoring_package_survey#IDOUtils_(NDOUtils) Jmxtranshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Jmxtrans KairosDBhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#KairosDB LibreNMShttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#LibreNMS Logstashhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Logstash Logsterhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Logster Merlinhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Merlin Metricingahttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Metricinga Mod-gearmanhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Mod-gearman Monithttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Monit Muninhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Munin Nagioshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Nagios NetDBhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#NetDB NRPEhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#NRPE NSCAhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#NSCA Observiumhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Observium Oculushttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Oculus OpenNMShttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#OpenNMS OpenTSDBhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#OpenTSDB OpsViewhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#OpsView Pandora FMShttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Pandora_FMS Prometheushttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Prometheus RANCIDhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#RANCID Rearviewhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Rearview Riemannhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Riemann Sensuhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Sensu Servermonhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Servermon Seyrenhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Seyren Shinkenhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Shinken Skylinehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Skyline Smokepinghttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Smokeping Statsdhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Statsd Tesserahttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Tessera Torrushttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Torrus Umpirehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Umpire Zenosshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Zenoss Zabbixhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Zabbix Developed for WMFhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Developed_for_WMF Dbtreehttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Dbtree Ishmaelhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Ishmael Labsnagiosbuilderhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Labsnagiosbuilder Sqstathttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Sqstat Tendrilhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Tendril Serviceshttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Services Boundaryhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Boundary Datadoghttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Datadog New Relichttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#New_Relic Nimsoft Cloud Monitor (formerly Watchmouse)https://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Nimsoft_Cloud_Monitor_(formerly_Watchmouse) PagerDutyhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#PagerDuty Pingdomhttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#Pingdom RIPE Atlashttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#RIPE_Atlas See alsohttps://wikitech.wikimedia.org/wiki/Monitoring_package_survey#See_also https://wikitech.wikimedia.org/wiki/Add_a_server For any MediaWiki app server: List of things that will break if you try to install MediaWiki without following this procedurehttps://wikitech.wikimedia.org/wiki/Add_a_server#List_of_things_that_will_break_if_you_try_to_install_MediaWiki_without_following_this_procedure https://wikitech.wikimedia.org/wiki/Puppet Puppet is the main configuration management tool to be used on the Wikimedia clusters. For some additional insight the Wikimedia article is a good introduction. Making changeshttps://wikitech.wikimedia.org/wiki/Puppet#Making_changes Updating operations/puppethttps://wikitech.wikimedia.org/wiki/Puppet#Updating_operations/puppet Pending changeshttps://wikitech.wikimedia.org/wiki/Puppet#Pending_changes Additional noteshttps://wikitech.wikimedia.org/wiki/Puppet#Additional_notes Updating labs/private.githttps://wikitech.wikimedia.org/wiki/Puppet#Updating_labs/private.git Noop test run on a nodehttps://wikitech.wikimedia.org/wiki/Puppet#Noop_test_run_on_a_node Trigger a run on a nodehttps://wikitech.wikimedia.org/wiki/Puppet#Trigger_a_run_on_a_node Puppet agenthttps://wikitech.wikimedia.org/wiki/Puppet#Puppet_agent Reinstallshttps://wikitech.wikimedia.org/wiki/Puppet#Reinstalls Forcing a Puppet run against a specific serverhttps://wikitech.wikimedia.org/wiki/Puppet#Forcing_a_Puppet_run_against_a_specific_server SANs for puppet certshttps://wikitech.wikimedia.org/wiki/Puppet#SANs_for_puppet_certs Mischttps://wikitech.wikimedia.org/wiki/Puppet#Misc Maintenancehttps://wikitech.wikimedia.org/wiki/Puppet#Maintenance Facterhttps://wikitech.wikimedia.org/wiki/Puppet#Facter Puppetmasterhttps://wikitech.wikimedia.org/wiki/Puppet#Puppetmaster PuppetDBhttps://wikitech.wikimedia.org/wiki/Puppet#PuppetDB Debugginghttps://wikitech.wikimedia.org/wiki/Puppet#Debugging check_puppet_run_changeshttps://wikitech.wikimedia.org/wiki/Puppet#check_puppet_run_changes node cleanuphttps://wikitech.wikimedia.org/wiki/Puppet#node_cleanup Micro Servicehttps://wikitech.wikimedia.org/wiki/Puppet#Micro_Service Operationshttps://wikitech.wikimedia.org/wiki/Puppet#Operations Pool / depool a backendhttps://wikitech.wikimedia.org/wiki/Puppet#Pool_/_depool_a_backend Pool / depool a frontendhttps://wikitech.wikimedia.org/wiki/Puppet#Pool_/_depool_a_frontend pdb-changes - Audit changes during a specific time windowhttps://wikitech.wikimedia.org/wiki/Puppet#pdb-changes_-_Audit_changes_during_a_specific_time_window Errorshttps://wikitech.wikimedia.org/wiki/Puppet#Errors Check .erb template syntaxhttps://wikitech.wikimedia.org/wiki/Puppet#Check_.erb_template_syntax Audit resources via puppetdbhttps://wikitech.wikimedia.org/wiki/Puppet#Audit_resources_via_puppetdb Icinga alertshttps://wikitech.wikimedia.org/wiki/Puppet#Icinga_alerts check_client_bucket_large_filehttps://wikitech.wikimedia.org/wiki/Puppet#check_client_bucket_large_file Troubleshootinghttps://wikitech.wikimedia.org/wiki/Puppet#Troubleshooting puppet master spewing 500shttps://wikitech.wikimedia.org/wiki/Puppet#puppet_master_spewing_500s puppet-merge fails to sync on secondaryhttps://wikitech.wikimedia.org/wiki/Puppet#puppet-merge_fails_to_sync_on_secondary force puppet agent to use a specific puppetmasterhttps://wikitech.wikimedia.org/wiki/Puppet#force_puppet_agent_to_use_a_specific_puppetmaster Git is down (and requires a puppet change to put it back)https://wikitech.wikimedia.org/wiki/Puppet#Git_is_down_(and_requires_a_puppet_change_to_put_it_back) Volatile mounthttps://wikitech.wikimedia.org/wiki/Puppet#Volatile_mount Private puppethttps://wikitech.wikimedia.org/wiki/Puppet#Private_puppet Public (fake) private puppet repohttps://wikitech.wikimedia.org/wiki/Puppet#Public_(fake)_private_puppet_repo Puppet CAhttps://wikitech.wikimedia.org/wiki/Puppet#Puppet_CA Failoverhttps://wikitech.wikimedia.org/wiki/Puppet#Failover Renew agent certificatehttps://wikitech.wikimedia.org/wiki/Puppet#Renew_agent_certificate More informationhttps://wikitech.wikimedia.org/wiki/Puppet#More_information https://wikitech.wikimedia.org/wiki/SRE_project_wishlist This page is meant to be used to coordinate projects within the Ops team. The focus of this page should be coordinating non-geographically based sprints. Active projectshttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Active_projects Netflow collectorhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Netflow_collector Performance monitoringhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Performance_monitoring Backburnerhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Backburner Gerrit repo creation through wikitechhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Gerrit_repo_creation_through_wikitech Basic monitoring & alertinghttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Basic_monitoring_&_alerting Scaling of monitoring infrastructurehttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Scaling_of_monitoring_infrastructure Logging infrastructurehttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Logging_infrastructure Network-based securityhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Network-based_security User account refactoringhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#User_account_refactoring Expand use of AppArmorhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Expand_use_of_AppArmor Security Updateshttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Security_Updates mediawiki Labs projecthttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#mediawiki_Labs_project Finished projectshttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Finished_projects DNShttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#DNS Backup infrastructurehttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Backup_infrastructure Switch "text" to Varnishhttps://wikitech.wikimedia.org/wiki/SRE_project_wishlist#Switch_"text"_to_Varnish https://wikitech.wikimedia.org/wiki/Search/UDP_Logger == UDP Logger == UDP Loggerhttps://wikitech.wikimedia.org/wiki/Search/UDP_Logger#UDP_Logger Hosthttps://wikitech.wikimedia.org/wiki/Search/UDP_Logger#Host Storagehttps://wikitech.wikimedia.org/wiki/Search/UDP_Logger#Storage Scriptshttps://wikitech.wikimedia.org/wiki/Search/UDP_Logger#Scripts Logshttps://wikitech.wikimedia.org/wiki/Search/UDP_Logger#Logs Additions Neededhttps://wikitech.wikimedia.org/wiki/Search/UDP_Logger#Additions_Needed https://wikitech.wikimedia.org/wiki/Project_Honeypot We send data from spam.log to an external party, Project Honeypot, in exchange for them sending us abuse data. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Live-1.5 The /home/wikipedia/common/live-1.5 web tree holds the "live" files which will be exposed to the web via http://xx. Configuration and updateshttps://wikitech.wikimedia.org/wiki/Live-1.5#Configuration_and_updates Examplehttps://wikitech.wikimedia.org/wiki/Live-1.5#Example https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13 == June 30 == June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_25 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_17 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_27 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_20 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_14 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_3 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#March_1 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_23 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_12 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#January_1 December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_8 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_30 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_24 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_9 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_20 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_3 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_13#October_1 https://wikitech.wikimedia.org/wiki/Monitoring_procedure Proposed monitoring procedure Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Bot and monitoringhttps://wikitech.wikimedia.org/wiki/Category:Bot_and_monitoring https://wikitech.wikimedia.org/wiki/Linode == Restarting the Linode server (contains wikitech) == Restarting the Linode server (contains wikitech)https://wikitech.wikimedia.org/wiki/Linode#Restarting_the_Linode_server_(contains_wikitech) https://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy __TOC__ Main dirhttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Main_dir Extensionshttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Extensions Includeshttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Includes Languageshttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Languages Maintenancehttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Maintenance Mathhttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Math Skinshttps://wikitech.wikimedia.org/wiki/Uncommitted_files_in_live_working_copy#Skins https://wikitech.wikimedia.org/wiki/Ms1 == Hardware, role == Hardware, rolehttps://wikitech.wikimedia.org/wiki/Ms1#Hardware,_role https://wikitech.wikimedia.org/wiki/SecurePoll SecurePoll is a voting system with per-election configuration stored in the database. We use it for Board elections. About XML fileshttps://wikitech.wikimedia.org/wiki/SecurePoll#About_XML_files WMF-specific CLI scriptshttps://wikitech.wikimedia.org/wiki/SecurePoll#WMF-specific_CLI_scripts How to run a board electionhttps://wikitech.wikimedia.org/wiki/SecurePoll#How_to_run_a_board_election Voter eligibilityhttps://wikitech.wikimedia.org/wiki/SecurePoll#Voter_eligibility Exceptionshttps://wikitech.wikimedia.org/wiki/SecurePoll#Exceptions Creating the election on votewikihttps://wikitech.wikimedia.org/wiki/SecurePoll#Creating_the_election_on_votewiki Translationshttps://wikitech.wikimedia.org/wiki/SecurePoll#Translations Do a test runhttps://wikitech.wikimedia.org/wiki/SecurePoll#Do_a_test_run Email spamhttps://wikitech.wikimedia.org/wiki/SecurePoll#Email_spam Duplicate removalhttps://wikitech.wikimedia.org/wiki/SecurePoll#Duplicate_removal Encryptionhttps://wikitech.wikimedia.org/wiki/SecurePoll#Encryption Tallyinghttps://wikitech.wikimedia.org/wiki/SecurePoll#Tallying Simple method: GUIhttps://wikitech.wikimedia.org/wiki/SecurePoll#Simple_method:_GUI Alternative method: Command linehttps://wikitech.wikimedia.org/wiki/SecurePoll#Alternative_method:_Command_line Session transfershttps://wikitech.wikimedia.org/wiki/SecurePoll#Session_transfers Timelinehttps://wikitech.wikimedia.org/wiki/SecurePoll#Timeline https://wikitech.wikimedia.org/wiki/ServiceOwnership As a result of the mobile gateway at en.m becoming more and more popular it has become necessary to draft some guidelines about what it is required from our dedicated operations staff to better support the service. Softwarehttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Software Hardwarehttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Hardware Usagehttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Usage Healthhttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Health Capacityhttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Capacity Dependencieshttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Dependencies Start/Restarthttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Start/Restart Configurationhttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Configuration Typical Problemshttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Typical_Problems Activityhttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Activity Monitoringhttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Monitoring Backupshttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Backups Escalation Pathhttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Escalation_Path Reference Linkshttps://wikitech.wikimedia.org/wiki/ServiceOwnership#Reference_Links https://wikitech.wikimedia.org/wiki/Wikimedia_binaries The following executable binaries are maintained in version control ([and others) and provisioned by Puppet into /usr/local/bin. Deployment hosthttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#Deployment_host httpbbhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#httpbb mw-debug-replhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#mw-debug-repl mwlog-serverhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#mwlog-server logspam-watchhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#logspam-watch logspamhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#logspam fatalmonitorhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#fatalmonitor Maintenance hosthttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#Maintenance_host mwscripthttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#mwscript mwscriptwikisethttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#mwscriptwikiset foreachwikiindblisthttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#foreachwikiindblist foreachwikihttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#foreachwiki mwgrephttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#mwgrep expanddblisthttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#expanddblist sqlhttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#sql Purgehttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#Purge See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_binaries#See_also https://wikitech.wikimedia.org/wiki/Scap thcipriani@tin:~$ scap fortune | scap say Usagehttps://wikitech.wikimedia.org/wiki/Scap#Usage MediaWiki Deploymentshttps://wikitech.wikimedia.org/wiki/Scap#MediaWiki_Deployments scap lockhttps://wikitech.wikimedia.org/wiki/Scap#scap_lock scap pullhttps://wikitech.wikimedia.org/wiki/Scap#scap_pull scap sync-filehttps://wikitech.wikimedia.org/wiki/Scap#scap_sync-file scap sync-wikiversionshttps://wikitech.wikimedia.org/wiki/Scap#scap_sync-wikiversions scap sync-worldhttps://wikitech.wikimedia.org/wiki/Scap#scap_sync-world Backport Deploymentshttps://wikitech.wikimedia.org/wiki/Scap#Backport_Deployments scap backporthttps://wikitech.wikimedia.org/wiki/Scap#scap_backport scap backport --reverthttps://wikitech.wikimedia.org/wiki/Scap#scap_backport_--revert Other software deploymentshttps://wikitech.wikimedia.org/wiki/Scap#Other_software_deployments scap deployhttps://wikitech.wikimedia.org/wiki/Scap#scap_deploy Exampleshttps://wikitech.wikimedia.org/wiki/Scap#Examples DEFAULThttps://wikitech.wikimedia.org/wiki/Scap#DEFAULT scap deploy --service-restarthttps://wikitech.wikimedia.org/wiki/Scap#scap_deploy_--service-restart scap deploy-loghttps://wikitech.wikimedia.org/wiki/Scap#scap_deploy-log Deployment-server-scripthttps://wikitech.wikimedia.org/wiki/Scap#Deployment-server-script All-scripthttps://wikitech.wikimedia.org/wiki/Scap#All-script Wholesome Funhttps://wikitech.wikimedia.org/wiki/Scap#Wholesome_Fun Make a new Scap releasehttps://wikitech.wikimedia.org/wiki/Scap#Make_a_new_Scap_release https://wikitech.wikimedia.org/wiki/Test.wikipedia.org test.wikipedia. Purposehttps://wikitech.wikimedia.org/wiki/Test.wikipedia.org#Purpose Detailshttps://wikitech.wikimedia.org/wiki/Test.wikipedia.org#Details Before 2016https://wikitech.wikimedia.org/wiki/Test.wikipedia.org#Before_2016 Before 2013https://wikitech.wikimedia.org/wiki/Test.wikipedia.org#Before_2013 See alsohttps://wikitech.wikimedia.org/wiki/Test.wikipedia.org#See_also External linkhttps://wikitech.wikimedia.org/wiki/Test.wikipedia.org#External_link https://wikitech.wikimedia.org/wiki/Update_the_interwiki_cache The interwiki cache is a cache of the [map/list|interwiki map] page at Meta-Wiki, which maps interwiki prefixes to URLs. How to updatehttps://wikitech.wikimedia.org/wiki/Update_the_interwiki_cache#How_to_update Relatedhttps://wikitech.wikimedia.org/wiki/Update_the_interwiki_cache#Related https://wikitech.wikimedia.org/wiki/Ms2 New RAID layout of ms2, after the restore: Data recoveryhttps://wikitech.wikimedia.org/wiki/Ms2#Data_recovery New layouthttps://wikitech.wikimedia.org/wiki/Ms2#New_layout https://wikitech.wikimedia.org/wiki/Mobile_iPhone == Support == Supporthttps://wikitech.wikimedia.org/wiki/Mobile_iPhone#Support Developmenthttps://wikitech.wikimedia.org/wiki/Mobile_iPhone#Development https://wikitech.wikimedia.org/wiki/Tw_cli Some of our hardware raid controllers are controlled by the tw_cli command line tool. Most machines that have hardware arrays will have it installed but if not then you can grab it from the vendor 3ware. https://wikitech.wikimedia.org/wiki/Projects_for_September_2009 * order! SSLhttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#SSL Squid capacity upgradehttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#Squid_capacity_upgrade Datacenter projecthttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#Datacenter_project Miscellaneous servers for esamshttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#Miscellaneous_servers_for_esams Puppethttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#Puppet Move Wikitechhttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#Move_Wikitech esams cleanuphttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#esams_cleanup pmtpa management networkhttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#pmtpa_management_network LVShttps://wikitech.wikimedia.org/wiki/Projects_for_September_2009#LVS https://wikitech.wikimedia.org/wiki/Static_test_notes http://sage.knams. https://wikitech.wikimedia.org/wiki/ActiveMQ ActiveMQ used to be part of our fundraising architecture. It stood between civicrm and our operational cluster running the Donation Gateway extension providing a new payment gateway. Softwarehttps://wikitech.wikimedia.org/wiki/ActiveMQ#Software Configurationhttps://wikitech.wikimedia.org/wiki/ActiveMQ#Configuration Config fileshttps://wikitech.wikimedia.org/wiki/ActiveMQ#Config_files Connectorshttps://wikitech.wikimedia.org/wiki/ActiveMQ#Connectors Start/Stophttps://wikitech.wikimedia.org/wiki/ActiveMQ#Start/Stop Escalationhttps://wikitech.wikimedia.org/wiki/ActiveMQ#Escalation Activityhttps://wikitech.wikimedia.org/wiki/ActiveMQ#Activity Log in to tellurium. exhttps://wikitech.wikimedia.org/wiki/ActiveMQ#Log_in_to_tellurium._ex Login with your default terminal usernamehttps://wikitech.wikimedia.org/wiki/ActiveMQ#Login_with_your_default_terminal_username Connect to ActiveMQhttps://wikitech.wikimedia.org/wiki/ActiveMQ#Connect_to_ActiveMQ Testing donation consumptionhttps://wikitech.wikimedia.org/wiki/ActiveMQ#Testing_donation_consumption https://wikitech.wikimedia.org/wiki/Adding_Namespaces Like other configuration changes, adding namespaces is a two-step process: prepare a config change, and deploy it. Config changehttps://wikitech.wikimedia.org/wiki/Adding_Namespaces#Config_change Deploymenthttps://wikitech.wikimedia.org/wiki/Adding_Namespaces#Deployment https://wikitech.wikimedia.org/wiki/Add_a_wiki This page documents the process for adding a new wiki. This includes new languages on sister projects, and wikis for committees, chapters etc. Preparationhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Preparation Notifyhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Notify DNShttps://wikitech.wikimedia.org/wiki/Add_a_wiki#DNS Apache configurationhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Apache_configuration Language configurationhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Language_configuration Installhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Install IMPORTANT: For Private Wikishttps://wikitech.wikimedia.org/wiki/Add_a_wiki#IMPORTANT:_For_Private_Wikis MediaWiki configurationhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#MediaWiki_configuration Logohttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Logo Database creationhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Database_creation RESTBasehttps://wikitech.wikimedia.org/wiki/Add_a_wiki#RESTBase Parsoidhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Parsoid cxserverhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#cxserver Searchhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Search Swifthttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Swift Wiki Replicashttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Wiki_Replicas Before maintain views: DBAs' workhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Before_maintain_views:_DBAs'_work Maintain viewshttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Maintain_views Manual method in case Maintain views failhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Manual_method_in_case_Maintain_views_fail Finish up for either methodhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Finish_up_for_either_method WikimediaMessageshttps://wikitech.wikimedia.org/wiki/Add_a_wiki#WikimediaMessages Translatable project namehttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Translatable_project_name Cross-wiki (a.k.a. interwiki) search result titlehttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Cross-wiki_(a.k.a._interwiki)_search_result_title Wikipedia mobile appshttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Wikipedia_mobile_apps Post-installhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Post-install General announcement in Tech/Newshttps://wikitech.wikimedia.org/wiki/Add_a_wiki#General_announcement_in_Tech/News Wikidatahttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Wikidata Data Engineeringhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Data_Engineering Incubatorhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Incubator Clean up interwiki linkshttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Clean_up_interwiki_links Tell wikistats Cloud VPS project to add the wikihttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Tell_wikistats_Cloud_VPS_project_to_add_the_wiki Tell Pywikibot project to add the wikihttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Tell_Pywikibot_project_to_add_the_wiki Mobile appshttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Mobile_apps Portalhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Portal Kiwixhttps://wikitech.wikimedia.org/wiki/Add_a_wiki#Kiwix See alsohttps://wikitech.wikimedia.org/wiki/Add_a_wiki#See_also https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech ServerTech CDUs are smart power supplies with support for power and environmental monitoring, and (some models) outlet control. Issueshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Issues Initial Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Initial_Setup Adding items to scshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Adding_items_to_scs After the pdu restartshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#After_the_pdu_restarts Adding to Netboxhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Adding_to_Netbox Setting up the Configurationhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Setting_up_the_Configuration Adding devices to monitoringhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Adding_devices_to_monitoring Cookbookshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Cookbooks PDU'shttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#PDU's sre.pdus.uptimehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#sre.pdus.uptime sre.pdus.reboot-and-waithttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#sre.pdus.reboot-and-wait sre.pdus.rotate-snmphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#sre.pdus.rotate-snmp sre.pdus.rotate-passwordhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#sre.pdus.rotate-password Other Infohttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#Other_Info powering off and on outletshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#powering_off_and_on_outlets summary of other commandshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/ServerTech#summary_of_other_commands https://wikitech.wikimedia.org/wiki/Mobile1 Mobile1 is a Dell Poweredge 1950 running Ubuntu 8.04. Mobile serviceshttps://wikitech.wikimedia.org/wiki/Category:Mobile_services https://wikitech.wikimedia.org/wiki/Increasing_account_creation_threshold There are cases when the Wikimedia Foundation or others will host events that have a tendency of creating a large amount of new account requests during a short window of time from a single IP or a few IPs. The IP [account creation#Requesting temporary lift of IP cap|can be effectively white listed to be excluded from rate limiting]. throttle.phphttps://wikitech.wikimedia.org/wiki/Increasing_account_creation_threshold#throttle.php https://wikitech.wikimedia.org/wiki/Openstreetmap_Databases With OpenStreetMap, there are actually two possible types of PostgreSQL databases: OpenStreetMap API databasehttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#OpenStreetMap_API_database Setup processhttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Setup_process Full OSM Database Structurehttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Full_OSM_Database_Structure Simple schema for Osmosishttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Simple_schema_for_Osmosis Import planet with Osmosishttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Import_planet_with_Osmosis Mapnik databasehttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Mapnik_database Create Mapnik databasehttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Create_Mapnik_database Mapnik database structurehttps://wikitech.wikimedia.org/wiki/Openstreetmap_Databases#Mapnik_database_structure https://wikitech.wikimedia.org/wiki/Robot_policy This is a summary of the policies for crawlers, bots and remote loading websites that wish to operate on Wikipedia and other Wikimedia websites. User agenthttps://wikitech.wikimedia.org/wiki/Robot_policy#User_agent Cache hit ratehttps://wikitech.wikimedia.org/wiki/Robot_policy#Cache_hit_rate API usagehttps://wikitech.wikimedia.org/wiki/Robot_policy#API_usage Avoiding accidental DoShttps://wikitech.wikimedia.org/wiki/Robot_policy#Avoiding_accidental_DoS Request ratehttps://wikitech.wikimedia.org/wiki/Robot_policy#Request_rate Remote loadershttps://wikitech.wikimedia.org/wiki/Robot_policy#Remote_loaders https://wikitech.wikimedia.org/wiki/Torrus Torrus is an [monitoring/graphing system. It's like a much more advanced version of Cricket. Configuration and setuphttps://wikitech.wikimedia.org/wiki/Torrus#Configuration_and_setup Discoveryhttps://wikitech.wikimedia.org/wiki/Torrus#Discovery Common problemshttps://wikitech.wikimedia.org/wiki/Torrus#Common_problems Deadlock problemhttps://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem See alsohttps://wikitech.wikimedia.org/wiki/Torrus#See_also https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14 == December 15 == December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_12 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_19 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_30 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_9 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#August_1 July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_6 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_14#July_1 https://wikitech.wikimedia.org/wiki/Syslog Remote syslogs go to syslog.eqiad. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Bot and monitoringhttps://wikitech.wikimedia.org/wiki/Category:Bot_and_monitoring https://wikitech.wikimedia.org/wiki/Bits.wikimedia.org/Bits_and_pieces_plan The idea of bits and pieces is moving serving a group of certain most viewed static objects (css, js, etc) via another set of cache servers - that would be configured for many many connections, many many requests and not too much data with nearly no invalidations. Rationalehttps://wikitech.wikimedia.org/wiki/Bits.wikimedia.org/Bits_and_pieces_plan#Rationale Softwarehttps://wikitech.wikimedia.org/wiki/Bits.wikimedia.org/Bits_and_pieces_plan#Software Deployment planhttps://wikitech.wikimedia.org/wiki/Bits.wikimedia.org/Bits_and_pieces_plan#Deployment_plan https://wikitech.wikimedia.org/wiki/Bits.wikimedia.org/Varnish_testing Few notes: Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/MobileRoles There are several roles needed for a functioning Mobile system. Termshttps://wikitech.wikimedia.org/wiki/MobileRoles#Terms List of Roleshttps://wikitech.wikimedia.org/wiki/MobileRoles#List_of_Roles Basic Outline of Request Cyclehttps://wikitech.wikimedia.org/wiki/MobileRoles#Basic_Outline_of_Request_Cycle Basic Outline of Log Parsinghttps://wikitech.wikimedia.org/wiki/MobileRoles#Basic_Outline_of_Log_Parsing https://wikitech.wikimedia.org/wiki/Usability == Deployment Schedule == Deployment Schedulehttps://wikitech.wikimedia.org/wiki/Usability#Deployment_Schedule Deployment gotchashttps://wikitech.wikimedia.org/wiki/Usability#Deployment_gotchas Assetshttps://wikitech.wikimedia.org/wiki/Usability#Assets Usability JS/CSShttps://wikitech.wikimedia.org/wiki/Usability#Usability_JS/CSS Usability imageshttps://wikitech.wikimedia.org/wiki/Usability#Usability_images Monobook vs. Vectorhttps://wikitech.wikimedia.org/wiki/Usability#Monobook_vs._Vector Assets unique to Monobookhttps://wikitech.wikimedia.org/wiki/Usability#Assets_unique_to_Monobook Assets unique to Vectorhttps://wikitech.wikimedia.org/wiki/Usability#Assets_unique_to_Vector Migration speedupshttps://wikitech.wikimedia.org/wiki/Usability#Migration_speedups Other deployment taskshttps://wikitech.wikimedia.org/wiki/Usability#Other_deployment_tasks https://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data == Raw Data == Raw Datahttps://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#Raw_Data Analysishttps://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#Analysis On the changes from 2010-2011https://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#On_the_changes_from_2010-2011 Description of fields and valueshttps://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#Description_of_fields_and_values Legendhttps://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#Legend How these stats were generatedhttps://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#How_these_stats_were_generated Bugshttps://wikitech.wikimedia.org/wiki/External_storage/Text_storage_data#Bugs https://wikitech.wikimedia.org/wiki/OAI Our legacy OAI feed is configured with a standard mediawiki extension and is configured on the s3 database cluster. All current users are in the oai database under the oaiuser table. https://wikitech.wikimedia.org/wiki/PublicDashBoard What public facing reporting do we want? Examples of Dashboardshttps://wikitech.wikimedia.org/wiki/PublicDashBoard#Examples_of_Dashboards https://wikitech.wikimedia.org/wiki/MegaCli MegaCli is LSI's command line interface to their MegaRAID controller family. Dell uses them in their servers as e. Installation from the ZIP filehttps://wikitech.wikimedia.org/wiki/MegaCli#Installation_from_the_ZIP_file Common Parametershttps://wikitech.wikimedia.org/wiki/MegaCli#Common_Parameters Monitoringhttps://wikitech.wikimedia.org/wiki/MegaCli#Monitoring Information gatheringhttps://wikitech.wikimedia.org/wiki/MegaCli#Information_gathering Battery statushttps://wikitech.wikimedia.org/wiki/MegaCli#Battery_status Array statushttps://wikitech.wikimedia.org/wiki/MegaCli#Array_status Disk statushttps://wikitech.wikimedia.org/wiki/MegaCli#Disk_status Smart statushttps://wikitech.wikimedia.org/wiki/MegaCli#Smart_status Controller log output to a filehttps://wikitech.wikimedia.org/wiki/MegaCli#Controller_log_output_to_a_file Replacing Diskshttps://wikitech.wikimedia.org/wiki/MegaCli#Replacing_Disks Automatic array rebuild with a new diskhttps://wikitech.wikimedia.org/wiki/MegaCli#Automatic_array_rebuild_with_a_new_disk Manually array rebuild with an used diskhttps://wikitech.wikimedia.org/wiki/MegaCli#Manually_array_rebuild_with_an_used_disk Check and clear Preserved Cachehttps://wikitech.wikimedia.org/wiki/MegaCli#Check_and_clear_Preserved_Cache Manually replace multiple diskshttps://wikitech.wikimedia.org/wiki/MegaCli#Manually_replace_multiple_disks Replace individual disks in JBODhttps://wikitech.wikimedia.org/wiki/MegaCli#Replace_individual_disks_in_JBOD See alsohttps://wikitech.wikimedia.org/wiki/MegaCli#See_also External linkshttps://wikitech.wikimedia.org/wiki/MegaCli#External_links https://wikitech.wikimedia.org/wiki/OSPF OSPF ([Shortest Path First]) is the [used by Wikimedia. Because Foundry/Brocade does not support IS-IS for IPv6, we cannot use it. AS 43821https://wikitech.wikimedia.org/wiki/OSPF#AS_43821 https://wikitech.wikimedia.org/wiki/Paypal CiviCRM recieves contributions from two pipelines Web Checkouthttps://wikitech.wikimedia.org/wiki/Paypal#Web_Checkout Payflow Credit Cardshttps://wikitech.wikimedia.org/wiki/Paypal#Payflow_Credit_Cards https://wikitech.wikimedia.org/wiki/Tesla Tesla is a virtualization host for usability initiative virtual machines. Hostshttps://wikitech.wikimedia.org/wiki/Tesla#Hosts VMshttps://wikitech.wikimedia.org/wiki/Tesla#VMs Managing Teslahttps://wikitech.wikimedia.org/wiki/Tesla#Managing_Tesla Rebooting virtual machineshttps://wikitech.wikimedia.org/wiki/Tesla#Rebooting_virtual_machines VMware toolshttps://wikitech.wikimedia.org/wiki/Tesla#VMware_tools User documentationhttps://wikitech.wikimedia.org/wiki/Tesla#User_documentation Backend servershttps://wikitech.wikimedia.org/wiki/Tesla#Backend_servers Resourceshttps://wikitech.wikimedia.org/wiki/Tesla#Resources https://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/enwiki_2010-06-15 Here's the broad outline for the plan to roll out FlaggedRevs/Pending Changes to enwiki: Monday: Roll out FlaggedRevsAlpha to existing FlaggedRevs usershttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/enwiki_2010-06-15#Monday:_Roll_out_FlaggedRevsAlpha_to_existing_FlaggedRevs_users Tuesday: Roll out to enwikihttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/enwiki_2010-06-15#Tuesday:_Roll_out_to_enwiki Removal stepshttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/enwiki_2010-06-15#Removal_steps https://wikitech.wikimedia.org/wiki/Civicrm_tables These are the tables used by CiviCRM 2: Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Fundraising Archivehttps://wikitech.wikimedia.org/wiki/Category:Fundraising_Archive https://wikitech.wikimedia.org/wiki/Payments.wikimedia.org Due to the sensitive nature of the payments cluster, documentation can be found on OfficeWiki. Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/Distribution_upgrades This page provides some advice and guidelines on how to upgrade distributions on servers. Things to be aware ofhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades#Things_to_be_aware_of Distribution-specific noteshttps://wikitech.wikimedia.org/wiki/Distribution_upgrades#Distribution-specific_notes precise -> trustyhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades#precise_->_trusty jessie -> stretchhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades#jessie_->_stretch https://wikitech.wikimedia.org/wiki/Fundraising_Tracking Analytics play a large role in the annual fundraiser and we utilize a very simple and light weight system to capture how a user moves through their workflow. Central Noticehttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Central_Notice Landing Pageshttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Landing_Pages Multi Step Trackinghttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Multi_Step_Tracking Contribution Tracking Database Tablehttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Contribution_Tracking_Database_Table PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#PayPal Recurring Payments using PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Recurring_Payments_using_PayPal Credit Cardhttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Credit_Card Viewing Statshttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Viewing_Stats Missing Datahttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Missing_Data Tampering with datahttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Tampering_with_data Pathshttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Paths Future Planninghttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#Future_Planning OWAhttps://wikitech.wikimedia.org/wiki/Fundraising_Tracking#OWA https://wikitech.wikimedia.org/wiki/RT The Wikimedia Operations team is still using [Tracker] for managing procurement@ queue. RT is a ticket-tracking system written in Perl used to coordinate tasks with a mail based interface to handle support requests. Installationhttps://wikitech.wikimedia.org/wiki/RT#Installation Configurationhttps://wikitech.wikimedia.org/wiki/RT#Configuration Web server setuphttps://wikitech.wikimedia.org/wiki/RT#Web_server_setup Mail server setuphttps://wikitech.wikimedia.org/wiki/RT#Mail_server_setup Usagehttps://wikitech.wikimedia.org/wiki/RT#Usage Merginghttps://wikitech.wikimedia.org/wiki/RT#Merging Prioritieshttps://wikitech.wikimedia.org/wiki/RT#Priorities Toolbarhttps://wikitech.wikimedia.org/wiki/RT#Toolbar Adding a userhttps://wikitech.wikimedia.org/wiki/RT#Adding_a_user Detailed How To Add a Userhttps://wikitech.wikimedia.org/wiki/RT#Detailed_How_To_Add_a_User Which queues do we have and what are they used for?https://wikitech.wikimedia.org/wiki/RT#Which_queues_do_we_have_and_what_are_they_used_for? How do permissions work ?https://wikitech.wikimedia.org/wiki/RT#How_do_permissions_work_? Which groups do we have?https://wikitech.wikimedia.org/wiki/RT#Which_groups_do_we_have? system groupshttps://wikitech.wikimedia.org/wiki/RT#system_groups custom groupshttps://wikitech.wikimedia.org/wiki/RT#custom_groups Which permissions are there?https://wikitech.wikimedia.org/wiki/RT#Which_permissions_are_there? Permissions per group per queuehttps://wikitech.wikimedia.org/wiki/RT#Permissions_per_group_per_queue core-opshttps://wikitech.wikimedia.org/wiki/RT#core-ops domainshttps://wikitech.wikimedia.org/wiki/RT#domains eqiadhttps://wikitech.wikimedia.org/wiki/RT#eqiad Permissions per queue per grouphttps://wikitech.wikimedia.org/wiki/RT#Permissions_per_queue_per_group graphshttps://wikitech.wikimedia.org/wiki/RT#graphs Wishlist & annoyanceshttps://wikitech.wikimedia.org/wiki/RT#Wishlist_&_annoyances https://wikitech.wikimedia.org/wiki/Search_servers_relocation_-_12_august_2010 Batch one: searchidx1, search1 - search12 Before moving servershttps://wikitech.wikimedia.org/wiki/Search_servers_relocation_-_12_august_2010#Before_moving_servers Moving batch onehttps://wikitech.wikimedia.org/wiki/Search_servers_relocation_-_12_august_2010#Moving_batch_one Moving batch twohttps://wikitech.wikimedia.org/wiki/Search_servers_relocation_-_12_august_2010#Moving_batch_two Switching back to original statehttps://wikitech.wikimedia.org/wiki/Search_servers_relocation_-_12_august_2010#Switching_back_to_original_state https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15 == June 30 == June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_27 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_25 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_23 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_3 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_18 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_14 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_5 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_8 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#March_1 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_25 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_18 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#January_2 December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_15#December_16 https://wikitech.wikimedia.org/wiki/Packet-loss ==Packet-loss program== Packet-loss programhttps://wikitech.wikimedia.org/wiki/Packet-loss#Packet-loss_program Outputhttps://wikitech.wikimedia.org/wiki/Packet-loss#Output Link to UDP2LOGhttps://wikitech.wikimedia.org/wiki/Packet-loss#Link_to_UDP2LOG https://wikitech.wikimedia.org/wiki/Virtualization == Working documentation == Working documentationhttps://wikitech.wikimedia.org/wiki/Virtualization#Working_documentation Building VMshttps://wikitech.wikimedia.org/wiki/Virtualization#Building_VMs See alsohttps://wikitech.wikimedia.org/wiki/Virtualization#See_also https://wikitech.wikimedia.org/wiki/Virt-install == MAC Address ranges == MAC Address rangeshttps://wikitech.wikimedia.org/wiki/Virt-install#MAC_Address_ranges Using virt-installhttps://wikitech.wikimedia.org/wiki/Virt-install#Using_virt-install https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/old Below are miscellaneous notes about past implementation of this idea. For the latest information, see Heterogeneous deployment. Roan's quick&dirty implementationhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/old#Roan's_quick&dirty_implementation What lives wherehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/old#What_lives_where How to do stuffhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/old#How_to_do_stuff Notes for future projecthttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/old#Notes_for_future_project https://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/2010-11-17_Rollout_Checklist Here's the broad outline for the plan to roll out FlaggedRevs/Pending Changes to enwiki: Timelinehttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/2010-11-17_Rollout_Checklist#Timeline Removal stepshttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/2010-11-17_Rollout_Checklist#Removal_steps See alsohttps://wikitech.wikimedia.org/wiki/FlaggedRevs_setup/2010-11-17_Rollout_Checklist#See_also https://wikitech.wikimedia.org/wiki/Db10 Dell_PowerEdge_1950 Historyhttps://wikitech.wikimedia.org/wiki/Db10#History https://wikitech.wikimedia.org/wiki/Db9 Dell PowerEdge 1950 Active Databaseshttps://wikitech.wikimedia.org/wiki/Db9#Active_Databases CiviCRMhttps://wikitech.wikimedia.org/wiki/Db9#CiviCRM Blogshttps://wikitech.wikimedia.org/wiki/Db9#Blogs Othershttps://wikitech.wikimedia.org/wiki/Db9#Others Disk space issues as of 7/29/2011https://wikitech.wikimedia.org/wiki/Db9#Disk_space_issues_as_of_7/29/2011 https://wikitech.wikimedia.org/wiki/Yongle Yongle is a 3GB apache server. It's had hardware problems before, iirc. Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Tridge Tridge was the corporate backup server for all non-wiki data. Directorieshttps://wikitech.wikimedia.org/wiki/Tridge#Directories See alsohttps://wikitech.wikimedia.org/wiki/Tridge#See_also Decommissionedhttps://wikitech.wikimedia.org/wiki/Tridge#Decommissioned https://wikitech.wikimedia.org/wiki/Sockpuppet sockpuppet is a Dell PowerEdge R300, running Ubuntu 9.10. Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Singer singer ran miscellaneous services. Serviceshttps://wikitech.wikimedia.org/wiki/Singer#Services Decommissionedhttps://wikitech.wikimedia.org/wiki/Singer#Decommissioned https://wikitech.wikimedia.org/wiki/Sanger sanger was a Dell PowerEdge 1950 with a single Intel Xeon 5130, with 4 GB of memory and 2x 300 GB hardware RAID, and twin-brother of mchenry. sanger is Wikimedia's IMAP server. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Raskin Raskin is a selenium cluster node for testing OS X browser compatibility. Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Mchenry mchenry was a Dell PowerEdge 1950 with a single Intel Xeon 5130, with 4 GB of memory and 2x 300 GB hardware RAID. mchenry was Wikimedia's primary mail relay. Historyhttps://wikitech.wikimedia.org/wiki/Mchenry#History https://wikitech.wikimedia.org/wiki/Hume == Hardware == Hardwarehttps://wikitech.wikimedia.org/wiki/Hume#Hardware Ranhttps://wikitech.wikimedia.org/wiki/Hume#Ran Puppet Roleshttps://wikitech.wikimedia.org/wiki/Hume#Puppet_Roles Storagehttps://wikitech.wikimedia.org/wiki/Hume#Storage Historyhttps://wikitech.wikimedia.org/wiki/Hume#History https://wikitech.wikimedia.org/wiki/Grosley gosley was the failover host for aluminium. See Grosley-Aluminium-Migration for notes from switchover in November 2011. Serviceshttps://wikitech.wikimedia.org/wiki/Grosley#Services Hudsonhttps://wikitech.wikimedia.org/wiki/Grosley#Hudson Potential issueshttps://wikitech.wikimedia.org/wiki/Grosley#Potential_issues Hitting ext3 subdir limit in builds directorieshttps://wikitech.wikimedia.org/wiki/Grosley#Hitting_ext3_subdir_limit_in_builds_directories Preventionhttps://wikitech.wikimedia.org/wiki/Grosley#Prevention Resolutionhttps://wikitech.wikimedia.org/wiki/Grosley#Resolution Mail setuphttps://wikitech.wikimedia.org/wiki/Grosley#Mail_setup Configuration changeshttps://wikitech.wikimedia.org/wiki/Grosley#Configuration_changes https://wikitech.wikimedia.org/wiki/Fenari fenari was a Dell/PowerEdge R300 in Tampa running Ubuntu 10.04. Former serviceshttps://wikitech.wikimedia.org/wiki/Fenari#Former_services https://wikitech.wikimedia.org/wiki/Erzurumi Hosts ActiveMQ. Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Brewster Brewster was a Dell PowerEdge R300, with 4GB of RAM and two 1T drives (really?), running Ubuntu 8. Decomhttps://wikitech.wikimedia.org/wiki/Brewster#Decom Serviceshttps://wikitech.wikimedia.org/wiki/Brewster#Services https://wikitech.wikimedia.org/wiki/Adler Adler was a database server in Tampa. Systemhttps://wikitech.wikimedia.org/wiki/Adler#System Softwarehttps://wikitech.wikimedia.org/wiki/Adler#Software Historyhttps://wikitech.wikimedia.org/wiki/Adler#History Errorshttps://wikitech.wikimedia.org/wiki/Adler#Errors RMA Historyhttps://wikitech.wikimedia.org/wiki/Adler#RMA_History https://wikitech.wikimedia.org/wiki/Locke Dell PowerEdge 1950 Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Reclaim_space_on_full_db_servers == Remove old relay logs == Remove old relay logshttps://wikitech.wikimedia.org/wiki/Reclaim_space_on_full_db_servers#Remove_old_relay_logs Remove old bin logshttps://wikitech.wikimedia.org/wiki/Reclaim_space_on_full_db_servers#Remove_old_bin_logs https://wikitech.wikimedia.org/wiki/List_of_Admins https://wikitech.wikimedia.org/wiki/How_to_deploy_code This article is mainly about deployment of changes to MediaWiki code to the Wikimedia cluster. Introductionhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Introduction See alsohttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#See_also Basic tipshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Basic_tips Deployment requirementshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Deployment_requirements Access/rights needed to deployhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Access/rights_needed_to_deploy Other Prerequisiteshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Other_Prerequisites Step 1: get the code in the deployment branchhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Step_1:_get_the_code_in_the_deployment_branch Case 1a: core changeshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Case_1a:_core_changes Commit message for cherry pickshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Commit_message_for_cherry_picks Case 1b: extension/skin/vendor changeshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Case_1b:_extension/skin/vendor_changes Updating the deployment branchhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Updating_the_deployment_branch Updating the submodulehttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Updating_the_submodule Case 1c: new submodule (extension, skin, etc.)https://wikitech.wikimedia.org/wiki/How_to_deploy_code#Case_1c:_new_submodule_(extension,_skin,_etc.) Beta featurehttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Beta_feature Step 2: configuration and other prep workhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Step_2:_configuration_and_other_prep_work Add a configuration switch for an extensionhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Add_a_configuration_switch_for_an_extension Add new extension to extension-list and release toolshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Add_new_extension_to_extension-list_and_release_tools Disabling an extensionhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Disabling_an_extension Step 3: synchronize the changes to the clusterhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Step_3:_synchronize_the_changes_to_the_cluster Small changes: sync individual files or directorieshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Small_changes:_sync_individual_files_or_directories More complex changes: sync everythinghttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#More_complex_changes:_sync_everything Add / remove a dblisthttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Add_/_remove_a_dblist Changing files in /statichttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Changing_files_in_/static Manually stage changeshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Manually_stage_changes Pre-deployment testing in productionhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Pre-deployment_testing_in_production Test and monitor your live codehttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Test_and_monitor_your_live_code Don't leave townhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Don't_leave_town A note on JavaScript and CSShttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#A_note_on_JavaScript_and_CSS ResourceLoader and l10n messageshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#ResourceLoader_and_l10n_messages Security patcheshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Security_patches Creating a Security Patchhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Creating_a_Security_Patch Beforehttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Before Guidelines for creating patcheshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Guidelines_for_creating_patches Deployment: Manualhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Deployment:_Manual Deployment: via scripthttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Deployment:_via_script Afterhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#After Problem: Submodule security patches not committedhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Problem:_Submodule_security_patches_not_committed Security mitigationshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Security_mitigations Problem: undeployed codehttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Problem:_undeployed_code Backgroundhttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Background Problem: file permissions errorshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Problem:_file_permissions_errors Emergency runbook for production config changeshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Emergency_runbook_for_production_config_changes Footnoteshttps://wikitech.wikimedia.org/wiki/How_to_deploy_code#Footnotes https://wikitech.wikimedia.org/wiki/Configuration_files ==Deployment== Deploymenthttps://wikitech.wikimedia.org/wiki/Configuration_files#Deployment InitialiseSettings.phphttps://wikitech.wikimedia.org/wiki/Configuration_files#InitialiseSettings.php wgVariables vs. wmgVariableshttps://wikitech.wikimedia.org/wiki/Configuration_files#wgVariables_vs._wmgVariables CommonSettings.phphttps://wikitech.wikimedia.org/wiki/Configuration_files#CommonSettings.php Localization cachehttps://wikitech.wikimedia.org/wiki/Configuration_files#Localization_cache dblistshttps://wikitech.wikimedia.org/wiki/Configuration_files#dblists Other fileshttps://wikitech.wikimedia.org/wiki/Configuration_files#Other_files How configuration files are loadedhttps://wikitech.wikimedia.org/wiki/Configuration_files#How_configuration_files_are_loaded https://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change See Schema changes#Workflow of a schema change. Whatever you do, do not run update. Major Migrationshttps://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change#Major_Migrations sql.phphttps://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change#sql.php sql commandhttps://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change#sql_command runBatchedQuery.phphttps://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change#runBatchedQuery.php Running things on all wikishttps://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change#Running_things_on_all_wikis See alsohttps://wikitech.wikimedia.org/wiki/How_to_do_a_schema_change#See_also https://wikitech.wikimedia.org/wiki/Reprepro Reprepro is a tool for managing APT repositories. Deployment at WMFhttps://wikitech.wikimedia.org/wiki/Reprepro#Deployment_at_WMF HOWTOhttps://wikitech.wikimedia.org/wiki/Reprepro#HOWTO Browse packageshttps://wikitech.wikimedia.org/wiki/Reprepro#Browse_packages List all package versions in the repositorieshttps://wikitech.wikimedia.org/wiki/Reprepro#List_all_package_versions_in_the_repositories Build packages for importhttps://wikitech.wikimedia.org/wiki/Reprepro#Build_packages_for_import Automatically import files from an incoming/ directoryhttps://wikitech.wikimedia.org/wiki/Reprepro#Automatically_import_files_from_an_incoming/_directory Importing packageshttps://wikitech.wikimedia.org/wiki/Reprepro#Importing_packages Missing orig tarballhttps://wikitech.wikimedia.org/wiki/Reprepro#Missing_orig_tarball Removing packageshttps://wikitech.wikimedia.org/wiki/Reprepro#Removing_packages Removing a componenthttps://wikitech.wikimedia.org/wiki/Reprepro#Removing_a_component Using the override filehttps://wikitech.wikimedia.org/wiki/Reprepro#Using_the_override_file Copying between distributionshttps://wikitech.wikimedia.org/wiki/Reprepro#Copying_between_distributions Updating external repositorieshttps://wikitech.wikimedia.org/wiki/Reprepro#Updating_external_repositories Adding a new external repositoryhttps://wikitech.wikimedia.org/wiki/Reprepro#Adding_a_new_external_repository Updating where Pull rules are usedhttps://wikitech.wikimedia.org/wiki/Reprepro#Updating_where_Pull_rules_are_used If signing failshttps://wikitech.wikimedia.org/wiki/Reprepro#If_signing_fails wrong reprepro base dirhttps://wikitech.wikimedia.org/wiki/Reprepro#wrong_reprepro_base_dir Multiple versions of the same packagehttps://wikitech.wikimedia.org/wiki/Reprepro#Multiple_versions_of_the_same_package Additional infohttps://wikitech.wikimedia.org/wiki/Reprepro#Additional_info dputhttps://wikitech.wikimedia.org/wiki/Reprepro#dput duploadhttps://wikitech.wikimedia.org/wiki/Reprepro#dupload testing update filtershttps://wikitech.wikimedia.org/wiki/Reprepro#testing_update_filters External linkshttps://wikitech.wikimedia.org/wiki/Reprepro#External_links https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles * We use the Opengear CM4148. This is the 48 port version of the serial console server. Using the Serial Consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles#Using_the_Serial_Console Administrative Actionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles#Administrative_Actions Initial Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles#Initial_Setup Port / Connection Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles#Port_/_Connection_Setup Escape sequencehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles#Escape_sequence External Linkshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Opengear_Serial_Consoles#External_Links https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16 == October 31 == October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_20 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_30 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_22 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_9 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_8 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#August_1 July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_30 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_12 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_5 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_16#July_1 https://wikitech.wikimedia.org/wiki/Office_virtualization == Creating virtual machines == Creating virtual machineshttps://wikitech.wikimedia.org/wiki/Office_virtualization#Creating_virtual_machines Troubleshootinghttps://wikitech.wikimedia.org/wiki/Office_virtualization#Troubleshooting Keyboard mapping issueshttps://wikitech.wikimedia.org/wiki/Office_virtualization#Keyboard_mapping_issues https://wikitech.wikimedia.org/wiki/Fundraising_Logging The fundraising team utilizes the udp2log data stream to count banner impressions and click throughs. Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Fundraising - Needs Updatedhttps://wikitech.wikimedia.org/wiki/Category:Fundraising_-_Needs_Updated https://wikitech.wikimedia.org/wiki/Rename_a_wiki This is mostly a draft. It also only covers domain renames, DBA made clear that db renames won't happen. How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To MediaWiki productionhttps://wikitech.wikimedia.org/wiki/Category:MediaWiki_production https://wikitech.wikimedia.org/wiki/Kaulen Kaulen is a web server. Serviceshttps://wikitech.wikimedia.org/wiki/Kaulen#Services https://wikitech.wikimedia.org/wiki/Payments_deployment Payments deployment (on office wiki) Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17 This page archive server admin logs from November 1st 2010 till December 31st 2010 December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_12 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_17#November_1 https://wikitech.wikimedia.org/wiki/Fundraising_Monitoring This page is intended to document the monitoring infrastructure that exists for the fundraising as well as keep track of desired monitoring functionality. Existing monitoring infrastructurehttps://wikitech.wikimedia.org/wiki/Fundraising_Monitoring#Existing_monitoring_infrastructure Log monitoringhttps://wikitech.wikimedia.org/wiki/Fundraising_Monitoring#Log_monitoring Minfraud loghttps://wikitech.wikimedia.org/wiki/Fundraising_Monitoring#Minfraud_log Monitoring wishlisthttps://wikitech.wikimedia.org/wiki/Fundraising_Monitoring#Monitoring_wishlist https://wikitech.wikimedia.org/wiki/PoolCounter https://wikitech.wikimedia.org/wiki/Deployments This page tracks upcoming deployments of software to the [Foundation servers]. Getting startedhttps://wikitech.wikimedia.org/wiki/Deployments#Getting_started Week of November 11https://wikitech.wikimedia.org/wiki/Deployments#Week_of_November_11 ===https://wikitech.wikimedia.org/wiki/Deployments#=== Week of November 18https://wikitech.wikimedia.org/wiki/Deployments#Week_of_November_18 https://wikitech.wikimedia.org/wiki/Deployments/Archive/2011 == December == Decemberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#December Novemberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#November Octoberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#October Septemberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#September Augusthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#August Julyhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#July Junehttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#June Mayhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#May Aprilhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#April Marchhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2011#March https://wikitech.wikimedia.org/wiki/Contacts.wikimedia.org = Mail = Mailhttps://wikitech.wikimedia.org/wiki/Contacts.wikimedia.org#Mail https://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org https://etherpad.wikimedia. Hardwarehttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Hardware Abouthttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#About Database layouthttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Database_layout Deleting pads via site adminhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Deleting_pads_via_site_admin Restoring a pad to a previous revisionhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Restoring_a_pad_to_a_previous_revision How to list all padshttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#How_to_list_all_pads MediaWiki extensionhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#MediaWiki_extension Converting etherpad content into wikitexthttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Converting_etherpad_content_into_wikitext Maintenance workhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Maintenance_work Upgrading Etherpad versionhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Upgrading_Etherpad_version Build nodehttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Build_node Step #1, fetch stuffhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#1,_fetch_stuff Step #2, refresh patcheshttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#2,_refresh_patches Step #4, bump debian changeloghttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#4,_bump_debian_changelog Step #5, buildhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#5,_build Step #6, copy files to APT serverhttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#6,_copy_files_to_APT_server Step #7, import package into APT repohttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#7,_import_package_into_APT_repo Step #8, install new package version on Etherpad hosthttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#Step_#8,_install_new_package_version_on_Etherpad_host See alsohttps://wikitech.wikimedia.org/wiki/Etherpad.wikimedia.org#See_also https://wikitech.wikimedia.org/wiki/Delete_a_wiki Usually, wikis are closed, not deleted. Shirley: creating a wiki is like creating a baby, yes you should have a good reason to create one, but if you don't for whatever reason, you should have an _extra_ good reason for killing one Closing a wiki means that it is not editable anymore, but the content is still available. To delete a wikihttps://wikitech.wikimedia.org/wiki/Delete_a_wiki#To_delete_a_wiki Clean up after deletionhttps://wikitech.wikimedia.org/wiki/Delete_a_wiki#Clean_up_after_deletion See alsohttps://wikitech.wikimedia.org/wiki/Delete_a_wiki#See_also Noteshttps://wikitech.wikimedia.org/wiki/Delete_a_wiki#Notes https://wikitech.wikimedia.org/wiki/SRE/Production_access For instructions on accessing public Cloud VPS and Toolforge instances, see Help:Accessing Cloud VPS instances. Eligibilityhttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Eligibility Change the privileges of an access grouphttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Change_the_privileges_of_an_access_group Add WMF/WMDE Staff to an access grouphttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Add_WMF/WMDE_Staff_to_an_access_group Add a volunteer to an access grouphttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Add_a_volunteer_to_an_access_group Access Request Processhttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Access_Request_Process Accountshttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Accounts Signing the agreementhttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Signing_the_agreement Generating your SSH keyhttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Generating_your_SSH_key Filing the requesthttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Filing_the_request Technical detailshttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Technical_details Setting up your accesshttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Setting_up_your_access Setting up your SSH confighttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Setting_up_your_SSH_config Advanced: operations confighttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Advanced:_operations_config Known host fileshttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Known_host_files Securityhttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Security Other tipshttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Other_tips Debugginghttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Debugging See alsohttps://wikitech.wikimedia.org/wiki/SRE/Production_access#See_also Noteshttps://wikitech.wikimedia.org/wiki/SRE/Production_access#Notes https://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica == New Server Setup == New Server Setuphttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#New_Server_Setup Hardware Raidhttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Hardware_Raid XFShttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#XFS Puppethttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Puppet Transferring Datahttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Transferring_Data On New/Intended Slavehttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#On_New/Intended_Slave On Existing DBhttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#On_Existing_DB On New Slave, After xtrabackuphttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#On_New_Slave,_After_xtrabackup Starting Replicationhttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Starting_Replication Post Replicationhttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Post_Replication Adding to Productionhttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Adding_to_Production Slaves Not In Active Production (db.php)https://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Slaves_Not_In_Active_Production_(db.php) Make sure they'll receive schema migrationshttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Make_sure_they'll_receive_schema_migrations Making use-specific tweakshttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Making_use-specific_tweaks Research Slavehttps://wikitech.wikimedia.org/wiki/Setting_up_a_MySQL_replica#Research_Slave https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18 == June 30 == June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_20 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_31 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_13 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#March_1 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_2 February 01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#February_01 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_18#January_2 https://wikitech.wikimedia.org/wiki/Incidents/20110524-PlannedMaintenance Summary Report - Planned Network Maintenance, May 24, 2011 (13:00 UTC to 14:00 UTC) Incident documentationhttps://wikitech.wikimedia.org/wiki/Category:Incident_documentation https://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015 == Design == Designhttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Design Service nameshttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Service_names Load balancinghttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Load_balancing Certificateshttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Certificates SSL terminationhttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#SSL_termination Logginghttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Logging geoiplookup supporthttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#geoiplookup_support Secure cookieshttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Secure_cookies Protocol-relative URLshttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Protocol-relative_URLs Failoverhttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Failover Performance settingshttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Performance_settings Initial connection testinghttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Initial_connection_testing Image transfer with keepalive testinghttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Image_transfer_with_keepalive_testing Text transfer with keepalive testinghttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Text_transfer_with_keepalive_testing Security settingshttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Security_settings Future workhttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Future_work Testinghttps://wikitech.wikimedia.org/wiki/HTTPS/Archived-Pre-2015#Testing https://wikitech.wikimedia.org/wiki/Incidents/20110623-Performance On 23rd June 2011 at about 15:35 UTC, WMF Engineering reported access and performance problem with some of its web properties, which was subsequently resolved by 16:30 UTC. Sequence of Eventshttps://wikitech.wikimedia.org/wiki/Incidents/20110623-Performance#Sequence_of_Events Observed Symptomshttps://wikitech.wikimedia.org/wiki/Incidents/20110623-Performance#Observed_Symptoms Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20110623-Performance#Impact Root Cause Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20110623-Performance#Root_Cause_Analysis Recommendations/Lessons Learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20110623-Performance#Recommendations/Lessons_Learned https://wikitech.wikimedia.org/wiki/Incident_response Category:Operations policies Incident documentationhttps://wikitech.wikimedia.org/wiki/Category:Incident_documentation Operations policieshttps://wikitech.wikimedia.org/wiki/Category:Operations_policies https://wikitech.wikimedia.org/wiki/Fundraising_Analytics How fundraising analytics works. Data Mininghttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Data_Mining Banner Impressionshttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Banner_Impressions Data Cleaninghttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Data_Cleaning Data APIhttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Data_API Normalizationhttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Normalization SQL Querieshttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#SQL_Queries Confidence Testinghttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Confidence_Testing Web Hosting and Reportinghttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Web_Hosting_and_Reporting Implementationhttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics#Implementation https://wikitech.wikimedia.org/wiki/Fundraising_Analytics/Impression_Stats We now get stats via Kafka and some special fr-tech-ops script to reconstitute files that look like web logs, then a Django script processes them. udp2log proxy log collectionhttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics/Impression_Stats#udp2log_proxy_log_collection proxy log rotation and archivinghttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics/Impression_Stats#proxy_log_rotation_and_archiving analytics processing scripthttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics/Impression_Stats#analytics_processing_script monitoring and debugginghttps://wikitech.wikimedia.org/wiki/Fundraising_Analytics/Impression_Stats#monitoring_and_debugging https://wikitech.wikimedia.org/wiki/Incidents/20110713-PlannedMaintenance Draft Report on the July 13, 2011 Planned Network Maintenance Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20110713-PlannedMaintenance#Summary Backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/20110713-PlannedMaintenance#Background Planhttps://wikitech.wikimedia.org/wiki/Incidents/20110713-PlannedMaintenance#Plan Maintenance periodhttps://wikitech.wikimedia.org/wiki/Incidents/20110713-PlannedMaintenance#Maintenance_period Notehttps://wikitech.wikimedia.org/wiki/Incidents/20110713-PlannedMaintenance#Note https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment This page documents the design and architecture of Heterogeneous deployments (abbreviated as "HET"). This document describes the current infrastructure, which allows for different wikis to be running different MediaWiki versions at the same time. Where things livehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Where_things_live mediawiki-staging/https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#mediawiki-staging/ mediawiki-staging/multiversionhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#mediawiki-staging/multiversion mediawiki-staging/wmf-confighttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#mediawiki-staging/wmf-config mediawiki-staging/php-*https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#mediawiki-staging/php-* /usr/local/binhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#/usr/local/bin How to do stuffhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#How_to_do_stuff General remarks on deploying codehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#General_remarks_on_deploying_code Basic common sensehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Basic_common_sense Deployment Requirementshttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Deployment_Requirements Don't leave townhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Don't_leave_town Basic code deployment stepshttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Basic_code_deployment_steps Change wiki configurationhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Change_wiki_configuration In your own repo via gerrithttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#In_your_own_repo_via_gerrit Change on deployment.eqiad.wmnet then commithttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Change_on_deployment.eqiad.wmnet_then_commit Run a maintenance script on a wikihttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Run_a_maintenance_script_on_a_wiki Run a maintenance script on a group of wikishttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Run_a_maintenance_script_on_a_group_of_wikis Run a maintenance script on all wikishttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Run_a_maintenance_script_on_all_wikis Install a new extension on a wikihttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Install_a_new_extension_on_a_wiki Add a configuration switch for an extensionhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Add_a_configuration_switch_for_an_extension Add new extensions to extension-listhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Add_new_extensions_to_extension-list Deploy the extensionhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Deploy_the_extension Add to repos/releng/releasehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment#Add_to_repos/releng/release https://wikitech.wikimedia.org/wiki/Db1025 db1025 is a 'misc' cluster slave of db1008. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Db1008 db1008 is the master database of the fundraisingdb cluster. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/XFS == XFS and our servers == XFS and our servershttps://wikitech.wikimedia.org/wiki/XFS#XFS_and_our_servers How they're formattedhttps://wikitech.wikimedia.org/wiki/XFS#How_they're_formatted How they get formattedhttps://wikitech.wikimedia.org/wiki/XFS#How_they_get_formatted Why they're formatted this wayhttps://wikitech.wikimedia.org/wiki/XFS#Why_they're_formatted_this_way https://wikitech.wikimedia.org/wiki/Raid_and_MegaCli == Raid setup at Wikimedia == Raid setup at Wikimediahttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#Raid_setup_at_Wikimedia Querying the RAID cardhttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#Querying_the_RAID_card Get event logshttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#Get_event_logs Logical device infohttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#Logical_device_info Firmware, serial number, and boatloads of other default confighttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#Firmware,_serial_number,_and_boatloads_of_other_default_config https://wikitech.wikimedia.org/wiki/Raid_and_MegaCli# Icinga checkshttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#Icinga_checks External linkshttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#External_links See Alsohttps://wikitech.wikimedia.org/wiki/Raid_and_MegaCli#See_Also https://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation This page serves to chronicle my investigation into why puppet is so slow in our environment. Bhartshorne 17:01, 9 August 2011 (UTC) Potential problems to checkhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Potential_problems_to_check Hypotheses about why we're slowhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Hypotheses_about_why_we're_slow Avenues of investigationhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Avenues_of_investigation server sidehttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#server_side client sidehttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#client_side Taskshttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Tasks Tests to runhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Tests_to_run collected datahttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#collected_data puppetmasterhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#puppetmaster aluminiumhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#aluminium fast runhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#fast_run apache logs comparing actions in later runshttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#apache_logs_comparing_actions_in_later_runs spencehttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#spence Things to tryhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Things_to_try Other resources that look interestinghttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Other_resources_that_look_interesting Resolved issues and their descriptionhttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Resolved_issues_and_their_description Spencehttps://wikitech.wikimedia.org/wiki/Puppet/Performance_investigation#Spence https://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08 A description of the project to bring the external storage service up to date. Background and contexthttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#Background_and_context Goalshttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#Goals Processhttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#Process Documentationhttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#Documentation Database replication - desired end statehttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#Database_replication_-_desired_end_state Putting the new hosts into rotation and testinghttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#Putting_the_new_hosts_into_rotation_and_testing db level test for ES contenthttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#db_level_test_for_ES_content application level test for the ES data contenthttps://wikitech.wikimedia.org/wiki/External_storage/Update_2011-08#application_level_test_for_the_ES_data_content https://wikitech.wikimedia.org/wiki/Swift/Dev_Notes Category:Swift Documentation Organizationhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Documentation_Organization Swift architecturehttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Swift_architecture Hardwarehttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Hardware Proposedhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Proposed Analysishttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Analysis Purchasedhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Purchased Deploy orderhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Deploy_order Thumbnails, round 1https://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Thumbnails,_round_1 Originalshttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Originals Thumbnails, round 2https://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Thumbnails,_round_2 MediaWiki integrationhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#MediaWiki_integration Thumbnail Uploadhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Thumbnail_Upload Thumbnail Retrievalhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Thumbnail_Retrieval Current Pathhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Current_Path Testing Swifthttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Testing_Swift All Swifthttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#All_Swift Removing ms5https://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Removing_ms5 Removing NFS from the scalershttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Removing_NFS_from_the_scalers Originals Uploadshttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Originals_Uploads Originals Retrievalhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Originals_Retrieval FAQ and random bits about how our cluster is deployed and whyhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#FAQ_and_random_bits_about_how_our_cluster_is_deployed_and_why how to thumbnails for private vs. public wikis differ?https://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#how_to_thumbnails_for_private_vs._public_wikis_differ? why don't we use ssl, and what are the ramifications?https://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#why_don't_we_use_ssl,_and_what_are_the_ramifications? More detailed task breakdownhttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#More_detailed_task_breakdown Installation Noteshttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#Installation_Notes old noteshttps://wikitech.wikimedia.org/wiki/Swift/Dev_Notes#old_notes https://wikitech.wikimedia.org/wiki/Swift/Cluster_Ops Category:Swift Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services Swifthttps://wikitech.wikimedia.org/wiki/Category:Swift https://wikitech.wikimedia.org/wiki/MobileFrontend == Ops Configuration / Deployed Files == Ops Configuration / Deployed Fileshttps://wikitech.wikimedia.org/wiki/MobileFrontend#Ops_Configuration_/_Deployed_Files Varnish 3.0https://wikitech.wikimedia.org/wiki/MobileFrontend#Varnish_3.0 MediaWikihttps://wikitech.wikimedia.org/wiki/MobileFrontend#MediaWiki Traffic Flowhttps://wikitech.wikimedia.org/wiki/MobileFrontend#Traffic_Flow Redirect to mobilehttps://wikitech.wikimedia.org/wiki/MobileFrontend#Redirect_to_mobile Mobile requestshttps://wikitech.wikimedia.org/wiki/MobileFrontend#Mobile_requests Cache purginghttps://wikitech.wikimedia.org/wiki/MobileFrontend#Cache_purging Flushing the cachehttps://wikitech.wikimedia.org/wiki/MobileFrontend#Flushing_the_cache Logginghttps://wikitech.wikimedia.org/wiki/MobileFrontend#Logging Deployment considerations/gotchashttps://wikitech.wikimedia.org/wiki/MobileFrontend#Deployment_considerations/gotchas Statshttps://wikitech.wikimedia.org/wiki/MobileFrontend#Stats https://wikitech.wikimedia.org/wiki/Nagios-wm nagios-wm is an IRC bot that outputs Nagios changes on channels. Botshttps://wikitech.wikimedia.org/wiki/Category:Bots https://wikitech.wikimedia.org/wiki/Parser_cache The [cache|parser cache] is currently (2011-08-31) backed by MariaDB with hot keys also residing in MediaWiki's main cache (Memcached). Current configurationhttps://wikitech.wikimedia.org/wiki/Parser_cache#Current_configuration Historyhttps://wikitech.wikimedia.org/wiki/Parser_cache#History https://wikitech.wikimedia.org/wiki/UID ==UID ranges== UID rangeshttps://wikitech.wikimedia.org/wiki/UID#UID_ranges Reserved UIDs & GIDshttps://wikitech.wikimedia.org/wiki/UID#Reserved_UIDs_&_GIDs Permission/security hierarchyhttps://wikitech.wikimedia.org/wiki/UID#Permission/security_hierarchy https://wikitech.wikimedia.org/wiki/RT_Flow === Summary === Summaryhttps://wikitech.wikimedia.org/wiki/RT_Flow#Summary Flow Descriptionhttps://wikitech.wikimedia.org/wiki/RT_Flow#Flow_Description Next Stepshttps://wikitech.wikimedia.org/wiki/RT_Flow#Next_Steps https://wikitech.wikimedia.org/wiki/Raid_setup Category:How-To How to configure Raid in the BIOShttps://wikitech.wikimedia.org/wiki/Raid_setup#How_to_configure_Raid_in_the_BIOS Hosts with PERC H750 RAID Controllershttps://wikitech.wikimedia.org/wiki/Raid_setup#Hosts_with_PERC_H750_RAID_Controllers Dell R510https://wikitech.wikimedia.org/wiki/Raid_setup#Dell_R510 Dell R740xd2https://wikitech.wikimedia.org/wiki/Raid_setup#Dell_R740xd2 https://wikitech.wikimedia.org/wiki/Aluminium aluminium was the fundraising application host at eqiad between 2013 and 2016. Before 2013, grosley was also used. See alsohttps://wikitech.wikimedia.org/wiki/Aluminium#See_also https://wikitech.wikimedia.org/wiki/External_storage/Srv-data-migration Detail on the process to migrate data from the srv external store hosts to the new es100x hosts. playershttps://wikitech.wikimedia.org/wiki/External_storage/Srv-data-migration#players setuphttps://wikitech.wikimedia.org/wiki/External_storage/Srv-data-migration#setup actionhttps://wikitech.wikimedia.org/wiki/External_storage/Srv-data-migration#action posthttps://wikitech.wikimedia.org/wiki/External_storage/Srv-data-migration#post end statehttps://wikitech.wikimedia.org/wiki/External_storage/Srv-data-migration#end_state https://wikitech.wikimedia.org/wiki/Gerrit We use Gerrit for our code review system. End users documentationshttps://wikitech.wikimedia.org/wiki/Gerrit#End_users_documentations https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_PowerEdge_RN10/R510_Performance_Testing The Dell PowerEdge R510 hosts are used for the es1001-es1010 hosts in eqiad. Hardware statshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_PowerEdge_RN10/R510_Performance_Testing#Hardware_stats Performance statisticshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_PowerEdge_RN10/R510_Performance_Testing#Performance_statistics cpu, memory, threads, mutexhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_PowerEdge_RN10/R510_Performance_Testing#cpu,_memory,_threads,_mutex diskshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_PowerEdge_RN10/R510_Performance_Testing#disks https://wikitech.wikimedia.org/wiki/MessageCache This is Wikimedia-specific documentation for the MessageCache system. How tohttps://wikitech.wikimedia.org/wiki/MessageCache#How_to https://wikitech.wikimedia.org/wiki/Incident_status ;Create a new incident report Past incidentshttps://wikitech.wikimedia.org/wiki/Incident_status#Past_incidents https://wikitech.wikimedia.org/wiki/Incident_status# Incident historyhttps://wikitech.wikimedia.org/wiki/Incident_status#Incident_history See alsohttps://wikitech.wikimedia.org/wiki/Incident_status#See_also https://wikitech.wikimedia.org/wiki/Incidents/20110926-DBandPower == Documentation by Mark Bergsma == Documentation by Mark Bergsmahttps://wikitech.wikimedia.org/wiki/Incidents/20110926-DBandPower#Documentation_by_Mark_Bergsma Access switch power outage at 14:12 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20110926-DBandPower#Access_switch_power_outage_at_14:12_UTC Database master switch outage at 18:23https://wikitech.wikimedia.org/wiki/Incidents/20110926-DBandPower#Database_master_switch_outage_at_18:23 Another database related outage at 22:41 UTC.https://wikitech.wikimedia.org/wiki/Incidents/20110926-DBandPower#Another_database_related_outage_at_22:41_UTC. Additional notes by Asher Feldmanhttps://wikitech.wikimedia.org/wiki/Incidents/20110926-DBandPower#Additional_notes_by_Asher_Feldman https://wikitech.wikimedia.org/wiki/Verify-copy.sh You probably want to use compare.py instead and do a full verification. MySQLhttps://wikitech.wikimedia.org/wiki/Category:MySQL Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Ganglios Just in case you missed the RT ticket (1603) fly by, I have intsalled (and tested, somewhat) ganglios[1], a collection of python that allows nagios to query ganglia for the metrics it reports and use that data to trigger alerts. This will be useful in two ways: Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Bot and monitoringhttps://wikitech.wikimedia.org/wiki/Category:Bot_and_monitoring https://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading Currently the CentralNotice banners load approximately 1 second after the rest of the page loads which is annoying. Ideashttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#Ideas 1. Store country in a cookiehttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#1._Store_country_in_a_cookie 2. Remove Ajax call (frontload the banner lists)https://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#2._Remove_Ajax_call_(frontload_the_banner_lists) 3. Partial page cachinghttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#3._Partial_page_caching 4. Make the GeoIP lookup reliably fasthttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#4._Make_the_GeoIP_lookup_reliably_fast 5. Use JS to detect cookie hiding banners and load correct CSShttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#5._Use_JS_to_detect_cookie_hiding_banners_and_load_correct_CSS 6. Load BannerLoader locallyhttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#6._Load_BannerLoader_locally 2012 updatehttps://wikitech.wikimedia.org/wiki/CentralNotice/Optimizing_banner_loading#2012_update https://wikitech.wikimedia.org/wiki/Pentaho This page details some initial investigation into what it would take to install the Pentaho business intelligence platform for collecting stats about the Wikimedia community. Contexthttps://wikitech.wikimedia.org/wiki/Pentaho#Context Pentaho structurehttps://wikitech.wikimedia.org/wiki/Pentaho#Pentaho_structure Linkshttps://wikitech.wikimedia.org/wiki/Pentaho#Links https://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes Category:Swift hardwarehttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#hardware swift installhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#swift_install packageshttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#packages puppethttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#puppet proxy nodeshttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#proxy_nodes high capacity conntrackinghttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#high_capacity_conntracking memcachedhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#memcached ringshttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#rings swauthhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#swauth storage nodeshttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#storage_nodes filesystemshttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#filesystems rsyncdhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#rsyncd swift servershttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#swift_servers testinghttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#testing using tempauthhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#using_tempauth using swauthhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#using_swauth testing the auth systemhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#testing_the_auth_system testing the object storehttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#testing_the_object_store testing upload.wikimedia.org style URLshttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#testing_upload.wikimedia.org_style_URLs Performance Testinghttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#Performance_Testing pmtpa test clusterhttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#pmtpa_test_cluster debugginghttps://wikitech.wikimedia.org/wiki/Swift/Hackathon_Installation_Notes#debugging https://wikitech.wikimedia.org/wiki/PartMan This page is about partitioning with preseed. See Ubuntu installer for other parts of the installation process and preseed options. Background Infohttps://wikitech.wikimedia.org/wiki/PartMan#Background_Info Standard recipes / disk layouthttps://wikitech.wikimedia.org/wiki/PartMan#Standard_recipes_/_disk_layout Software raidhttps://wikitech.wikimedia.org/wiki/PartMan#Software_raid Hardware raidhttps://wikitech.wikimedia.org/wiki/PartMan#Hardware_raid LVM layouthttps://wikitech.wikimedia.org/wiki/PartMan#LVM_layout Non-standard recipeshttps://wikitech.wikimedia.org/wiki/PartMan#Non-standard_recipes Help Fileshttps://wikitech.wikimedia.org/wiki/PartMan#Help_Files Important note about RAIDhttps://wikitech.wikimedia.org/wiki/PartMan#Important_note_about_RAID Important note about how partman calculates the final size of the partitionshttps://wikitech.wikimedia.org/wiki/PartMan#Important_note_about_how_partman_calculates_the_final_size_of_the_partitions Config languagehttps://wikitech.wikimedia.org/wiki/PartMan#Config_language Dissecting a Semi-working configurationhttps://wikitech.wikimedia.org/wiki/PartMan#Dissecting_a_Semi-working_configuration Dissecting another confighttps://wikitech.wikimedia.org/wiki/PartMan#Dissecting_another_config Things that peter has found outhttps://wikitech.wikimedia.org/wiki/PartMan#Things_that_peter_has_found_out Other Helpful Documentshttps://wikitech.wikimedia.org/wiki/PartMan#Other_Helpful_Documents https://wikitech.wikimedia.org/wiki/PartMan/Auto Back to PartMan How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To https://wikitech.wikimedia.org/wiki/PartMan/AutoRaid Back to PartMan How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To https://wikitech.wikimedia.org/wiki/Link_aggregation There are several ways to aggregate multiple links into one, bigger, more redundant link. Server link aggregationhttps://wikitech.wikimedia.org/wiki/Link_aggregation#Server_link_aggregation Juniperhttps://wikitech.wikimedia.org/wiki/Link_aggregation#Juniper Foundryhttps://wikitech.wikimedia.org/wiki/Link_aggregation#Foundry Linux/Puppethttps://wikitech.wikimedia.org/wiki/Link_aggregation#Linux/Puppet https://wikitech.wikimedia.org/wiki/HTTPS/Httpsless_domains See also HTTPS/domains List of domains not supporting HTTPS [http://pastebin.com/zqjtnx09]https://wikitech.wikimedia.org/wiki/HTTPS/Httpsless_domains#List_of_domains_not_supporting_HTTPS_[http://pastebin.com/zqjtnx09] https://wikitech.wikimedia.org/wiki/Partial_page_caching See the RFC at mw.org for current-day information. https://wikitech.wikimedia.org/wiki/Git-buildpackage = Using git-buildpackage with source that already has a debian/ directory = Using git-buildpackage with source that already has a debian/ directoryhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Using_git-buildpackage_with_source_that_already_has_a_debian/_directory Initially cloning the git repository from Upstreamhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Initially_cloning_the_git_repository_from_Upstream Making changes and testing snapshot buildshttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Making_changes_and_testing_snapshot_builds Doing a releasehttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Doing_a_release Pushing changes into Gerrithttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Pushing_changes_into_Gerrit Pushing the repository into Gerrithttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Pushing_the_repository_into_Gerrit How to build a Python deb package using git-buildpackagehttps://wikitech.wikimedia.org/wiki/Git-buildpackage#How_to_build_a_Python_deb_package_using_git-buildpackage Building a python package from a release tarballhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Building_a_python_package_from_a_release_tarball Prep your git repositoryhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Prep_your_git_repository Import the tarballhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Import_the_tarball Use stdeb to create the debian/ directoryhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Use_stdeb_to_create_the_debian/_directory Build the packagehttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Build_the_package Push to gerrit for reviewhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Push_to_gerrit_for_review Add the reviewed package to apt.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Add_the_reviewed_package_to_apt.wikimedia.org Building a python package from an existing git repositoryhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Building_a_python_package_from_an_existing_git_repository FAQhttps://wikitech.wikimedia.org/wiki/Git-buildpackage#FAQ dpkg-source complaining about local changeshttps://wikitech.wikimedia.org/wiki/Git-buildpackage#dpkg-source_complaining_about_local_changes Investigating build failureshttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Investigating_build_failures Experimentshttps://wikitech.wikimedia.org/wiki/Git-buildpackage#Experiments experiment build mathoid debian package on vagrant and publish to ppahttps://wikitech.wikimedia.org/wiki/Git-buildpackage#experiment_build_mathoid_debian_package_on_vagrant_and_publish_to_ppa External linkshttps://wikitech.wikimedia.org/wiki/Git-buildpackage#External_links https://wikitech.wikimedia.org/wiki/Hooper hooper ran miscellaneous services Serviceshttps://wikitech.wikimedia.org/wiki/Hooper#Services Puppet Roleshttps://wikitech.wikimedia.org/wiki/Hooper#Puppet_Roles https://wikitech.wikimedia.org/wiki/Dumps/Adds-changes_dumps ==Adds/changes dumps overview== Adds/changes dumps overviewhttps://wikitech.wikimedia.org/wiki/Dumps/Adds-changes_dumps#Adds/changes_dumps_overview How it workshttps://wikitech.wikimedia.org/wiki/Dumps/Adds-changes_dumps#How_it_works When stuff breakshttps://wikitech.wikimedia.org/wiki/Dumps/Adds-changes_dumps#When_stuff_breaks Some numbershttps://wikitech.wikimedia.org/wiki/Dumps/Adds-changes_dumps#Some_numbers https://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan Category:Swift Background informationhttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#Background_information Test platformshttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#Test_platforms First iterationhttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#First_iteration Second iteration (proposed)https://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#Second_iteration_(proposed) production config (proposed)https://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#production_config_(proposed) Testshttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#Tests speedhttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#speed functional against swift directlyhttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#functional_against_swift_directly functional through mediawiki - thumbnailshttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#functional_through_mediawiki_-_thumbnails functional through mediawiki - originalshttps://wikitech.wikimedia.org/wiki/Swift/Preliminary_test_plan#functional_through_mediawiki_-_originals https://wikitech.wikimedia.org/wiki/Incidents/20111127-Reddit On 27th November 2011 at about 21:48 UTC, Nagios started reporting load problem with db1025, a MySQL slave server used by the Fundraising team for reporting purposes. About 7 minutes later, db1025 and the Apache servers started spilling 'socket timeout' error messages. Sequence of Eventshttps://wikitech.wikimedia.org/wiki/Incidents/20111127-Reddit#Sequence_of_Events Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20111127-Reddit#Impact Root Cause Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20111127-Reddit#Root_Cause_Analysis Recommendations/Lessons Learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20111127-Reddit#Recommendations/Lessons_Learned https://wikitech.wikimedia.org/wiki/Bayes bayes was a Sun server in Tampa, used by [for metrics scripts written in R]. (Do not touch right before metrics meetings) Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/LimeSurveyPerformanceRecs === LimeSurvey Recommendations === LimeSurvey Recommendationshttps://wikitech.wikimedia.org/wiki/LimeSurveyPerformanceRecs#LimeSurvey_Recommendations Support for InnoDBhttps://wikitech.wikimedia.org/wiki/LimeSurveyPerformanceRecs#Support_for_InnoDB Session handlinghttps://wikitech.wikimedia.org/wiki/LimeSurveyPerformanceRecs#Session_handling Database efficiencyhttps://wikitech.wikimedia.org/wiki/LimeSurveyPerformanceRecs#Database_efficiency Summationhttps://wikitech.wikimedia.org/wiki/LimeSurveyPerformanceRecs#Summation https://wikitech.wikimedia.org/wiki/Create_a_Racktables_server Moving/copying Racktables from one server to another: How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation Operationshttps://wikitech.wikimedia.org/wiki/Category:Operations https://wikitech.wikimedia.org/wiki/Hardware_Disambiguation This page serves as a rough translation between informal names (db) and hardware (dell r510). All statements should be verified on specific hardware. Hardwarehttps://wikitech.wikimedia.org/wiki/Category:Hardware Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation Platform-specific documentationhttps://wikitech.wikimedia.org/wiki/Category:Platform-specific_documentation https://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster Category:Swift update DNShttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#update_DNS Set up filesystemshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#Set_up_filesystems create the cluster hashhttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#create_the_cluster_hash update puppethttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#update_puppet build the ringshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#build_the_rings distribute the ringshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#distribute_the_rings reboothttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#reboot set up auth tokens for the clusterhttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#set_up_auth_tokens_for_the_cluster tell puppet about the auth tokenshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#tell_puppet_about_the_auth_tokens update the proxies and restart the proxy servicehttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#update_the_proxies_and_restart_the_proxy_service create dispersion objects and containershttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#create_dispersion_objects_and_containers make the containers necessary for thumbnailshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#make_the_containers_necessary_for_thumbnails make the containers readable by anonymous usershttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#make_the_containers_readable_by_anonymous_users test the clusterhttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#test_the_cluster todohttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster#todo https://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data Category:Swift new methodhttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#new_method capture incoming thumbnail requestshttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#capture_incoming_thumbnail_requests stuff images into swifthttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#stuff_images_into_swift watching progresshttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#watching_progress old method (as of 2012-01-30)https://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#old_method_(as_of_2012-01-30) success conditionhttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#success_condition get a list of existing thumbnails from ms5https://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#get_a_list_of_existing_thumbnails_from_ms5 exclude commons for test clustershttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#exclude_commons_for_test_clusters transform the list into URLshttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#transform_the_list_into_URLs load all these urlshttps://wikitech.wikimedia.org/wiki/Swift/Load_Thumbnail_Data#load_all_these_urls https://wikitech.wikimedia.org/wiki/Libera_Chat Libera Chat is an IRC network used by the Wikimedia community since May 2021. Community-maintained documentation about how to use IRC can be found at [and to manage your channel, refer to [[m:IRC/Instructions#Instructions for channel ops]. Create a public channelhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Create_a_public_channel Create a private channelhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Create_a_private_channel Manage a channelhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Manage_a_channel Op your selfhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Op_your_self To verify nick protectionhttps://wikitech.wikimedia.org/wiki/Libera_Chat#To_verify_nick_protection Enable nick protectionhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Enable_nick_protection Show invite listhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Show_invite_list Invite someone to a channel (permanently)https://wikitech.wikimedia.org/wiki/Libera_Chat#Invite_someone_to_a_channel_(permanently) Invite yourself to a private channelhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Invite_yourself_to_a_private_channel Remove someone from the invite listhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Remove_someone_from_the_invite_list Invite someone to a list temporarilyhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Invite_someone_to_a_list_temporarily Edit the topichttps://wikitech.wikimedia.org/wiki/Libera_Chat#Edit_the_topic View access listhttps://wikitech.wikimedia.org/wiki/Libera_Chat#View_access_list Add channel operatorhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Add_channel_operator Remove a guesthttps://wikitech.wikimedia.org/wiki/Libera_Chat#Remove_a_guest Manage Usershttps://wikitech.wikimedia.org/wiki/Libera_Chat#Manage_Users Check user has nick protectionhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Check_user_has_nick_protection See alsohttps://wikitech.wikimedia.org/wiki/Libera_Chat#See_also Freenode IRC networkhttps://wikitech.wikimedia.org/wiki/Libera_Chat#Freenode_IRC_network https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19 == December 31 == December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_9 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_8 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#August_1 July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_4 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_19#July_1 https://wikitech.wikimedia.org/wiki/Dumps/Snapshot_hosts ==Snapshot (XML dumps generation) cluster information== Snapshot (XML dumps generation) cluster informationhttps://wikitech.wikimedia.org/wiki/Dumps/Snapshot_hosts#Snapshot_(XML_dumps_generation)_cluster_information Hardwarehttps://wikitech.wikimedia.org/wiki/Dumps/Snapshot_hosts#Hardware Current setuphttps://wikitech.wikimedia.org/wiki/Dumps/Snapshot_hosts#Current_setup Worker nodes:https://wikitech.wikimedia.org/wiki/Dumps/Snapshot_hosts#Worker_nodes: Other taskshttps://wikitech.wikimedia.org/wiki/Dumps/Snapshot_hosts#Other_tasks https://wikitech.wikimedia.org/wiki/Dumps/Dump_servers ==XML Dump servers== XML Dump servershttps://wikitech.wikimedia.org/wiki/Dumps/Dump_servers#XML_Dump_servers Hardwarehttps://wikitech.wikimedia.org/wiki/Dumps/Dump_servers#Hardware Serviceshttps://wikitech.wikimedia.org/wiki/Dumps/Dump_servers#Services Deploying a new hosthttps://wikitech.wikimedia.org/wiki/Dumps/Dump_servers#Deploying_a_new_host Space issueshttps://wikitech.wikimedia.org/wiki/Dumps/Dump_servers#Space_issues Maintenance/downtimehttps://wikitech.wikimedia.org/wiki/Dumps/Dump_servers#Maintenance/downtime https://wikitech.wikimedia.org/wiki/Dumps/Software_dependencies ==Software dependencies for running the dumps== Software dependencies for running the dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Software_dependencies#Software_dependencies_for_running_the_dumps https://wikitech.wikimedia.org/wiki/Dumps/Mirror_status === Current mirrors === Current mirrorshttps://wikitech.wikimedia.org/wiki/Dumps/Mirror_status#Current_mirrors Adding a mirrorhttps://wikitech.wikimedia.org/wiki/Dumps/Mirror_status#Adding_a_mirror In progress mirrorshttps://wikitech.wikimedia.org/wiki/Dumps/Mirror_status#In_progress_mirrors https://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job == Fixing a broken dump == Fixing a broken dumphttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Fixing_a_broken_dump Rerunning dumps on all wikishttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Rerunning_dumps_on_all_wikis Rerunning a complete dumphttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Rerunning_a_complete_dump Rerunning one piece of a dumphttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Rerunning_one_piece_of_a_dump Rerunning an interrupted en wikipedia history dumphttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Rerunning_an_interrupted_en_wikipedia_history_dump Rerunning a dump from a given step onwardshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Rerunning_a_dump_from_a_given_step_onwards Rerunning a step without using the python scriptshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Rerunning_a_step_without_using_the_python_scripts Exampleshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Examples Generating new dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Generating_new_dumps Text revision fileshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Text_revision_files Stub files as prequisitehttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Stub_files_as_prequisite Prefetch from previous dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Prefetch_from_previous_dumps Using a different prefetch file for revision textshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Using_a_different_prefetch_file_for_revision_texts Skipping prefetch for revision textshttps://wikitech.wikimedia.org/wiki/Dumps/Rerunning_a_job#Skipping_prefetch_for_revision_texts https://wikitech.wikimedia.org/wiki/Dumps/Phases_of_a_dump_run Each dump of a wiki runs in several phases (jobs). If you look at any completed wiki run from the main index page (http://dumps. Backup jobs overviewhttps://wikitech.wikimedia.org/wiki/Dumps/Phases_of_a_dump_run#Backup_jobs_overview Detailshttps://wikitech.wikimedia.org/wiki/Dumps/Phases_of_a_dump_run#Details https://wikitech.wikimedia.org/wiki/Dumps/History (Please fill in interesting tidbits here.) Noteshttps://wikitech.wikimedia.org/wiki/Dumps/History#Notes https://wikitech.wikimedia.org/wiki/Swift/How_To Category:Swift General Prephttps://wikitech.wikimedia.org/wiki/Swift/How_To#General_Prep Set up an entire swift clusterhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Set_up_an_entire_swift_cluster Individual Commands - interacting with Swifthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Individual_Commands_-_interacting_with_Swift Impersonating a specific swift accounthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Impersonating_a_specific_swift_account Create a new swift account (Thanos Cluster)https://wikitech.wikimedia.org/wiki/Swift/How_To#Create_a_new_swift_account_(Thanos_Cluster) Create a containerhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Create_a_container List containers and contentshttps://wikitech.wikimedia.org/wiki/Swift/How_To#List_containers_and_contents list of all containershttps://wikitech.wikimedia.org/wiki/Swift/How_To#list_of_all_containers list the contents of one containerhttps://wikitech.wikimedia.org/wiki/Swift/How_To#list_the_contents_of_one_container list specific objects within a containerhttps://wikitech.wikimedia.org/wiki/Swift/How_To#list_specific_objects_within_a_container Find an object in swifthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Find_an_object_in_swift Find a deleted object in swifthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Find_a_deleted_object_in_swift Find an object in the backups databasehttps://wikitech.wikimedia.org/wiki/Swift/How_To#Find_an_object_in_the_backups_database Show specific info about a container or objecthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Show_specific_info_about_a_container_or_object Delete a container or objecthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Delete_a_container_or_object Fine-grained object deletions with Swiftlyhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Fine-grained_object_deletions_with_Swiftly Example read-only command with Swiftly fordohttps://wikitech.wikimedia.org/wiki/Swift/How_To#Example_read-only_command_with_Swiftly_fordo Example deletion command with Swiftly fordohttps://wikitech.wikimedia.org/wiki/Swift/How_To#Example_deletion_command_with_Swiftly_fordo Example .swiftly.confhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Example_.swiftly.conf Setup temp url key on an accounthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Setup_temp_url_key_on_an_account Checking / Fixing container ACLs for private wikishttps://wikitech.wikimedia.org/wiki/Swift/How_To#Checking_/_Fixing_container_ACLs_for_private_wikis Individual Commands - Managing Swifthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Individual_Commands_-_Managing_Swift Show current swift ring layouthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Show_current_swift_ring_layout Managing the Ringshttps://wikitech.wikimedia.org/wiki/Swift/How_To#Managing_the_Rings Add a proxy node to the clusterhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Add_a_proxy_node_to_the_cluster Reimage/provision the ring manager proxy hosthttps://wikitech.wikimedia.org/wiki/Swift/How_To#Reimage/provision_the_ring_manager_proxy_host Remove a failed proxy node from the clusterhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Remove_a_failed_proxy_node_from_the_cluster Add a storage node to the clusterhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Add_a_storage_node_to_the_cluster Removing a storage node from the clusterhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Removing_a_storage_node_from_the_cluster Remove (fail out) a drive from a ringhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Remove_(fail_out)_a_drive_from_a_ring Replacing a disk without touching the ringshttps://wikitech.wikimedia.org/wiki/Swift/How_To#Replacing_a_disk_without_touching_the_rings Cleanup fully used root filesystemhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Cleanup_fully_used_root_filesystem Rollover a Swift keyhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Rollover_a_Swift_key Rebooting backends / Puppet is failing on a recently-booted backendhttps://wikitech.wikimedia.org/wiki/Swift/How_To#Rebooting_backends_/_Puppet_is_failing_on_a_recently-booted_backend Rolling restart of swift frontendshttps://wikitech.wikimedia.org/wiki/Swift/How_To#Rolling_restart_of_swift_frontends Update internal TLS certificateshttps://wikitech.wikimedia.org/wiki/Swift/How_To#Update_internal_TLS_certificates Handle alertshttps://wikitech.wikimedia.org/wiki/Swift/How_To#Handle_alerts Rise in 5xx responses reported from ATShttps://wikitech.wikimedia.org/wiki/Swift/How_To#Rise_in_5xx_responses_reported_from_ATS mediawiki originals uploadshttps://wikitech.wikimedia.org/wiki/Swift/How_To#mediawiki_originals_uploads https://wikitech.wikimedia.org/wiki/Incidents/20120120-Varnish ==Problem== Problemhttps://wikitech.wikimedia.org/wiki/Incidents/20120120-Varnish#Problem Backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/20120120-Varnish#Background Root Causehttps://wikitech.wikimedia.org/wiki/Incidents/20120120-Varnish#Root_Cause Fixhttps://wikitech.wikimedia.org/wiki/Incidents/20120120-Varnish#Fix Recommendationhttps://wikitech.wikimedia.org/wiki/Incidents/20120120-Varnish#Recommendation https://wikitech.wikimedia.org/wiki/Dumps/Testing_historical This test suite was last updated in 2013 for Mediawiki 1.17. Access to sourcehttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Access_to_source Basic usage of the test suitehttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Basic_usage_of_the_test_suite MediaWiki brancheshttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#MediaWiki_branches Big picturehttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Big_picture Detailed overviewhttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Detailed_overview Failure simulationhttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Failure_simulation MySQLhttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#MySQL Nfshttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Nfs Local cluster managementhttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Local_cluster_management Local clusters and failure simulationhttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Local_clusters_and_failure_simulation Decisionshttps://wikitech.wikimedia.org/wiki/Dumps/Testing_historical#Decisions https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100 == Model(s) == Model(s)https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Model(s) Dell PowerEdge C2100https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Dell_PowerEdge_C2100 Lights Out Managementhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Lights_Out_Management Common actions (easy way)https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Common_actions_(easy_way) Common actions (raw way)https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Common_actions_(raw_way) Initial Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Initial_Setup BIOS Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#BIOS_Setup Changing Management Passwordhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/PowerEdge_C2100#Changing_Management_Password https://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics Category:Swift Trending graphshttps://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics#Trending_graphs Monitoringhttps://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics#Monitoring Log lineshttps://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics#Log_lines proxy exampleshttps://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics#proxy_examples full format description for proxy logshttps://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics#full_format_description_for_proxy_logs Additional monitoring we needhttps://wikitech.wikimedia.org/wiki/Swift/Logging_and_Metrics#Additional_monitoring_we_need https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics Category:Swift Tests pre-deployhttps://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#Tests_pre-deploy test 1 (reads, 5 nodes)https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#test_1_(reads,_5_nodes) test 2 (mixed, 5 nodes)https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#test_2_(mixed,_5_nodes) test 3 (writes, 5 nodes)https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#test_3_(writes,_5_nodes) test 4https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#test_4 test 5https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#test_5 test 6https://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#test_6 Tests post-deployhttps://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#Tests_post-deploy production load + read performance testhttps://wikitech.wikimedia.org/wiki/Swift/Performance_Metrics#production_load_+_read_performance_test https://wikitech.wikimedia.org/wiki/Swift Overview of Swift, as implemented in Wikimedia production. Quick Noteshttps://wikitech.wikimedia.org/wiki/Swift#Quick_Notes What is Swifthttps://wikitech.wikimedia.org/wiki/Swift#What_is_Swift Other documentationhttps://wikitech.wikimedia.org/wiki/Swift#Other_documentation External linkshttps://wikitech.wikimedia.org/wiki/Swift#External_links https://wikitech.wikimedia.org/wiki/Incidents/20120206-Squid == Outage Summary == Outage Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20120206-Squid#Outage_Summary Detailhttps://wikitech.wikimedia.org/wiki/Incidents/20120206-Squid#Detail For next timehttps://wikitech.wikimedia.org/wiki/Incidents/20120206-Squid#For_next_time https://wikitech.wikimedia.org/wiki/Eqiad_data_center eqiad (pronounced eh-key-add, or the Ashburn DC) is located at the [data center in Ashburn, Virginia, United States]. Networkhttps://wikitech.wikimedia.org/wiki/Eqiad_data_center#Network Media galleryhttps://wikitech.wikimedia.org/wiki/Eqiad_data_center#Media_gallery See alsohttps://wikitech.wikimedia.org/wiki/Eqiad_data_center#See_also https://wikitech.wikimedia.org/wiki/Linne Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Dobson Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Ersch ersch was a Wikimedia PoolCounter server (role::poolcounter). Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Loudon Category:Fundraising Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Spence == Former services == Former serviceshttps://wikitech.wikimedia.org/wiki/Spence#Former_services https://wikitech.wikimedia.org/wiki/Stafford Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Streber Used to run RT in the past which has now moved to magnesium. Still runs observium. Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Tarin Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Williams Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/SearchShards = what = whathttps://wikitech.wikimedia.org/wiki/SearchShards#what finest quality script to gather index distribution datahttps://wikitech.wikimedia.org/wiki/SearchShards#finest_quality_script_to_gather_index_distribution_data https://wikitech.wikimedia.org/wiki/Swift/Server_layout Category:Swift Swift Server Hardware, Partitioning, and OS informationhttps://wikitech.wikimedia.org/wiki/Swift/Server_layout#Swift_Server_Hardware,_Partitioning,_and_OS_information ms-fehttps://wikitech.wikimedia.org/wiki/Swift/Server_layout#ms-fe ms-behttps://wikitech.wikimedia.org/wiki/Swift/Server_layout#ms-be https://wikitech.wikimedia.org/wiki/Storage3 storage3 is a fundraisingdb cluster slave of db1008. Pmtpa data centerhttps://wikitech.wikimedia.org/wiki/Category:Pmtpa_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Silicon Silicon is a payments cluster host at eqiad. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Server usage:Paymentshttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Payments Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Manganese manganese was the gerrit host till 2013-09-05, then [by ytterbium], Renamed to [[Dickson in 2013 ([Change]) Serviceshttps://wikitech.wikimedia.org/wiki/Manganese#Services https://wikitech.wikimedia.org/wiki/Deployments/Archive/2012 == January == Januaryhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#January Februaryhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#February Marchhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#March Aprilhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#April Mayhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#May Junehttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#June Julyhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#July Augusthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#August Septemberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#September Octoberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#October Novemberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#November Dechttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2012#Dec https://wikitech.wikimedia.org/wiki/Dumps/Other_information_sources This is a partial list of various pages about the xml/sql dumps. It would be nice to gather all the information in a couple of places, and it would be easier to keep it up to date. Dumpshttps://wikitech.wikimedia.org/wiki/Category:Dumps https://wikitech.wikimedia.org/wiki/SMS/USSD == SMS and USSD support for Wikipedia == SMS and USSD support for Wikipediahttps://wikitech.wikimedia.org/wiki/SMS/USSD#SMS_and_USSD_support_for_Wikipedia Backgroundhttps://wikitech.wikimedia.org/wiki/SMS/USSD#Background Monitoringhttps://wikitech.wikimedia.org/wiki/SMS/USSD#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SMS/USSD#Troubleshooting Possible problems (or known issues) arehttps://wikitech.wikimedia.org/wiki/SMS/USSD#Possible_problems_(or_known_issues)_are Problem connecting to Redishttps://wikitech.wikimedia.org/wiki/SMS/USSD#Problem_connecting_to_Redis Bad message crashes transport:https://wikitech.wikimedia.org/wiki/SMS/USSD#Bad_message_crashes_transport: Problem connecting to SMPPhttps://wikitech.wikimedia.org/wiki/SMS/USSD#Problem_connecting_to_SMPP Vumi recovery process management:https://wikitech.wikimedia.org/wiki/SMS/USSD#Vumi_recovery_process_management: Escalation (Application) Contact:https://wikitech.wikimedia.org/wiki/SMS/USSD#Escalation_(Application)_Contact: Future Planshttps://wikitech.wikimedia.org/wiki/SMS/USSD#Future_Plans https://wikitech.wikimedia.org/wiki/Fundraising_Auditing Periodically, it's important to audit the contribution records in CiviCRM against the various payment processors that we use. This is necessary for data sanity as well as the obvious general good practice for financial records and for accurate data reporting for various groups in and externally to the Foundation (eg Finance, Global Development, chapters, etc. The moduleshttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#The_modules contribution_audithttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#contribution_audit Drush scripthttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#Drush_script log_audithttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#log_audit (Payflow pro) paypal_audithttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#(Payflow_pro)_paypal_audit globalcollect_audithttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#globalcollect_audit Performing the audithttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#Performing_the_audit PayflowPro and PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#PayflowPro_and_PayPal Globalcollecthttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#Globalcollect Global Development reportinghttps://wikitech.wikimedia.org/wiki/Fundraising_Auditing#Global_Development_reporting https://wikitech.wikimedia.org/wiki/Offsite_Backups Planning notes for offsite backups. This is a draft, edit heavily please. Overviewhttps://wikitech.wikimedia.org/wiki/Offsite_Backups#Overview Requirementshttps://wikitech.wikimedia.org/wiki/Offsite_Backups#Requirements Noteshttps://wikitech.wikimedia.org/wiki/Offsite_Backups#Notes https://wikitech.wikimedia.org/wiki/Mwlib === Notes === Noteshttps://wikitech.wikimedia.org/wiki/Mwlib#Notes Notes on building mwlib 'offline collection generator' hosts . . .https://wikitech.wikimedia.org/wiki/Mwlib#Notes_on_building_mwlib_'offline_collection_generator'_hosts_._._. Labs pediapress projecthttps://wikitech.wikimedia.org/wiki/Mwlib#Labs_pediapress_project To Be Determinedhttps://wikitech.wikimedia.org/wiki/Mwlib#To_Be_Determined Build processhttps://wikitech.wikimedia.org/wiki/Mwlib#Build_process puppet does this alreadyhttps://wikitech.wikimedia.org/wiki/Mwlib#puppet_does_this_already this part needs puppetificationhttps://wikitech.wikimedia.org/wiki/Mwlib#this_part_needs_puppetification Packages to Buildhttps://wikitech.wikimedia.org/wiki/Mwlib#Packages_to_Build Stock Packages That Should Workhttps://wikitech.wikimedia.org/wiki/Mwlib#Stock_Packages_That_Should_Work New Packages That Build Easilyhttps://wikitech.wikimedia.org/wiki/Mwlib#New_Packages_That_Build_Easily New Packages That Require Significant Refactoring Before Buildhttps://wikitech.wikimedia.org/wiki/Mwlib#New_Packages_That_Require_Significant_Refactoring_Before_Build https://wikitech.wikimedia.org/wiki/Proxy_access_to_cluster This page document how to access web services on private hosts. Tunnelhttps://wikitech.wikimedia.org/wiki/Proxy_access_to_cluster#Tunnel FoxyProxyhttps://wikitech.wikimedia.org/wiki/Proxy_access_to_cluster#FoxyProxy See alsohttps://wikitech.wikimedia.org/wiki/Proxy_access_to_cluster#See_also https://wikitech.wikimedia.org/wiki/Fundraising/tech This page is an overview of Fundraising Tech projects. To find the most recent documentation visit the [tech page] on [Components == Componentshttps://wikitech.wikimedia.org/wiki/Fundraising/tech#Components Fundraising Deploymentshttps://wikitech.wikimedia.org/wiki/Fundraising/tech#Fundraising_Deployments Installing Softwarehttps://wikitech.wikimedia.org/wiki/Fundraising/tech#Installing_Software See alsohttps://wikitech.wikimedia.org/wiki/Fundraising/tech#See_also https://wikitech.wikimedia.org/wiki/Fundraising/tech/Installing_Drupal_and_CiviCRM Use the WMF docker install process https://gitlab.com/andyrussg/fundraising-dev Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising https://wikitech.wikimedia.org/wiki/Fundraising/tech/Apache_httpd == Apache httpd == Apache httpdhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Apache_httpd#Apache_httpd https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21 == January 29 == January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#January_1 December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_26 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_9 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_8 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#August_1 July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_4 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_21#July_1 https://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs) This document is incomplete - it is a list of differences from Swift/Setup New Swift Cluster rather than a complete set of instructions. update DNShttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#update_DNS Launch the instanceshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#Launch_the_instances Set up filesystemshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#Set_up_filesystems create the cluster hashhttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#create_the_cluster_hash update puppethttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#update_puppet build the ringshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#build_the_rings distribute the ringshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#distribute_the_rings reboothttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#reboot set up auth tokens for the clusterhttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#set_up_auth_tokens_for_the_cluster tell puppet about the auth tokenshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#tell_puppet_about_the_auth_tokens update the proxies and restart the proxy servicehttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#update_the_proxies_and_restart_the_proxy_service make the containers necessary for thumbnailshttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#make_the_containers_necessary_for_thumbnails make the containers readable by anonymous usershttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#make_the_containers_readable_by_anonymous_users test the clusterhttps://wikitech.wikimedia.org/wiki/Swift/Setup_New_Swift_Cluster_(labs)#test_the_cluster https://wikitech.wikimedia.org/wiki/Swift/Deploy_Schedule_-_Originals This page details the steps necessary to get originals running in swift, with more detail around the actual cutover process. Overall Planhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Schedule_-_Originals#Overall_Plan Mediawiki Writes Thumbnailshttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Schedule_-_Originals#Mediawiki_Writes_Thumbnails https://wikitech.wikimedia.org/wiki/ES ES may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Jenkins Jenkins is a software system originating from the Java community. Jenkins offers a highly modular system which has allowed other communities to add their own plugins (such as Git, PHP, …). Administrationhttps://wikitech.wikimedia.org/wiki/Jenkins#Administration Upgradinghttps://wikitech.wikimedia.org/wiki/Jenkins#Upgrading Get the packagehttps://wikitech.wikimedia.org/wiki/Jenkins#Get_the_package Precheckhttps://wikitech.wikimedia.org/wiki/Jenkins#Precheck Deployinghttps://wikitech.wikimedia.org/wiki/Jenkins#Deploying Security updateshttps://wikitech.wikimedia.org/wiki/Jenkins#Security_updates Jenkins security updatehttps://wikitech.wikimedia.org/wiki/Jenkins#Jenkins_security_update Pluginshttps://wikitech.wikimedia.org/wiki/Jenkins#Plugins Plugins security updatehttps://wikitech.wikimedia.org/wiki/Jenkins#Plugins_security_update CI Jenkinshttps://wikitech.wikimedia.org/wiki/Jenkins#CI_Jenkins Releases Jenkinshttps://wikitech.wikimedia.org/wiki/Jenkins#Releases_Jenkins Patch a pluginhttps://wikitech.wikimedia.org/wiki/Jenkins#Patch_a_plugin Gearman pluginhttps://wikitech.wikimedia.org/wiki/Jenkins#Gearman_plugin gearman-java libraryhttps://wikitech.wikimedia.org/wiki/Jenkins#gearman-java_library Jenkins pluginhttps://wikitech.wikimedia.org/wiki/Jenkins#Jenkins_plugin How tohttps://wikitech.wikimedia.org/wiki/Jenkins#How_to Restart Jenkinshttps://wikitech.wikimedia.org/wiki/Jenkins#Restart_Jenkins Logshttps://wikitech.wikimedia.org/wiki/Jenkins#Logs Disable pluginhttps://wikitech.wikimedia.org/wiki/Jenkins#Disable_plugin Java thread dumphttps://wikitech.wikimedia.org/wiki/Jenkins#Java_thread_dump Java infohttps://wikitech.wikimedia.org/wiki/Jenkins#Java_info See alsohttps://wikitech.wikimedia.org/wiki/Jenkins#See_also https://wikitech.wikimedia.org/wiki/Sodium sodium. Serviceshttps://wikitech.wikimedia.org/wiki/Sodium#Services https://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions Most files stored in Swift will be for a FileRepo class. There are things like Math, DPL, EasyTimeline, and such that may directly store files without using FileRepo. Mapping FileRepo virtual URLS to storage pathshttps://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions#Mapping_FileRepo_virtual_URLS_to_storage_paths Mapping FileRepo storage paths to Swift URLshttps://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions#Mapping_FileRepo_storage_paths_to_Swift_URLs Non-sharded reposhttps://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions#Non-sharded_repos Sharded reposhttps://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions#Sharded_repos Mapping FileRepo storage paths to old NFS pathshttps://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions#Mapping_FileRepo_storage_paths_to_old_NFS_paths Mapping upload URLs to swift URLshttps://wikitech.wikimedia.org/wiki/Swift/Swift_Container_Name_Conventions#Mapping_upload_URLs_to_swift_URLs https://wikitech.wikimedia.org/wiki/Fundraising/tech/git == Fundraising and Git == Fundraising and Githttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Fundraising_and_Git Working with Githttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Working_with_Git Checking out brancheshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Checking_out_branches Check your status to see what you need to commithttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Check_your_status_to_see_what_you_need_to_commit Preparing your commithttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Preparing_your_commit Commit your codehttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Commit_your_code Rebase your branchhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/git#Rebase_your_branch https://wikitech.wikimedia.org/wiki/Fundraising/tech/deployments == Deployments == Deploymentshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/deployments#Deployments Stagedhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/deployments#Staged Releasedhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/deployments#Released https://wikitech.wikimedia.org/wiki/Wikitech You are probably reading Wikitech right now. Whathttps://wikitech.wikimedia.org/wiki/Wikitech#What Test versionhttps://wikitech.wikimedia.org/wiki/Wikitech#Test_version Historyhttps://wikitech.wikimedia.org/wiki/Wikitech#History https://wikitech.wikimedia.org/wiki/Incidents/20120430-MWCoreVersions == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20120430-MWCoreVersions#Summary Detailshttps://wikitech.wikimedia.org/wiki/Incidents/20120430-MWCoreVersions#Details Things to work onhttps://wikitech.wikimedia.org/wiki/Incidents/20120430-MWCoreVersions#Things_to_work_on https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Shard_Smaller_Wikis Category:Swift Swifthttps://wikitech.wikimedia.org/wiki/Category:Swift https://wikitech.wikimedia.org/wiki/Noc.wikimedia.org noc.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Noc.wikimedia.org#Service Historyhttps://wikitech.wikimedia.org/wiki/Noc.wikimedia.org#History See alsohttps://wikitech.wikimedia.org/wiki/Noc.wikimedia.org#See_also External linkshttps://wikitech.wikimedia.org/wiki/Noc.wikimedia.org#External_links https://wikitech.wikimedia.org/wiki/Planet/pl ERROR:planet:Error 500 while updating feed https://wikitech.wikimedia.org/wiki/Fundraising/tech/Spikes == Spikes == Spikeshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Spikes#Spikes 2012https://wikitech.wikimedia.org/wiki/Fundraising/tech/Spikes#2012 Spikes are in progresshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Spikes#Spikes_are_in_progress https://wikitech.wikimedia.org/wiki/NetApp NetApp was a [solution we used for awhile in 2012 or so. We briefly tried using it for media storage prior to using [[Swift]. Service Processorhttps://wikitech.wikimedia.org/wiki/NetApp#Service_Processor https://wikitech.wikimedia.org/wiki/Trebuchet Trebuchet was a saltstack based deployment system that has been replaced by Scap3 as of September 2017. https://wikitech.wikimedia.org/wiki/Incidents/20120607-LastModifiedExtension == Outage Summary == Outage Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20120607-LastModifiedExtension#Outage_Summary Detailhttps://wikitech.wikimedia.org/wiki/Incidents/20120607-LastModifiedExtension#Detail https://wikitech.wikimedia.org/wiki/Dumps/How_to_deploy ssh to the deployment host. Dumpshttps://wikitech.wikimedia.org/wiki/Category:Dumps https://wikitech.wikimedia.org/wiki/Ubuntu.wikimedia.org ubuntu.wikimedia. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/Librsvg As of June 2012, Wikimedia uses librsvg to convert SVGs to PNGs for inline viewing. It is currently using "rsvg version 2. https://wikitech.wikimedia.org/wiki/Fluorine fluorine is a Dell/PowerEdge R310 and in eqiad in row A-A4. It has been installed per RT:2350 to become a deployment host. Serviceshttps://wikitech.wikimedia.org/wiki/Fluorine#Services Deprecationhttps://wikitech.wikimedia.org/wiki/Fluorine#Deprecation https://wikitech.wikimedia.org/wiki/Graphite Graphite is a real-time time series data store and graph renderer. Front-endshttps://wikitech.wikimedia.org/wiki/Graphite#Front-ends Grafanahttps://wikitech.wikimedia.org/wiki/Graphite#Grafana graphite.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Graphite#graphite.wikimedia.org Service operationhttps://wikitech.wikimedia.org/wiki/Graphite#Service_operation TCPhttps://wikitech.wikimedia.org/wiki/Graphite#TCP Metric creationhttps://wikitech.wikimedia.org/wiki/Graphite#Metric_creation Terminologyhttps://wikitech.wikimedia.org/wiki/Graphite#Terminology Data sourceshttps://wikitech.wikimedia.org/wiki/Graphite#Data_sources statsdhttps://wikitech.wikimedia.org/wiki/Graphite#statsd EventLogginghttps://wikitech.wikimedia.org/wiki/Graphite#EventLogging statsvhttps://wikitech.wikimedia.org/wiki/Graphite#statsv MediaWikihttps://wikitech.wikimedia.org/wiki/Graphite#MediaWiki Extended propertieshttps://wikitech.wikimedia.org/wiki/Graphite#Extended_properties Countershttps://wikitech.wikimedia.org/wiki/Graphite#Counters Timershttps://wikitech.wikimedia.org/wiki/Graphite#Timers Functionshttps://wikitech.wikimedia.org/wiki/Graphite#Functions summarizehttps://wikitech.wikimedia.org/wiki/Graphite#summarize aliasByNodehttps://wikitech.wikimedia.org/wiki/Graphite#aliasByNode Architecturehttps://wikitech.wikimedia.org/wiki/Graphite#Architecture statsd ingestionhttps://wikitech.wikimedia.org/wiki/Graphite#statsd_ingestion carbon ingestionhttps://wikitech.wikimedia.org/wiki/Graphite#carbon_ingestion HTTP read-only APIhttps://wikitech.wikimedia.org/wiki/Graphite#HTTP_read-only_API FAQhttps://wikitech.wikimedia.org/wiki/Graphite#FAQ How do I render a counter metric as running total?https://wikitech.wikimedia.org/wiki/Graphite#How_do_I_render_a_counter_metric_as_running_total? Why is the data so different when zooming out or moving a week back?https://wikitech.wikimedia.org/wiki/Graphite#Why_is_the_data_so_different_when_zooming_out_or_moving_a_week_back? Operations manualhttps://wikitech.wikimedia.org/wiki/Graphite#Operations_manual Failoverhttps://wikitech.wikimedia.org/wiki/Graphite#Failover Monitor graphite querieshttps://wikitech.wikimedia.org/wiki/Graphite#Monitor_graphite_queries Deleting metricshttps://wikitech.wikimedia.org/wiki/Graphite#Deleting_metrics rsync metricshttps://wikitech.wikimedia.org/wiki/Graphite#rsync_metrics Merge and sync metricshttps://wikitech.wikimedia.org/wiki/Graphite#Merge_and_sync_metrics List slow querieshttps://wikitech.wikimedia.org/wiki/Graphite#List_slow_queries List metrics being createdhttps://wikitech.wikimedia.org/wiki/Graphite#List_metrics_being_created Operations troubleshootinghttps://wikitech.wikimedia.org/wiki/Graphite#Operations_troubleshooting carbon-cache too many createshttps://wikitech.wikimedia.org/wiki/Graphite#carbon-cache_too_many_creates Applying carbon storage_aggregation changeshttps://wikitech.wikimedia.org/wiki/Graphite#Applying_carbon_storage_aggregation_changes Identifying heavy and/or expensive querieshttps://wikitech.wikimedia.org/wiki/Graphite#Identifying_heavy_and/or_expensive_queries Further readinghttps://wikitech.wikimedia.org/wiki/Graphite#Further_reading External linkshttps://wikitech.wikimedia.org/wiki/Graphite#External_links Referenceshttps://wikitech.wikimedia.org/wiki/Graphite#References See alsohttps://wikitech.wikimedia.org/wiki/Graphite#See_also https://wikitech.wikimedia.org/wiki/Gdash.wikimedia.org gdash.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Gdash.wikimedia.org#Service See alsohttps://wikitech.wikimedia.org/wiki/Gdash.wikimedia.org#See_also External linkhttps://wikitech.wikimedia.org/wiki/Gdash.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Professor professor ran Graphite and related services. Former serviceshttps://wikitech.wikimedia.org/wiki/Professor#Former_services Decommissionedhttps://wikitech.wikimedia.org/wiki/Professor#Decommissioned https://wikitech.wikimedia.org/wiki/Incidents/20120620-srv268Load == Site Incident Summary == Site Incident Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20120620-srv268Load#Site_Incident_Summary Detailhttps://wikitech.wikimedia.org/wiki/Incidents/20120620-srv268Load#Detail https://wikitech.wikimedia.org/wiki/External_storage/Evaluating_innodb ==Notes from Asher (2012)== Notes from Asher (2012)https://wikitech.wikimedia.org/wiki/External_storage/Evaluating_innodb#Notes_from_Asher_(2012) https://wikitech.wikimedia.org/wiki/Swift/Other_Processes == Current == Currenthttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#Current Ganglia Logtailerhttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#Ganglia_Logtailer swift-ganglia-report-global-statshttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#swift-ganglia-report-global-stats Oldhttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#Old purgethumbs.pyhttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#purgethumbs.py delete-containerless-objectshttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#delete-containerless-objects Swift Cleanerhttps://wikitech.wikimedia.org/wiki/Swift/Other_Processes#Swift_Cleaner https://wikitech.wikimedia.org/wiki/Wlm.wikimedia.org wlm.wikimedia. Puppethttps://wikitech.wikimedia.org/wiki/Wlm.wikimedia.org#Puppet Sourceshttps://wikitech.wikimedia.org/wiki/Wlm.wikimedia.org#Sources MySQLhttps://wikitech.wikimedia.org/wiki/Wlm.wikimedia.org#MySQL https://wikitech.wikimedia.org/wiki/Incidents/20120806-Fibercut == Outage Summary == Outage Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20120806-Fibercut#Outage_Summary Detailhttps://wikitech.wikimedia.org/wiki/Incidents/20120806-Fibercut#Detail https://wikitech.wikimedia.org/wiki/Zirconium zirconium runs miscellaneous services and previously run on singer/kaulen.. Serviceshttps://wikitech.wikimedia.org/wiki/Zirconium#Services https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging EventLogging (EL for short) is a platform for modelling, logging, and processing arbitrary analytic data. It consists of: For usershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#For_users Schemashttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Schemas Creating a schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Creating_a_schema Send eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Send_events Client-side eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Client-side_events Accessing datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Accessing_data Privacyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Privacy Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Access Hadoop & Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Hadoop_&_Hive Notes on data in Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Notes_on_data_in_Hive Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Hive Errors for schemashttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Errors_for_schemas Sparkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Spark Spark 2 Scala SQL & Hive:https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Spark_2_Scala_SQL_&_Hive: Spark 2 Python SQL & Hive:https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Spark_2_Python_SQL_&_Hive: Spark 2 R SQL & Hive:https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Spark_2_R_SQL_&_Hive: Hadoop. Archived Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Hadoop._Archived_Data Hadoop Raw Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Hadoop_Raw_Data Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Kafka Publishing datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Publishing_data Verify received eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Verify_received_events User agent sanitizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#User_agent_sanitization Data retention and purginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Data_retention_and_purging Retiring a schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Retiring_a_schema Operational supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Operational_support Tier 2 supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Tier_2_support Outageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Outages Alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Alarms Contacthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Contact For developershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#For_developers Codebasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Codebase Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Architecture Performancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Performance Size limitationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Size_limitation Monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Monitoring Testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Testing How do I ...?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#How_do_I_...? Administration. On callhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Administration._On_call Data Quality Issueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Data_Quality_Issues Changes and Known Problems with Datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Changes_and_Known_Problems_with_Dataset Incidentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Incidents Limits of the eventlogging replication scripthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Limits_of_the_eventlogging_replication_script Ad blockershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Ad_blockers See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#See_also Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging#Notes https://wikitech.wikimedia.org/wiki/Vanadium vanadium was a server in eqiad that was the log collector for EventLogging generated by event.gif requests to the bits Varnish servers. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/VCL Varnish Configuration Language, or VCL, is the domain-specific language used for configuring Varnish's caching and request policy. https://wikitech.wikimedia.org/wiki/Geolocation Geolocation is based on the MaxMind GeoIP2 database paid for by the WMF, and is used in two ways: Historyhttps://wikitech.wikimedia.org/wiki/Geolocation#History Unknown countryhttps://wikitech.wikimedia.org/wiki/Geolocation#Unknown_country https://wikitech.wikimedia.org/wiki/Network_cheat_sheet This document is about working on the Juniper devices used in the Wikimedia Infrastructure. SSH access to network equipmenthttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#SSH_access_to_network_equipment Juniperhttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Juniper How to block an IP addresshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#How_to_block_an_IP_address Operational mode vs Configuration modehttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Operational_mode_vs_Configuration_mode Rollbackshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Rollbacks Show diff between two commitshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Show_diff_between_two_commits Edit ACLs for Network portshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Edit_ACLs_for_Network_ports Change an access switch port's VLANhttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Change_an_access_switch_port's_VLAN Matching hosts with rack numbershttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Matching_hosts_with_rack_numbers Check reboot or downtimehttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Check_reboot_or_downtime Check what host owns a specific IPv6 addresshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Check_what_host_owns_a_specific_IPv6_address Operational mode commandshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Operational_mode_commands Config commandshttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Config_commands MX204 (and similar) upgradehttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#MX204_(and_similar)_upgrade Linuxhttps://wikitech.wikimedia.org/wiki/Network_cheat_sheet#Linux https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5 ==Notes for Swift upgrade from 1.4. Notes for Swift upgrade from 1.4.3 to 1.5https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Notes_for_Swift_upgrade_from_1.4.3_to_1.5 Upgrade stepshttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Upgrade_steps Prep workhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Prep_work Test puppet changeshttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Test_puppet_changes Proxy servershttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Proxy_servers Backend hostshttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Backend_hosts Statsdhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Statsd Confighttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Config statsd -> ganglia bridgehttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#statsd_->_ganglia_bridge Container Synchronizationhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Upgrade_from_1.4.3_to_1.5#Container_Synchronization https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2 ==Last steps for move from ms7 (media server for originals) to swift for reads== Last steps for move from ms7 (media server for originals) to swift for readshttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#Last_steps_for_move_from_ms7_(media_server_for_originals)_to_swift_for_reads Blacklist approachhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#Blacklist_approach Whitelist (or combination) approach:https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#Whitelist_(or_combination)_approach: Prep first:https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#Prep_first: How to test on a single squidhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#How_to_test_on_a_single_squid Tests (and expected resurlts)https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#Tests_(and_expected_resurlts) What happenedhttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_Originals_Part_2#What_happened https://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012 ==Open Issues after upgrade and media originals reads deployment== Open Issues after upgrade and media originals reads deploymenthttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012#Open_Issues_after_upgrade_and_media_originals_reads_deployment Pointershttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012#Pointers https://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7 Here's the todo list of things left on ms7 so we can knock 'em off one at a time. NEED TO BE MOVEDhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#NEED_TO_BE_MOVED docroothttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#docroot ALREADY MOVEDhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#ALREADY_MOVED ext-disthttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#ext-dist ConfirmEdithttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#ConfirmEdit mathhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#math math.tmphttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#math.tmp wikipedia/(langcode)/timelinehttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#wikipedia/(langcode)/timeline jarshttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#jars faviconshttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#favicons privatehttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#private wikipedia/commons/scanhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#wikipedia/commons/scan NEED TO BE FIXEDhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#NEED_TO_BE_FIXED originals??https://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#originals?? broken urlshttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#broken_urls NEED EQUIV ON SWIFThttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#NEED_EQUIV_ON_SWIFT pybaltestfile.txthttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#pybaltestfile.txt 404https://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#404 DON'T NEED ANYMOREhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#DON'T_NEED_ANYMORE lost-image-thumb-backuphttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#lost-image-thumb-backup mime.phphttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#mime.php portalhttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#portal scriptshttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#scripts skinshttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#skins sync-from-homehttps://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#sync-from-home x1https://wikitech.wikimedia.org/wiki/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#x1 https://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes This is a brief guide on how to perform security fixes. From commit draft to minor release. Stepshttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#Steps 1: Commithttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#1:_Commit 2: Apply on deploy hosthttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#2:_Apply_on_deploy_host 3: Deployhttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#3:_Deploy 4: Request CVEhttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#4:_Request_CVE 5: Push to gerrit & make releasehttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#5:_Push_to_gerrit_&_make_release Make releasehttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#Make_release Push to gerrithttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#Push_to_gerrit See alsohttps://wikitech.wikimedia.org/wiki/How_to_perform_security_fixes#See_also https://wikitech.wikimedia.org/wiki/MyISAM MyISAM sucks (at least for full text search). Still, we're using it in some cases it seems. MySQLhttps://wikitech.wikimedia.org/wiki/Category:MySQL https://wikitech.wikimedia.org/wiki/Data_centers These are [center|data centers] used by the Wikimedia Foundation, in which it has colo space where its operates [cluster|server clusters]. Presenthttps://wikitech.wikimedia.org/wiki/Data_centers#Present Pasthttps://wikitech.wikimedia.org/wiki/Data_centers#Past See alsohttps://wikitech.wikimedia.org/wiki/Data_centers#See_also Referenceshttps://wikitech.wikimedia.org/wiki/Data_centers#References https://wikitech.wikimedia.org/wiki/Es1001 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1002 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1003 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1004 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1010 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1005 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1006 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1007 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1008 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Es1009 Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Databasehttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Database Server usage:MySQLhttps://wikitech.wikimedia.org/wiki/Category:Server_usage:MySQL Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Swift/Server_issues_Aug-Sept_2012 We've seen some issues with the ms-be boxes (all C2100s) in tampa. https://wikitech.wikimedia.org/wiki/Fundraising/ContributionTracking ContributionTracking refers to donation metadata saved to a table which currently resides not in the fundraising civicrm database, but in the drupal database for the host drupal instance. The placement of this table in the drupal database is clearly very silly, and as such it needs to be moved elsewhere. Table Columnshttps://wikitech.wikimedia.org/wiki/Fundraising/ContributionTracking#Table_Columns https://wikitech.wikimedia.org/wiki/Incidents/20120916-GeoDataTemplate == Outage Summary == Outage Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20120916-GeoDataTemplate#Outage_Summary Detailhttps://wikitech.wikimedia.org/wiki/Incidents/20120916-GeoDataTemplate#Detail https://wikitech.wikimedia.org/wiki/Zedler zedler was a host at the Toolserver server as the database server for "sql". Old documentationhttps://wikitech.wikimedia.org/wiki/Zedler#Old_documentation See alsohttps://wikitech.wikimedia.org/wiki/Zedler#See_also https://wikitech.wikimedia.org/wiki/Sender_Policy_Framework SPF is a framework for validating outgoing mail, which gives the receiving side useful information for spam filtering. The main goal is to cause spoofed @wikimedia. Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising Mailhttps://wikitech.wikimedia.org/wiki/Category:Mail https://wikitech.wikimedia.org/wiki/Deployments/Archive ==By year== By yearhttps://wikitech.wikimedia.org/wiki/Deployments/Archive#By_year https://wikitech.wikimedia.org/wiki/MobileFrontend/Deployment MobileFrontend rides the regular WMF deployment train. For out-of-band deployments, MobileFrontend has some deployment procedures/considerations beyond the normal WMF deployment procedures. Deployment rubrichttps://wikitech.wikimedia.org/wiki/MobileFrontend/Deployment#Deployment_rubric ResourceLoaderhttps://wikitech.wikimedia.org/wiki/MobileFrontend/Deployment#ResourceLoader Mobile varnish cachehttps://wikitech.wikimedia.org/wiki/MobileFrontend/Deployment#Mobile_varnish_cache Performancehttps://wikitech.wikimedia.org/wiki/MobileFrontend/Deployment#Performance Apache logshttps://wikitech.wikimedia.org/wiki/MobileFrontend/Deployment#Apache_logs https://wikitech.wikimedia.org/wiki/Contint1001 contint1001 runs the continuous integration tools such as Jenkins and Zuul. Aliashttps://wikitech.wikimedia.org/wiki/Contint1001#Alias Serviceshttps://wikitech.wikimedia.org/wiki/Contint1001#Services Mischttps://wikitech.wikimedia.org/wiki/Contint1001#Misc https://wikitech.wikimedia.org/wiki/Contint1001/Upgrade_to_Precise This page is about upgrading the gallium host from Ubuntu Lucid to Ubuntu Precise. Processhttps://wikitech.wikimedia.org/wiki/Contint1001/Upgrade_to_Precise#Process Stuff that need packaginghttps://wikitech.wikimedia.org/wiki/Contint1001/Upgrade_to_Precise#Stuff_that_need_packaging Android SDKhttps://wikitech.wikimedia.org/wiki/Contint1001/Upgrade_to_Precise#Android_SDK PHPUnit upgradehttps://wikitech.wikimedia.org/wiki/Contint1001/Upgrade_to_Precise#PHPUnit_upgrade PHP 5.3.2https://wikitech.wikimedia.org/wiki/Contint1001/Upgrade_to_Precise#PHP_5.3.2 https://wikitech.wikimedia.org/wiki/How_to_run_queries_on_live_data If you need to query the live data (rather than a dump or tools mirror), follow the following steps: Querying a specific serverhttps://wikitech.wikimedia.org/wiki/How_to_run_queries_on_live_data#Querying_a_specific_server https://wikitech.wikimedia.org/wiki/Thumbnail.log thumbnail.log is a log containing information about failures in thumbnails generation. Image handlinghttps://wikitech.wikimedia.org/wiki/Category:Image_handling https://wikitech.wikimedia.org/wiki/Logs Logs of several sorts are generated across the cluster and collected in a single location replicated on some machines. Privileged users can explore most logs through the OpenSearch Dashboards front-end at https://logstash. mwlog1002:/srv/mw-log/https://wikitech.wikimedia.org/wiki/Logs#mwlog1002:/srv/mw-log/ sysloghttps://wikitech.wikimedia.org/wiki/Logs#syslog 5xx errorshttps://wikitech.wikimedia.org/wiki/Logs#5xx_errors mwmaint Maintenance scriptshttps://wikitech.wikimedia.org/wiki/Logs#mwmaint_Maintenance_scripts deploy1002:/var/log/l10updatelog/l10update.loghttps://wikitech.wikimedia.org/wiki/Logs#deploy1002:/var/log/l10updatelog/l10update.log vanadium:/var/log/eventlogging/https://wikitech.wikimedia.org/wiki/Logs#vanadium:/var/log/eventlogging/ Request logshttps://wikitech.wikimedia.org/wiki/Logs#Request_logs centrallog1002:/srv/weblog/webrequesthttps://wikitech.wikimedia.org/wiki/Logs#centrallog1002:/srv/weblog/webrequest Beta clusterhttps://wikitech.wikimedia.org/wiki/Logs#Beta_cluster Mailservershttps://wikitech.wikimedia.org/wiki/Logs#Mailservers Deadhttps://wikitech.wikimedia.org/wiki/Logs#Dead Lucene (search)https://wikitech.wikimedia.org/wiki/Logs#Lucene_(search) fenari:/home/wikipedia/sysloghttps://wikitech.wikimedia.org/wiki/Logs#fenari:/home/wikipedia/syslog fenari:/var/log/https://wikitech.wikimedia.org/wiki/Logs#fenari:/var/log/ External linkshttps://wikitech.wikimedia.org/wiki/Logs#External_links https://wikitech.wikimedia.org/wiki/2011%E2%80%9312_schedule In 2011–2012, the system administrators for Wikimedia did a bunch of work on the rollout of a new data center, EQIAD, in Ashburn in North America. See alsohttps://wikitech.wikimedia.org/wiki/2011%E2%80%9312_schedule#See_also https://wikitech.wikimedia.org/wiki/2012%E2%80%9313_schedule In 2012–2013, the system administrators for Wikimedia did a bunch of work on the rollout of a new data center, EQIAD, in Ashburn in North America. See alsohttps://wikitech.wikimedia.org/wiki/2012%E2%80%9313_schedule#See_also https://wikitech.wikimedia.org/wiki/Swift/Dell_R720XD_setup To set these up for use as backend hosts, you need to do the following extra steps before the PXE boot: https://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_R720xds_in_tampa ===Current status=== Current statushttps://wikitech.wikimedia.org/wiki/Swift/Deploy_Plan_-_R720xds_in_tampa#Current_status https://wikitech.wikimedia.org/wiki/Ulsfo_data_center ulsfo (pronounced U-L-S-F-O, or the San Francisco DC) is located at United Layer's 200 Paul Ave data center in [Francisco, California|San Francisco]. It provides edge caching for West USA and East Asia. Photo galleryhttps://wikitech.wikimedia.org/wiki/Ulsfo_data_center#Photo_gallery See alsohttps://wikitech.wikimedia.org/wiki/Ulsfo_data_center#See_also https://wikitech.wikimedia.org/wiki/Ulsfo_buildout Please link to RT tickets for any/all tasks! Current blockershttps://wikitech.wikimedia.org/wiki/Ulsfo_buildout#Current_blockers Deadlineshttps://wikitech.wikimedia.org/wiki/Ulsfo_buildout#Deadlines What is donehttps://wikitech.wikimedia.org/wiki/Ulsfo_buildout#What_is_done https://wikitech.wikimedia.org/wiki/Incidents/20121211-TranslationNotifications Report written by Niklas Laxström, 2012-12-07. Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20121211-TranslationNotifications#Timeline Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20121211-TranslationNotifications#Analysis Recommendations for immediate actionshttps://wikitech.wikimedia.org/wiki/Incidents/20121211-TranslationNotifications#Recommendations_for_immediate_actions Snapshot of jobs (not all extensions included)https://wikitech.wikimedia.org/wiki/Incidents/20121211-TranslationNotifications#Snapshot_of_jobs_(not_all_extensions_included) How to fixhttps://wikitech.wikimedia.org/wiki/Incidents/20121211-TranslationNotifications#How_to_fix https://wikitech.wikimedia.org/wiki/Parsoid [is a service that converts between wikitext and HTML. The HTML contains additional metadata that allows it to be converted back ("round-tripped") to wikitext. Useshttps://wikitech.wikimedia.org/wiki/Parsoid#Uses Monitoringhttps://wikitech.wikimedia.org/wiki/Parsoid#Monitoring Machine overviewhttps://wikitech.wikimedia.org/wiki/Parsoid#Machine_overview Deploying changeshttps://wikitech.wikimedia.org/wiki/Parsoid#Deploying_changes Deploying Parsoidhttps://wikitech.wikimedia.org/wiki/Parsoid#Deploying_Parsoid Communicate changeshttps://wikitech.wikimedia.org/wiki/Parsoid#Communicate_changes Test the version you hope to deployhttps://wikitech.wikimedia.org/wiki/Parsoid#Test_the_version_you_hope_to_deploy Prepare the vendor patchhttps://wikitech.wikimedia.org/wiki/Parsoid#Prepare_the_vendor_patch Detailshttps://wikitech.wikimedia.org/wiki/Parsoid#Details Verify deployment version on beta after the vendor patch is mergedhttps://wikitech.wikimedia.org/wiki/Parsoid#Verify_deployment_version_on_beta_after_the_vendor_patch_is_merged Be around on IRChttps://wikitech.wikimedia.org/wiki/Parsoid#Be_around_on_IRC Logs to monitorhttps://wikitech.wikimedia.org/wiki/Parsoid#Logs_to_monitor Post-deploy checkshttps://wikitech.wikimedia.org/wiki/Parsoid#Post-deploy_checks Testing a version bumphttps://wikitech.wikimedia.org/wiki/Parsoid#Testing_a_version_bump Testing on parsoidtest1001https://wikitech.wikimedia.org/wiki/Parsoid#Testing_on_parsoidtest1001 Testing LanguageConverterhttps://wikitech.wikimedia.org/wiki/Parsoid#Testing_LanguageConverter Deploying a cherry-picked patchhttps://wikitech.wikimedia.org/wiki/Parsoid#Deploying_a_cherry-picked_patch Making a stable releasehttps://wikitech.wikimedia.org/wiki/Parsoid#Making_a_stable_release Forking for the major releasehttps://wikitech.wikimedia.org/wiki/Parsoid#Forking_for_the_major_release Making the first/another minor releasehttps://wikitech.wikimedia.org/wiki/Parsoid#Making_the_first/another_minor_release Edge case deployment scenarioshttps://wikitech.wikimedia.org/wiki/Parsoid#Edge_case_deployment_scenarios If the train branch has already been cuthttps://wikitech.wikimedia.org/wiki/Parsoid#If_the_train_branch_has_already_been_cut If you accidentally merged into vendor before the branch commit has been mergedhttps://wikitech.wikimedia.org/wiki/Parsoid#If_you_accidentally_merged_into_vendor_before_the_branch_commit_has_been_merged Misc stuffhttps://wikitech.wikimedia.org/wiki/Parsoid#Misc_stuff Data flowhttps://wikitech.wikimedia.org/wiki/Parsoid#Data_flow https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x =Upgrade Checklist= Upgrade Checklisthttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Upgrade_Checklist Update the Vendor branch in SVNhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Update_the_Vendor_branch_in_SVN Gotchashttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Gotchas Merge the Vendor changes into Trunk and Prodhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Merge_the_Vendor_changes_into_Trunk_and_Prod Take the Site Offline (prod only)https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Take_the_Site_Offline_(prod_only) Disable watchdogs and timeouts for MySQLhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Disable_watchdogs_and_timeouts_for_MySQL Kill the slow db query process killer.https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Kill_the_slow_db_query_process_killer. Ensure that CiviCRM is not your Drupal homepagehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Ensure_that_CiviCRM_is_not_your_Drupal_homepage Disable all CiviCRM integration / extension modules (NOT CiviCRM itself)https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Disable_all_CiviCRM_integration_/_extension_modules_(NOT_CiviCRM_itself) Backup your CiviCRM databasehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Backup_your_CiviCRM_database Backup and then delete all previous version code fileshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Backup_and_then_delete_all_previous_version_code_files Unpack the latest package and verify permissionshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Unpack_the_latest_package_and_verify_permissions Run the Upgrade scripthttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Run_the_Upgrade_script Verify and Update Resource URL Settingshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Verify_and_Update_Resource_URL_Settings Enable Componentshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Enable_Components Re-enable compatible CiviCRM integration / extension moduleshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Re-enable_compatible_CiviCRM_integration_/_extension_modules Review and Update Drupal Permissions Settingshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Review_and_Update_Drupal_Permissions_Settings Clear Views' cache (for sites using Views 2 integration)https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Clear_Views'_cache_(for_sites_using_Views_2_integration) Restore CiviCRM as the Drupal homepage if appropriatehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Restore_CiviCRM_as_the_Drupal_homepage_if_appropriate Unkill the slow db query killerhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Unkill_the_slow_db_query_killer Re-enable all the mysql stuff you disabled earlier (and log to avoid Angry Tim)https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Re-enable_all_the_mysql_stuff_you_disabled_earlier_(and_log_to_avoid_Angry_Tim) Put the Site Online (for production site upgrades)https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Put_the_Site_Online_(for_production_site_upgrades) Review background scriptshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Review_background_scripts Noteshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#Notes See Alsohttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.2.x#See_Also https://wikitech.wikimedia.org/wiki/Test2.wikipedia.org test2.wikipedia. Historyhttps://wikitech.wikimedia.org/wiki/Test2.wikipedia.org#History Detailshttps://wikitech.wikimedia.org/wiki/Test2.wikipedia.org#Details See alsohttps://wikitech.wikimedia.org/wiki/Test2.wikipedia.org#See_also External linkhttps://wikitech.wikimedia.org/wiki/Test2.wikipedia.org#External_link https://wikitech.wikimedia.org/wiki/Solr Solr is a Lucene-based search engine. WMF used it for [memory] and [searches], but switched to Elasticsearch. Puppethttps://wikitech.wikimedia.org/wiki/Solr#Puppet Operationshttps://wikitech.wikimedia.org/wiki/Solr#Operations How to poke it with a stickhttps://wikitech.wikimedia.org/wiki/Solr#How_to_poke_it_with_a_stick Upgrading schemahttps://wikitech.wikimedia.org/wiki/Solr#Upgrading_schema Logshttps://wikitech.wikimedia.org/wiki/Solr#Logs GeoDatahttps://wikitech.wikimedia.org/wiki/Solr#GeoData Disabling updateshttps://wikitech.wikimedia.org/wiki/Solr#Disabling_updates Switching masterhttps://wikitech.wikimedia.org/wiki/Solr#Switching_master Packageshttps://wikitech.wikimedia.org/wiki/Solr#Packages Linkshttps://wikitech.wikimedia.org/wiki/Solr#Links https://wikitech.wikimedia.org/wiki/Password_and_2FA_reset This document offers guidance when a Wikimedia user loses access to their account and can't login. Wikimedia account password resethttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Wikimedia_account_password_reset For usershttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#For_users For adminshttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#For_admins Ensure the request is legitimatehttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Ensure_the_request_is_legitimate Technical procedure to followhttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Technical_procedure_to_follow Two-factor authentication removalhttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Two-factor_authentication_removal Wikimedia two factor authentication removalhttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Wikimedia_two_factor_authentication_removal Phabricator two factor authentication removalhttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Phabricator_two_factor_authentication_removal Reset user password in LDAPhttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Reset_user_password_in_LDAP https://wikitech.wikimedia.org/wiki/Generating_CAPTCHAs ==Overview== Overviewhttps://wikitech.wikimedia.org/wiki/Generating_CAPTCHAs#Overview Making new CAPTCHAshttps://wikitech.wikimedia.org/wiki/Generating_CAPTCHAs#Making_new_CAPTCHAs https://wikitech.wikimedia.org/wiki/Debianize_python_package ---- Official wayhttps://wikitech.wikimedia.org/wiki/Debianize_python_package#Official_way Using fpmhttps://wikitech.wikimedia.org/wiki/Debianize_python_package#Using_fpm Using debianize.shhttps://wikitech.wikimedia.org/wiki/Debianize_python_package#Using_debianize.sh https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22 == July 31 == July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_4 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#July_1 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#March_1 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_22#January_29 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archives type=fulltext Archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archives#Archives 2000shttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archives#2000s 2010shttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archives#2010s 2020shttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archives#2020s https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013 == January == Januaryhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#January Februaryhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#February Marchhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#March Aprilhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#April Mayhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#May Junehttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#June Julyhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#July Augusthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#August Septemberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#September Octoberhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#October Week of October 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_October_28th Week of November 4https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_November_4 Week of November 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_November_11 Week of December 2https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_December_2 Week of December 9https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_December_9 Week of December 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_December_16 Week of December 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2013#Week_of_December_30 https://wikitech.wikimedia.org/wiki/Search/2013 === Overview of MediaWiki search === Overview of MediaWiki searchhttps://wikitech.wikimedia.org/wiki/Search/2013#Overview_of_MediaWiki_search Troubleshootinghttps://wikitech.wikimedia.org/wiki/Search/2013#Troubleshooting Notes on Lucenehttps://wikitech.wikimedia.org/wiki/Search/2013#Notes_on_Lucene Socket parametershttps://wikitech.wikimedia.org/wiki/Search/2013#Socket_parameters Search details (PHP)https://wikitech.wikimedia.org/wiki/Search/2013#Search_details_(PHP) Search details (Java)https://wikitech.wikimedia.org/wiki/Search/2013#Search_details_(Java) Installing MediaWiki and lucene-search-2 for debugginghttps://wikitech.wikimedia.org/wiki/Search/2013#Installing_MediaWiki_and_lucene-search-2_for_debugging Referenceshttps://wikitech.wikimedia.org/wiki/Search/2013#References https://wikitech.wikimedia.org/wiki/Caching_overview Caching overview may refer to: Cachinghttps://wikitech.wikimedia.org/wiki/Category:Caching Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages SRE Traffichttps://wikitech.wikimedia.org/wiki/Category:SRE_Traffic https://wikitech.wikimedia.org/wiki/Deployments/Scaptrap This is the temporary page for scaptraps until Gerrit gets tag support. In Masterhttps://wikitech.wikimedia.org/wiki/Deployments/Scaptrap#In_Master Not yet committed in masterhttps://wikitech.wikimedia.org/wiki/Deployments/Scaptrap#Not_yet_committed_in_master https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/E2_Notes == aft == afthttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/E2_Notes#aft kaldari, benny on Echohttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/E2_Notes#kaldari,_benny_on_Echo https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/Mobile_Notes Mobile Dev/Deploy https://wikitech.wikimedia.org/wiki/Deployments/Features_Process The WMF aims to move to a quicker release/deploy cycle with the near-term goal of moving to a weekly deploy cycle (exact details TBD). With that in mind, User:Greg Grossmeier is interviewing all WMF Feature Teams on their current development and deployment process, how it interacts with the bi-weekly deploys, how they use testing/QA in that process, and where any pain points are that might prevent them from moving to a faster cycle. https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/VisualEditor_Notes = Deploying? = Deploying?https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/VisualEditor_Notes#Deploying? Testing?https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/VisualEditor_Notes#Testing? Pain Pointshttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/VisualEditor_Notes#Pain_Points James and Betahttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/VisualEditor_Notes#James_and_Beta https://wikitech.wikimedia.org/wiki/Shell_Request/Clarkcj12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dapete Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zuzak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frdataproxy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frlabsjenkins Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chiefgeek157 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Monkia4025 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mpr312 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/E3_Notes * we have a lot of noisy errors https://wikitech.wikimedia.org/wiki/Shell_Request/Lkhatiwada Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/TODOs * - Ask Timo/Antoine re QUnit tests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Features_Process/General_Feedback == The Good News == The Good Newshttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/General_Feedback#The_Good_News The Bad Newshttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/General_Feedback#The_Bad_News Next Stepshttps://wikitech.wikimedia.org/wiki/Deployments/Features_Process/General_Feedback#Next_Steps https://wikitech.wikimedia.org/wiki/Shell_Request/Wooster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aaronfaloon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kiran2861 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nilsdornblut Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WikiLearnia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rajaraman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hzy980512 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Stat1 Former analytics server. Possibly as successor to bayes? Decommissionedhttps://wikitech.wikimedia.org/wiki/Stat1#Decommissioned https://wikitech.wikimedia.org/wiki/Shell_Request/Cwek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pozorvlak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MaZderMind Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sdickson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Train The Deployment Train is a weekly process led by the [Engineering Team], to deploy the latest alpha version of MediaWiki at WMF to production. Current weekhttps://wikitech.wikimedia.org/wiki/Deployments/Train#Current_week Schedulehttps://wikitech.wikimedia.org/wiki/Deployments/Train#Schedule Groupshttps://wikitech.wikimedia.org/wiki/Deployments/Train#Groups Tuesdayhttps://wikitech.wikimedia.org/wiki/Deployments/Train#Tuesday Wednesdayhttps://wikitech.wikimedia.org/wiki/Deployments/Train#Wednesday Thursdayhttps://wikitech.wikimedia.org/wiki/Deployments/Train#Thursday https://wikitech.wikimedia.org/wiki/Shell_Request/Liamzebedee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Illuminatis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HenriqueCrang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jenkins-deploy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hiong3-eng5 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bmeiggs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines This page is about writing puppet code: how to write it, when to write it, where to put it. For information about how to install or manage the Puppet software itself, visit Puppet. When we use Puppethttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#When_we_use_Puppet Wikimedia Cloud VPShttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Wikimedia_Cloud_VPS Organizationhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Organization Moduleshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Modules Profileshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Profiles Roleshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Roles Hierahttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Hiera Nodes in site.pphttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Nodes_in_site.pp A working example: deployment hosthttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#A_working_example:_deployment_host When should a profile include another profilehttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#When_should_a_profile_include_another_profile WMF Design conventionshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#WMF_Design_conventions Coding Stylehttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Coding_Style Formathttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Format Spacing, Indentation, & Whitespacehttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Spacing,_Indentation,_&_Whitespace Quotinghttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Quoting Resourceshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Resources Conditionalshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Conditionals Classeshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Classes Includinghttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Including Useful global variableshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Useful_global_variables Testing a patchhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Testing_a_patch Puppet moduleshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Puppet_modules Module vendoringhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Module_vendoring Considerations for vendoring moduleshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Considerations_for_vendoring_modules Vendor module evaluationhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Vendor_module_evaluation Adding a vendored modulehttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Adding_a_vendored_module Updating a vendored modulehttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Updating_a_vendored_module Forking a vendored modulehttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Forking_a_vendored_module Miscellaneoushttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Miscellaneous VIM guidelineshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#VIM_guidelines Emacs guidelineshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Emacs_guidelines Emacs modeshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Emacs_modes Useful config settingshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Useful_config_settings Puppet for Cloud VPS Projectshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Puppet_for_Cloud_VPS_Projects Packages that use pip, gem, etc.https://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Packages_that_use_pip,_gem,_etc. Different ways to install apt packages with puppethttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#Different_ways_to_install_apt_packages_with_puppet method 1: ensure presenthttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_1:_ensure_present method 2: ensure latesthttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_2:_ensure_latest method 3: ensure versionhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_3:_ensure_version method 4: install optionshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_4:_install_options method 5: apt pinninghttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_5:_apt_pinning method 6: combinationhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_6:_combination method 7: apt configuration before installationhttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#method_7:_apt_configuration_before_installation Referenceshttps://wikitech.wikimedia.org/wiki/Puppet/Coding_and_style_guidelines#References https://wikitech.wikimedia.org/wiki/Shell_Request/Ryanvosper Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wolfgang42 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ben10000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prabhupritam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mxn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dilexie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dominic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DixonD Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ketangarala Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaligula Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeff_evans Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinarexchange Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Julianrodes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dr0ptp4kt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dineshrajpurohit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Superzerocool Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shubh09 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AdamDrake Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tfellows Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smy987 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mirontoli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ifeyinwa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kshitij Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mollywhite Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abgaz1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andygrunwald Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diemei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rangilo_Gujarati Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Salvatorelionetti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karthik_sripal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ushau97 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vito_Genovese Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zwick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jmo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kosikfl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Agx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shepazu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frozenice Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DarkCircle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Badassdon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Velesin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ecarlson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cris.lopez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Butoijoh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peanut Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fadili Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diiq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qoreqyas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DerekHe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shashank Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Priya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ktulu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashengmz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xianhua Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/UA31 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rudloff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cobaltcigs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nelsonjohn011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rob_Kam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wavelander Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruphy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mhurd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jpdefillippo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jasper_Deng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davidlbowen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sandeep107 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BBlack Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fuoye Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ryansb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/IsabelG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FunPika Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haroldherbert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Julee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ganeshaditya1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zhaofeng_Li Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johncarter9214 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lydia_Pintscher_(WMDE) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nullzero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Toto_Az%C3%A9ro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/John_Parker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HaeB Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Belal-h.m Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mrsud Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hippietrail Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KartikMistry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shekharkadyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suryawanshimayank Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karagota Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hawk-Eye Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Uploading_large_files == Requirement == Requirementhttps://wikitech.wikimedia.org/wiki/Uploading_large_files#Requirement Step 1: download fileshttps://wikitech.wikimedia.org/wiki/Uploading_large_files#Step_1:_download_files Step 2: import image to Commonshttps://wikitech.wikimedia.org/wiki/Uploading_large_files#Step_2:_import_image_to_Commons https://wikitech.wikimedia.org/wiki/Shell_Request/Zeny_Ferry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pcs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Martsniez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RV1971 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xatt17 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Minhazav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fabrice_Florin_(WMF) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BallisticBender Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cyberpower678 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yosnoop Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jelte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shondhi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sbrdrms Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kushal124 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rogerhc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SuchABot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Test123456 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ganeshaditya91 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jrajav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pyfisch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Laaknor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xavier_Combelle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adisas91 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ayyy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bluerasberry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chipk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jalewagger2149 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Faith300 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wuyanna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grabus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Magnus_Manske Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wrightonlookn%27 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asitaka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jonathanischoice Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Parent5446 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marcoil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edswing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akkking Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robotto7831a Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Exbe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jean-Fr%C3%A9d%C3%A9ric Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mateng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130418-Jenkins from Antoine's email to engineering@ Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20130418-Jenkins#Summary Chain of eventshttps://wikitech.wikimedia.org/wiki/Incidents/20130418-Jenkins#Chain_of_events Lesson learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20130418-Jenkins#Lesson_learned https://wikitech.wikimedia.org/wiki/Shell_Request/DerekFaiers Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prolineserver Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timboven Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vivek_Rai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130419-Parsoid From Roan's email to the Ops mailing list Incident documentationhttps://wikitech.wikimedia.org/wiki/Category:Incident_documentation https://wikitech.wikimedia.org/wiki/Shell_Request/APPER Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ttysh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hawtin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danielrenfro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shaohong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sumurai8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Betacommand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/EBernhardson_(WMF) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Skingry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/EE_Dashboard NOTE: This dashboard is no longer available. Contact the Wikimedia Editing team to find out their plans for it. Anatomy of a dashboardhttps://wikitech.wikimedia.org/wiki/EE_Dashboard#Anatomy_of_a_dashboard Getting access to the ee-dashboard instancehttps://wikitech.wikimedia.org/wiki/EE_Dashboard#Getting_access_to_the_ee-dashboard_instance How to create new graphs and dashboardshttps://wikitech.wikimedia.org/wiki/EE_Dashboard#How_to_create_new_graphs_and_dashboards 1. Install Limnhttps://wikitech.wikimedia.org/wiki/EE_Dashboard#1._Install_Limn 2. Clone limn-editor-engagement-datahttps://wikitech.wikimedia.org/wiki/EE_Dashboard#2._Clone_limn-editor-engagement-data 3. Create a new data filehttps://wikitech.wikimedia.org/wiki/EE_Dashboard#3._Create_a_new_data_file 4. Register the data file as a data sourcehttps://wikitech.wikimedia.org/wiki/EE_Dashboard#4._Register_the_data_file_as_a_data_source 5. Create new graphhttps://wikitech.wikimedia.org/wiki/EE_Dashboard#5._Create_new_graph 6. Add the graph to a dashboardhttps://wikitech.wikimedia.org/wiki/EE_Dashboard#6._Add_the_graph_to_a_dashboard 7. Commit all changeshttps://wikitech.wikimedia.org/wiki/EE_Dashboard#7._Commit_all_changes 8. Deploy on ee-dashboardhttps://wikitech.wikimedia.org/wiki/EE_Dashboard#8._Deploy_on_ee-dashboard Need help?https://wikitech.wikimedia.org/wiki/EE_Dashboard#Need_help? https://wikitech.wikimedia.org/wiki/Shell_Request/Khanduja.pawandeep Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Campbell_Tang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edenhill Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cjucovschi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Acs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Devurself Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Modulistic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Little_green_rosetta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dolph Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manishearth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Magog_the_Ogre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dbeet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asdert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tritesters Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Colbyroblox99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karim.rayani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jpcarmona Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Buddhiprabha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kiran_mathew_koshy_1993 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Acnetj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dominiol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/If11026 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MarcoAurelio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kyzz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mrcaps Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rasel160 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clancer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ndetis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chippy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xiloynaha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Slboat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jwehl1988 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/I-pon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moncky Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aayush251 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hahc21 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/White_Master Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vvv214wth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Exklamationmark Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kpytang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dracorp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jiabao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Balloonguy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mooeypoo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ed_Lane Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boki3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cyrus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hkam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/EnDumEn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kenrick95 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suman.bahuguna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alvarin32 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Intelimal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JamesR Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ceph Ceph is a software defined storage system, offering high levels of scalability and flexibility. Clustershttps://wikitech.wikimedia.org/wiki/Ceph#Clusters Ceph Architecturehttps://wikitech.wikimedia.org/wiki/Ceph#Ceph_Architecture Troubleshootinghttps://wikitech.wikimedia.org/wiki/Ceph#Troubleshooting See alsohttps://wikitech.wikimedia.org/wiki/Ceph#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Deyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oantnri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Corvus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jakub_Vr%C3%A1na Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D8%B4%D8%B1%D9%83%D8%AA_%D8%A8%D9%86%D9%8A%D8%A7%D9%86_%D8%B3%D8%A7%D8%B2%D8%A7%D9%86_%D8%B4%D9%85%D8%A7%D9%84 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bjelleklang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Happyharrythehorse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jose.canciani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomrobert87 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Klortho Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Incola Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Euku Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tommyheyser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FFS2309 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Christian_Clerc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The_Illusive_Man Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fischx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Indranisen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ji-eun.lee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anboia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/CiviCRM_Reporting WMF has some remaining customised reports but our goal is to move away from them in favour of using search kit Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising https://wikitech.wikimedia.org/wiki/Shell_Request/Byrial Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zoska Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Munaf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Morriswa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Happy5214 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/E27_11w_corn_bulb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alessio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sanja_pavlovic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BraneJ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/DonationForm This page describes a proposed implementation of reusable donation form logic. Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Overview Design and implementationhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Design_and_implementation Use caseshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Use_cases Workflowshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Workflows Donatehttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Donate Begin donationhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Begin_donation Select payment methodhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Select_payment_method Submit paymenthttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Submit_payment Alternative entry pointshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Alternative_entry_points Form templateshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Form_templates Banner mixin formhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Banner_mixin_form Configuration interfacehttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Configuration_interface Referral interfacehttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Referral_interface Classeshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Classes DonationFormhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#DonationForm DonationDatahttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#DonationData PaymentMethodSpechttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#PaymentMethodSpec Translationhttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Translation Customization and experimentshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Customization_and_experiments Payment processinghttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Payment_processing Deploymenthttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Deployment Phase 1https://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Phase_1 Phase 2https://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Phase_2 Phase 3https://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Phase_3 Phase 4https://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Phase_4 Considerationshttps://wikitech.wikimedia.org/wiki/Fundraising/DonationForm#Considerations https://wikitech.wikimedia.org/wiki/Shell_Request/Twotwotwo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Tin tin was once the deployment host for Eqiad. It has been replaced by deploy1001. Connectinghttps://wikitech.wikimedia.org/wiki/Tin#Connecting Serviceshttps://wikitech.wikimedia.org/wiki/Tin#Services See alsohttps://wikitech.wikimedia.org/wiki/Tin#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Grv99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inkowik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MichaelBillington Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ladsgroup Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moustapha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sitic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Supermohi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pleclown Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ClementAmblard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iluvatar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gr%E3%82%A7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anupriyaq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anupriya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dalba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ebrahim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nielsen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Terbium terbium was the maintenance script host in eqiad, a Dell PowerEdge R420. It was replaced by mwmaint1001. Connecthttps://wikitech.wikimedia.org/wiki/Terbium#Connect Serviceshttps://wikitech.wikimedia.org/wiki/Terbium#Services See alsohttps://wikitech.wikimedia.org/wiki/Terbium#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Akosiaris Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Miguel2706 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Artem_Korzhimanov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/HTTPS/testing Testing puppet changes to ssl terminators (read and sanity check before blindly following this, maybe something's changed since this was written) https://wikitech.wikimedia.org/wiki/Shell_Request/Eclectiqus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Basti2342 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hersfold Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdgilbert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ricordisamoa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wpmirrordev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rsmith Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Samwilson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Liuxinyu970226 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Li3939108 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yzhang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AioftheStorm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CoveyHill Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ralokt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JdBAlten Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Steinsplitter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dan_Bolser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CBM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freak4pc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Henkel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gilfriedman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D7%90%D7%95%D7%A8_%D7%A9%D7%A4%D7%99%D7%A8%D7%90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aandrei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moshe742 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Heziresheff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zalak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shayt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306 This is here for historical reasons. This was the page used to describe two different one-week deploy cycle proposals as we were wanting to transition from a two-week cycle. Current deploy schedule statshttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Current_deploy_schedule_stats Proposals to get to a one-week deployment cyclehttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Proposals_to_get_to_a_one-week_deployment_cycle Option Ahttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Option_A Deploy calendarhttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Deploy_calendar Lifespanhttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Lifespan Statshttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Stats Pros/conshttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Pros/cons Option Bhttps://wikitech.wikimedia.org/wiki/Deployments/Train/Transition-201306#Option_B https://wikitech.wikimedia.org/wiki/Shell_Request/RAN1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shawnanthony420 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilfeld Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/A930913 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fantasticfears Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yonjah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Damzow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ronengi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amirber Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tom_Morris Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ydanziger Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alonga2811 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Colbeseder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vladk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Th3w4v3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dafna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Divec Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jamesmontalvo3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Martijn_Hoekstra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Egoblock Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Electricmonk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ProgramAngel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johnny505 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Etan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fvue Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sumanah-testing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TWillemsen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TMg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Micru Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ash_Crow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taweetham Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edlira Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juttavd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akoopal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ragesoss Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zielmicha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jackson_Peebles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CristianCantoro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Psychoslave Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deskana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Magioladitis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spider Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FatJagm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MarianneH Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AlanT Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ZeroK Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JoffreyQ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gretal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Florenth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danilo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ayarnet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iub Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Henna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zache-tool Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jane023 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fareh-abdelhak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Analysis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mahdiz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stevenliuyi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hym411 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mapio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cprodescu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pietrodn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nobushigex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pathoschild Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Strix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pecoes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Auduwage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nettrom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Konarak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peterbruin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iboyinc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LouriePieterse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Owl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MahmoudHashemi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rtdwivedi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SirReal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/StoneBird Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Heb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Koavf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inkbug Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tristessa_de_St_Ange Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Profoss Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manybubbles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chess64 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zhuyifei1999 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aschroet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xazza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Masti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Forexnewsnow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AleXXw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ltrlg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kylalak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wangxuan8331800 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Muthumani2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alvaro_Lopez_Tijeras Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Euvl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gitsan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aadithvmenon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gryllida Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner Redis is used for the [queue|MediaWiki job queue] as a memcached replacement. Statushttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner#Status Clusterhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner#Cluster Job queue keyshttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner#Job_queue_keys Getting counts of queues (lists and sets)https://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner#Getting_counts_of_queues_(lists_and_sets) Getting slices of setshttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner#Getting_slices_of_sets Examining the data for a jobhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF/Jobrunner#Examining_the_data_for_a_job https://wikitech.wikimedia.org/wiki/Redis There are a number of Redis clusters and instance in Wikimedia production. Cluster redis_gitlabhttps://wikitech.wikimedia.org/wiki/Redis#Cluster_redis_gitlab Cluster redis_mischttps://wikitech.wikimedia.org/wiki/Redis#Cluster_redis_misc Pair 1 (rdb1013 and rdb2007)https://wikitech.wikimedia.org/wiki/Redis#Pair_1_(rdb1013_and_rdb2007) Pair 2 (rdb1011 and rdb2009)https://wikitech.wikimedia.org/wiki/Redis#Pair_2_(rdb1011_and_rdb2009) Servershttps://wikitech.wikimedia.org/wiki/Redis#Servers Serviceshttps://wikitech.wikimedia.org/wiki/Redis#Services Related puppet codehttps://wikitech.wikimedia.org/wiki/Redis#Related_puppet_code Other Infohttps://wikitech.wikimedia.org/wiki/Redis#Other_Info Using Redishttps://wikitech.wikimedia.org/wiki/Redis#Using_Redis Connectinghttps://wikitech.wikimedia.org/wiki/Redis#Connecting Some useful commandshttps://wikitech.wikimedia.org/wiki/Redis#Some_useful_commands Using Redis from other Serviceshttps://wikitech.wikimedia.org/wiki/Redis#Using_Redis_from_other_Services Other referenceshttps://wikitech.wikimedia.org/wiki/Redis#Other_references Former clustershttps://wikitech.wikimedia.org/wiki/Redis#Former_clusters Cluster redis_mapshttps://wikitech.wikimedia.org/wiki/Redis#Cluster_redis_maps Cluster redis_sessionshttps://wikitech.wikimedia.org/wiki/Redis#Cluster_redis_sessions See alsohttps://wikitech.wikimedia.org/wiki/Redis#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Ptarjan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Saramg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joelp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Justincheng12345 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jarekt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goosy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dbeeson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HanneleOlenius Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Plavi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Steenth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Florianschmidtwelzow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bgwhite Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rcpenalosa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ArrowEdge Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Glaisher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bharaththiruveedula Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TCN7JM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/YMS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sreelu02 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Theczech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Osiris Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seahorseruler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruakh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Antimony antimony was the host running Gitblit on git.wikimedia. Decomhttps://wikitech.wikimedia.org/wiki/Antimony#Decom https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive This is a documentation for tool labs admins Toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Tools Creation of new toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Creation_of_new_tool Removal of toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Removal_of_tool Disabling tools running on -loginhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Disabling_tools_running_on_-login If they run them in cronhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#If_they_run_them_in_cron If they run them in a screenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#If_they_run_them_in_a_screen Configuration of instancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Configuration_of_instance Memoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Memory NFShttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#NFS New instance cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#New_instance_cookbook Exec nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Exec_nodes Mailhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Mail Toolwatcher (tools-login)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Toolwatcher_(tools-login) Access to instanceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Access_to_instances Howtohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#Howto local-adminhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#local-admin History of toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Archive#History_of_tools https://wikitech.wikimedia.org/wiki/Shell_Request/Stefan_K%C3%BChn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Telmar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130607-CI == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20130607-CI#Summary What Happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20130607-CI#What_Happened Lessons Learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20130607-CI#Lessons_Learned Action Itemshttps://wikitech.wikimedia.org/wiki/Incidents/20130607-CI#Action_Items https://wikitech.wikimedia.org/wiki/Shell_Request/Richregel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MrFredH Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Paulboal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pcodeaxonos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Orbartal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mpolucha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Patrick87 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Salvidrim! Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joe_Decker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lbthomsen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nutz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Blurbz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dg2ygx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jomo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bakert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nawiarigi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Paul2387 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kyloma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Meno25 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Denacig Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130508-memcached == Problem == Problemhttps://wikitech.wikimedia.org/wiki/Incidents/20130508-memcached#Problem Solutionhttps://wikitech.wikimedia.org/wiki/Incidents/20130508-memcached#Solution Startup Performancehttps://wikitech.wikimedia.org/wiki/Incidents/20130508-memcached#Startup_Performance https://wikitech.wikimedia.org/wiki/Shell_Request/Mati Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Martin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SUNGHAN_KIM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Voll Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130617-AccountCreation == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20130617-AccountCreation#Summary What Happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20130617-AccountCreation#What_Happened Lessons Learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20130617-AccountCreation#Lessons_Learned Action Itemshttps://wikitech.wikimedia.org/wiki/Incidents/20130617-AccountCreation#Action_Items https://wikitech.wikimedia.org/wiki/Incidents/20130617-Email Copy/paste from Faidon's email to Ops Actions to discuss/takehttps://wikitech.wikimedia.org/wiki/Incidents/20130617-Email#Actions_to_discuss/take https://wikitech.wikimedia.org/wiki/Shell_Request/Pywikipedia_Conversion_Bot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130315-AFTv5 ==Outage Summary== Outage Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20130315-AFTv5#Outage_Summary Detailhttps://wikitech.wikimedia.org/wiki/Incidents/20130315-AFTv5#Detail Response from Matthiashttps://wikitech.wikimedia.org/wiki/Incidents/20130315-AFTv5#Response_from_Matthias https://wikitech.wikimedia.org/wiki/Shell_Request/Oyamauchi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LFaraone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Bacula Bacula is a backup system that Wikimedia has been using since 2013. Objectivehttps://wikitech.wikimedia.org/wiki/Bacula#Objective Historyhttps://wikitech.wikimedia.org/wiki/Bacula#History General bacula informationhttps://wikitech.wikimedia.org/wiki/Bacula#General_bacula_information Bacula Architecturehttps://wikitech.wikimedia.org/wiki/Bacula#Bacula_Architecture Jobshttps://wikitech.wikimedia.org/wiki/Bacula#Jobs Jobdefshttps://wikitech.wikimedia.org/wiki/Bacula#Jobdefs Levelshttps://wikitech.wikimedia.org/wiki/Bacula#Levels Scheduleshttps://wikitech.wikimedia.org/wiki/Bacula#Schedules Filesetshttps://wikitech.wikimedia.org/wiki/Bacula#Filesets Volumeshttps://wikitech.wikimedia.org/wiki/Bacula#Volumes Poolshttps://wikitech.wikimedia.org/wiki/Bacula#Pools Encryptionhttps://wikitech.wikimedia.org/wiki/Bacula#Encryption SPOFshttps://wikitech.wikimedia.org/wiki/Bacula#SPOFs WMF specificshttps://wikitech.wikimedia.org/wiki/Bacula#WMF_specifics Architecturehttps://wikitech.wikimedia.org/wiki/Bacula#Architecture Off-site backupshttps://wikitech.wikimedia.org/wiki/Bacula#Off-site_backups What to backuphttps://wikitech.wikimedia.org/wiki/Bacula#What_to_backup DB Backupshttps://wikitech.wikimedia.org/wiki/Bacula#DB_Backups Retentionhttps://wikitech.wikimedia.org/wiki/Bacula#Retention Configured Poolshttps://wikitech.wikimedia.org/wiki/Bacula#Configured_Pools Architecture update (2020, 2022)https://wikitech.wikimedia.org/wiki/Bacula#Architecture_update_(2020,_2022) Configuration managementhttps://wikitech.wikimedia.org/wiki/Bacula#Configuration_management Adding a new clienthttps://wikitech.wikimedia.org/wiki/Bacula#Adding_a_new_client In the director (if needed)https://wikitech.wikimedia.org/wiki/Bacula#In_the_director_(if_needed) In the clienthttps://wikitech.wikimedia.org/wiki/Bacula#In_the_client Backup Strategyhttps://wikitech.wikimedia.org/wiki/Bacula#Backup_Strategy Operationshttps://wikitech.wikimedia.org/wiki/Bacula#Operations Monitoringhttps://wikitech.wikimedia.org/wiki/Bacula#Monitoring Ignore listhttps://wikitech.wikimedia.org/wiki/Bacula#Ignore_list Day to dayhttps://wikitech.wikimedia.org/wiki/Bacula#Day_to_day Statisticshttps://wikitech.wikimedia.org/wiki/Bacula#Statistics Restore (aka Panic mode)https://wikitech.wikimedia.org/wiki/Bacula#Restore_(aka_Panic_mode) Troubleshooting common issueshttps://wikitech.wikimedia.org/wiki/Bacula#Troubleshooting_common_issues Restore from a non-existent host (missing private key)https://wikitech.wikimedia.org/wiki/Bacula#Restore_from_a_non-existent_host_(missing_private_key) Modify a pool's retention (or other similar properties)https://wikitech.wikimedia.org/wiki/Bacula#Modify_a_pool's_retention_(or_other_similar_properties) Bare metal recoveryhttps://wikitech.wikimedia.org/wiki/Bacula#Bare_metal_recovery See alsohttps://wikitech.wikimedia.org/wiki/Bacula#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Pbhattacharya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mboisson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nilesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iamrahulsethi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andreqsi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uzmamunirr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MasWag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Theoctopus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/99of9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arlolra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neehaali82 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rutu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bluegoblin7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tommyang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fredddie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bountin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Michiganlake Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Liammonahan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ajs6f Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Melos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Springle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Media_storage This page describes Wikimedia's media storage infrastructure. Contexthttps://wikitech.wikimedia.org/wiki/Media_storage#Context Componentshttps://wikitech.wikimedia.org/wiki/Media_storage#Components Caching proxieshttps://wikitech.wikimedia.org/wiki/Media_storage#Caching_proxies Media storagehttps://wikitech.wikimedia.org/wiki/Media_storage#Media_storage Image & video scalershttps://wikitech.wikimedia.org/wiki/Media_storage#Image_&_video_scalers Architecturehttps://wikitech.wikimedia.org/wiki/Media_storage#Architecture File/object structurehttps://wikitech.wikimedia.org/wiki/Media_storage#File/object_structure Thumbnail handlinghttps://wikitech.wikimedia.org/wiki/Media_storage#Thumbnail_handling Datacenter replicationhttps://wikitech.wikimedia.org/wiki/Media_storage#Datacenter_replication Historyhttps://wikitech.wikimedia.org/wiki/Media_storage#History 2008https://wikitech.wikimedia.org/wiki/Media_storage#2008 2009https://wikitech.wikimedia.org/wiki/Media_storage#2009 2012https://wikitech.wikimedia.org/wiki/Media_storage#2012 Exampleshttps://wikitech.wikimedia.org/wiki/Media_storage#Examples First request for a thumbnail imagehttps://wikitech.wikimedia.org/wiki/Media_storage#First_request_for_a_thumbnail_image Common operationshttps://wikitech.wikimedia.org/wiki/Media_storage#Common_operations Removing archived fileshttps://wikitech.wikimedia.org/wiki/Media_storage#Removing_archived_files Cleaning up thumbshttps://wikitech.wikimedia.org/wiki/Media_storage#Cleaning_up_thumbs Syncing between storeshttps://wikitech.wikimedia.org/wiki/Media_storage#Syncing_between_stores See alsohttps://wikitech.wikimedia.org/wiki/Media_storage#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Tarrow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ciphers Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/DBA_Tasks === DBA onboarding and upcoming projects, June 2013 === DBA onboarding and upcoming projects, June 2013https://wikitech.wikimedia.org/wiki/DBA_Tasks#DBA_onboarding_and_upcoming_projects,_June_2013 Get familiar withhttps://wikitech.wikimedia.org/wiki/DBA_Tasks#Get_familiar_with To Dohttps://wikitech.wikimedia.org/wiki/DBA_Tasks#To_Do https://wikitech.wikimedia.org/wiki/Shell_Request/Addihockey10 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Upload.wikimedia.org upload.wikimedia. MediaWikihttps://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#MediaWiki Thumborhttps://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#Thumbor Media storagehttps://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#Media_storage Historyhttps://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#History 2008https://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#2008 2009https://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#2009 External linkhttps://wikitech.wikimedia.org/wiki/Upload.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Shell_Request/RickyB98 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jboogie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brylie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ArdWar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madhu9038 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Charlygurl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jgbarah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ciges Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20130628-Site == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20130628-Site#Summary What Happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20130628-Site#What_Happened Lessons Learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20130628-Site#Lessons_Learned Action Itemshttps://wikitech.wikimedia.org/wiki/Incidents/20130628-Site#Action_Items https://wikitech.wikimedia.org/wiki/Shell_Request/Adeel1022 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venkatsai101 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frouco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TMontgomery Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LivingShadow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tristanoid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pragunbhutani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/J883376 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gnumarcoo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Benjaoming Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tntnet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kyng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tilgovi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Telesliveca Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ingber Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mys_721tx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Linedwell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hhartl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hhartl-dev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MGA73 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goodtothet33 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Lifecycle This page describes the lifecycle of Wikimedia servers, starting from the moment we acquire them and until the time we don't own them anymore. A server has various states that it goes through, with several steps that need to happen in each state. Stateshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#States Server transitionshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Server_transitions Requestedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Requested Existing System Allocationhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Existing_System_Allocation Orderedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Ordered Post Orderhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Post_Order Requested -> Spare & Requested -> Plannedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Requested_->_Spare_&_Requested_->_Planned Receiving Systems On-Sitehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Receiving_Systems_On-Site Requested -> Planned additional steps & Spare -> Plannedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Requested_->_Planned_additional_steps_&_Spare_->_Planned Planned -> Activehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Planned_->_Active Preparationhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Preparation Installationhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Installation Automatic Installationhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Automatic_Installation Manual installationhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Manual_installation Spare -> Failed & Planned -> Failedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Spare_->_Failed_&_Planned_->_Failed Spare -> Decommissionedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Spare_->_Decommissioned Active -> Failedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Active_->_Failed Active -> Decommissionedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Active_->_Decommissioned Failed -> Sparehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Failed_->_Spare Failed -> Plannedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Failed_->_Planned Failed -> Activehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Failed_->_Active Failed -> Decommissionedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Failed_->_Decommissioned Decommissioned -> Sparehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Decommissioned_->_Spare Decommissioned -> Activehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Decommissioned_->_Active Decommissioned -> Unrackedhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Decommissioned_->_Unracked Unracked -> Recycledhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Unracked_->_Recycled Server actionshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Server_actions Reimagehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Reimage Remove from productionhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Remove_from_production Rename while reimaginghttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Rename_while_reimaging Old procedure (and for changing vlan if you really need it)https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Old_procedure_(and_for_changing_vlan_if_you_really_need_it) Reclaim to Spares OR Decommissionhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Reclaim_to_Spares_OR_Decommission Steps for non-LVS hostshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Steps_for_non-LVS_hosts Steps for ANY Opsenhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Steps_for_ANY_Opsen Steps for DC-OPS (with network switch access)https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Steps_for_DC-OPS_(with_network_switch_access) Decommission Specific (can be done by DC Ops without network switch access)https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Decommission_Specific_(can_be_done_by_DC_Ops_without_network_switch_access) Network devices specifichttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Network_devices_specific Move existing server between rows/racks, changing IPshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Move_existing_server_between_rows/racks,_changing_IPs Change server NIC and switch connection, keeping IPshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Change_server_NIC_and_switch_connection,_keeping_IPs Why?https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Why? Procedurehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Procedure Helpful Cheatshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Helpful_Cheats Finding hosts to Decommhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle#Finding_hosts_to_Decomm https://wikitech.wikimedia.org/wiki/Shell_Request/Benley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuvraj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fnielsen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fuxuan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JurgenNL Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pcoombe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clockery Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Malvineous Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krishna.rao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naqash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anatoly_Severin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Milicevic01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattsenate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alagalah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Acrida Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marian_520219 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gouboft Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Viswaprabha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aliawais002 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JosephAllen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Odisha1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kbrownell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Susannaanas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fleurent Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cloudyks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kingwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bine0410 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wmdv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions This page documents the naming conventions of servers, routers, and data center sites. Name reusehttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Name_reuse Data centershttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Data_centers Networkinghttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Networking OpenStack deploymentshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#OpenStack_deployments Diskshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Disks Kuberneteshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Kubernetes Servershttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Servers Datacenter numberinghttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Datacenter_numbering Hostname prefixeshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Hostname_prefixes Miscellaneous servershttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_naming_conventions#Miscellaneous_servers https://wikitech.wikimedia.org/wiki/Shell_Request/Pradeep Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/Syslog_Settings There are a number of log buckets that we regularly define in syslog, to help us monitor different things happening in DonationInterface, and increasingly, the payments listeners. Fundraisinghttps://wikitech.wikimedia.org/wiki/Category:Fundraising https://wikitech.wikimedia.org/wiki/Shell_Request/Kmenger Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dahoo1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chymer720 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Masud024 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clairemarcc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Steputis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moheen_Reeyad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PinkAmpersand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madihakanwal222 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krabat_der_Zauberlehrling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chinvo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Owora Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ops_notifications The operations team provides notification of maintenance or upgrades being done, emergency outages, and day to day work. Below is a summary of the different means in use by ops. IRChttps://wikitech.wikimedia.org/wiki/Ops_notifications#IRC Server Admin Log (SAL)https://wikitech.wikimedia.org/wiki/Ops_notifications#Server_Admin_Log_(SAL) Twitterhttps://wikitech.wikimedia.org/wiki/Ops_notifications#Twitter Mastodonhttps://wikitech.wikimedia.org/wiki/Ops_notifications#Mastodon Wikihttps://wikitech.wikimedia.org/wiki/Ops_notifications#Wiki Phabricatorhttps://wikitech.wikimedia.org/wiki/Ops_notifications#Phabricator Emailhttps://wikitech.wikimedia.org/wiki/Ops_notifications#Email Gerrithttps://wikitech.wikimedia.org/wiki/Ops_notifications#Gerrit https://wikitech.wikimedia.org/wiki/Shell_Request/Oleksandr_Petrov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Limojoe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jtdfs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rosshouser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rillke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/EventLogging/Universal_Language_Selector_October_2012 In October 2012, the [Language engineering] team evaluated the different available tracking tools for the [it needed, in particular for [[mw:ULS]; this assessment is copied from [of July 2013, the EventLogging tracking is being implemented.[https://mingle. Extension EventLogginghttps://wikitech.wikimedia.org/wiki/EventLogging/Universal_Language_Selector_October_2012#Extension_EventLogging Extension ClickTrackinghttps://wikitech.wikimedia.org/wiki/EventLogging/Universal_Language_Selector_October_2012#Extension_ClickTracking https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications This page will outline our preferred specifications for use in data centers. Cabling specificationshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Cabling_specifications Cabling optionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Cabling_options Power specificationshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Power_specifications Enclosure specificationshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Enclosure_specifications Eqiad rackshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Eqiad_racks Codfw rackshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Codfw_racks All other siteshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#All_other_sites Serial consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Serial_console Toolbag for Buildoutshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Toolbag_for_Buildouts Brazil Specifichttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Common_Data_center_Specifications#Brazil_Specific https://wikitech.wikimedia.org/wiki/Shell_Request/Kwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Technical_13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KSnider Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Myhappypenguin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seoexpert001 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pcc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rjain Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sidrakanwal774 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sidrakanwal77412 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mose Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LuckyLucy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roopak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Durga Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D9%81%D9%84%D9%88%D8%B1%D8%A7%D9%86%D8%B3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kylewooten99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elph Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ElphiBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Gitblit Our Gitblit installation is [at https://git.wikimedia. Hardwarehttps://wikitech.wikimedia.org/wiki/Gitblit#Hardware Operationshttps://wikitech.wikimedia.org/wiki/Gitblit#Operations Restartinghttps://wikitech.wikimedia.org/wiki/Gitblit#Restarting Delete a repohttps://wikitech.wikimedia.org/wiki/Gitblit#Delete_a_repo https://wikitech.wikimedia.org/wiki/Shell_Request/Andim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Git.wikimedia.org Git.wikimedia. See Alsohttps://wikitech.wikimedia.org/wiki/Git.wikimedia.org#See_Also Referenceshttps://wikitech.wikimedia.org/wiki/Git.wikimedia.org#References https://wikitech.wikimedia.org/wiki/Shell_Request/Nandy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M.Octagon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KuduIO Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Magul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Byfserag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Avocato Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amanampa-test Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FelixReimann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tzafrir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elifnas%C4%B1l Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sasangels Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abshirdheere Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MBQ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Worm_That_Turned Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ividal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mani_Chandel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xelgen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pkra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Wikitech-static wikitech-static is an offsite, read-only backup of wikitech.wikimedia. What content is on wikitech-static?https://wikitech.wikimedia.org/wiki/Wikitech-static#What_content_is_on_wikitech-static? Where is it?https://wikitech.wikimedia.org/wiki/Wikitech-static#Where_is_it? What is wikitech-static running?https://wikitech.wikimedia.org/wiki/Wikitech-static#What_is_wikitech-static_running? MediaWikihttps://wikitech.wikimedia.org/wiki/Wikitech-static#MediaWiki Status page redirecthttps://wikitech.wikimedia.org/wiki/Wikitech-static#Status_page_redirect Meta-monitoringhttps://wikitech.wikimedia.org/wiki/Wikitech-static#Meta-monitoring Example of page notificationshttps://wikitech.wikimedia.org/wiki/Wikitech-static#Example_of_page_notifications Example of email notificationhttps://wikitech.wikimedia.org/wiki/Wikitech-static#Example_of_email_notification How do we maintain it?https://wikitech.wikimedia.org/wiki/Wikitech-static#How_do_we_maintain_it? Configuration fileshttps://wikitech.wikimedia.org/wiki/Wikitech-static#Configuration_files Automatic content syncronisationhttps://wikitech.wikimedia.org/wiki/Wikitech-static#Automatic_content_syncronisation Manual updateshttps://wikitech.wikimedia.org/wiki/Wikitech-static#Manual_updates VM controlhttps://wikitech.wikimedia.org/wiki/Wikitech-static#VM_control What alerts should we watch out for?https://wikitech.wikimedia.org/wiki/Wikitech-static#What_alerts_should_we_watch_out_for? Serviceshttps://wikitech.wikimedia.org/wiki/Wikitech-static#Services External linkhttps://wikitech.wikimedia.org/wiki/Wikitech-static#External_link https://wikitech.wikimedia.org/wiki/Incidents/20130725-Wikivoyage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20130725-Wikivoyage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20130725-Wikivoyage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20130725-Wikivoyage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20130725-Wikivoyage#Actionables See alsohttps://wikitech.wikimedia.org/wiki/Incidents/20130725-Wikivoyage#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Pigpen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Release_notes_rebase_bot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cupcake Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wp-zero-data-bot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PywikibotCommitWatcher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lihux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cengin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pratyya_Ghosh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gogo5435435343 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chankouteh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Gerrit/Phabricator_integration Gerrit Notification Bot (aka gerritbot) is the username used by a Gerrit plugin to perform actions on Phabricator. Sourcehttps://wikitech.wikimedia.org/wiki/Gerrit/Phabricator_integration#Source Functionalityhttps://wikitech.wikimedia.org/wiki/Gerrit/Phabricator_integration#Functionality Maintainerhttps://wikitech.wikimedia.org/wiki/Gerrit/Phabricator_integration#Maintainer Archivehttps://wikitech.wikimedia.org/wiki/Gerrit/Phabricator_integration#Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Karan10 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hoggle42 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mineo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iassen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nette Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BryanDavis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clmbirn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cook879 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Afazio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fuzheado Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Victorcisneiros Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roopak.tj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PuzzletChung Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jduhamel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arash.pt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stephan_Schulz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Machouinard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jrn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marcmiquel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hasteur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Netol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LuisVilla Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anthony_Fok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hiebra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JaGa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pypt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Targasepanji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gog0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dmunene Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nirvin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jnd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carrytimer1319 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Surenm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Netsonfong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Larygloria01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kvt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SuperMarioBros99thx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%DB%8C%D8%A7%D8%B3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview This page is meant as a workspace to evaluate replacements for udp2log. The options discussed here will be used as the main data firehose into the Analytics Kraken Cluster. Contexthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Context udp2loghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#udp2log Problemshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Problems Distributed Logging Solutionshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Distributed_Logging_Solutions Key Questions for All Systemshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Key_Questions_for_All_Systems Configurationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Configuration Failure and Recoveryhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Failure_and_Recovery Maintenancehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Maintenance Terminologyhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Terminology Feature Comparisonhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Feature_Comparison Kafkahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Kafka Reliabilityhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Reliability How to get data inhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#How_to_get_data_in Proshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Pros Conshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Cons See Alsohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#See_Also Scribehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Scribe Flumehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Flume Data Flowshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Data_Flows End-to-endhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#End-to-end Store on failurehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Store_on_failure Best efforthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Best_effort Discussionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Discussion Local Message Bufferinghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Local_Message_Buffering Do we really need it?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Do_we_really_need_it? Suggestionshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Suggestions Setuphttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#Setup Referenceshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Overview#References https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation __TOC__ The Firehosehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#The_Firehose Requirementshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Requirements Kafkahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Kafka Projecthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Project Architecturehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Architecture Operationshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Operations Recovery Testinghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Recovery_Testing Case Study: Kafka at LinkedInhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Case_Study:_Kafka_at_LinkedIn Rejected Alternativeshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Rejected_Alternatives Scribehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Scribe Flumehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Flume Othershttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#Others Referenceshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Logging_-_Solutions_Recommendation#References https://wikitech.wikimedia.org/wiki/Shell_Request/Getnetabebe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie Apache Oozie is a workflow scheduler for Apache Hadoop jobs. Key termshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Key_terms Descriptionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Description Basic examplehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Basic_example Hive queryhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Hive_query Workflow.xml and workflow.propertieshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Workflow.xml_and_workflow.properties Validating worflow.xmlhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Validating_worflow.xml Moving files to hdfshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Moving_files_to_hdfs Running oozie jobhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Running_oozie_job Running your job, say, once a dayhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Running_your_job,_say,_once_a_day Advanced examplehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Advanced_example Rsync code to stat1004/stat1007https://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Rsync_code_to_stat1004/stat1007 Create tables if neededhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Create_tables_if_needed Put your oozie directory on hdfshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Put_your_oozie_directory_on_hdfs Run oozie job overriding what pertainshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Run_oozie_job_overriding_what_pertains Datasetshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Datasets Troubleshootinghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Troubleshooting No logshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#No_logs Checking logshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Checking_logs Seeing the last-run jobshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Seeing_the_last-run_jobs Investigating a failed jobhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Investigating_a_failed_job Killing a jobhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Killing_a_job Check how the cluster is doinghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Check_how_the_cluster_is_doing Check the Oozie versionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Check_the_Oozie_version "Oozie URL is not available"https://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#"Oozie_URL_is_not_available" More infohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#More_info Naming Conventionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Naming_Convention How to see jobs scheduled to runhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#How_to_see_jobs_scheduled_to_run Administrationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie#Administration https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster The Analytics cluster is the Hadoop cluster and related components that runs the Analytics Data Lake. Its most important functions are providing: Glossaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Glossary Log Producers - varnishkafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Log_Producers_-_varnishkafka Log Buffering - Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Log_Buffering_-_Kafka Batch Analysis - Hadoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Batch_Analysis_-_Hadoop Data pipelineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Data_pipelines Traffic datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Traffic_data Edit datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Edit_data More detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#More_details Infrastructurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Infrastructure Roleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Roles Puppethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Puppet FAQhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#FAQ How do I...https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#How_do_I... retrieve a file from HDFS?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#retrieve_a_file_from_HDFS? list files on a directory?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#list_files_on_a_directory? recover files deleted by mistake using the hdfs CLI rm command?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#recover_files_deleted_by_mistake_using_the_hdfs_CLI_rm_command? See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#See_also Webrequest ingestion diagramhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster#Webrequest_ingestion_diagram https://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive This page is for the project to implement an OpenStreetMap TileServer hosted in WMF's production infrastructure which serves the same basic data as OSM themselves (synced from them). This is orthogonal to (or in some other sense, a prerequisite for) other OSM efforts going on in Labs for related overlays and databases. Statushttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Status Rationalehttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Rationale Goalshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Goals Timeline / Planhttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Timeline_/_Plan Software discussionhttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Software_discussion Related Linkshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Related_Links Future Workhttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Future_Work Extended State of Things - 2013-11-27https://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Extended_State_of_Things_-_2013-11-27 Larger issues with the scope and constraints of this projecthttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Larger_issues_with_the_scope_and_constraints_of_this_project Basic technical notes from setting up a simple installhttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Basic_technical_notes_from_setting_up_a_simple_install Commentshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver/Archive#Comments https://wikitech.wikimedia.org/wiki/Shell_Request/SALOMON Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ccappstest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sk!d Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jreed Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Papuass Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tnegrin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cloud668 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peter.C Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arjunaraoc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oarabile_Mudongo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ainali Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sealsplayer8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Infovarius Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asaifm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lord_Farin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neosyon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Salix_alba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Panpin2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fr%C3%A9d%C3%A9ric_Wang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Delirium Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freddy2001 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lvova Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hubertchang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alex_brollo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ADMIRAL12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeph_paul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Poco_a_poco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Candalua Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wiki_SUNGHAN_KIM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lightbinder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop The hardware infrastructure page has the system description and configurations. As of August 2023, we are running a slightly modified version of Apache Bigtop 1. Administration linkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop#Administration_links Building Packageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop#Building_Packages For usershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop#For_users Queueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop#Queues GPU Supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop#GPU_Support https://wikitech.wikimedia.org/wiki/Shell_Request/Jephpaul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cheers! Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Kafka Apache Kafka is a scalable and durable distributed logging buffer. We currently run 6 Kafka clusters using Confluent's Kafka distribution. Administrationhttps://wikitech.wikimedia.org/wiki/Kafka#Administration Multi Datacenterhttps://wikitech.wikimedia.org/wiki/Kafka#Multi_Datacenter Data center topic prefixing design flawhttps://wikitech.wikimedia.org/wiki/Kafka#Data_center_topic_prefixing_design_flaw Kafka Clustershttps://wikitech.wikimedia.org/wiki/Kafka#Kafka_Clusters jumbo (eqiad)https://wikitech.wikimedia.org/wiki/Kafka#jumbo_(eqiad) main (eqiad and codfw)https://wikitech.wikimedia.org/wiki/Kafka#main_(eqiad_and_codfw) logging (eqiad and codfw)https://wikitech.wikimedia.org/wiki/Kafka#logging_(eqiad_and_codfw) test-eqiad (eqiad)https://wikitech.wikimedia.org/wiki/Kafka#test-eqiad_(eqiad) Webrequest logshttps://wikitech.wikimedia.org/wiki/Kafka#Webrequest_logs Monitoringhttps://wikitech.wikimedia.org/wiki/Kafka#Monitoring In Cloud VPShttps://wikitech.wikimedia.org/wiki/Kafka#In_Cloud_VPS How do I ...https://wikitech.wikimedia.org/wiki/Kafka#How_do_I_... List available Kafka topicshttps://wikitech.wikimedia.org/wiki/Kafka#List_available_Kafka_topics Consumehttps://wikitech.wikimedia.org/wiki/Kafka#Consume Producehttps://wikitech.wikimedia.org/wiki/Kafka#Produce Consume with a Python Kafka clienthttps://wikitech.wikimedia.org/wiki/Kafka#Consume_with_a_Python_Kafka_client Consume using Spark Streaminghttps://wikitech.wikimedia.org/wiki/Kafka#Consume_using_Spark_Streaming Get a neat GUI for interacting with Kafkahttps://wikitech.wikimedia.org/wiki/Kafka#Get_a_neat_GUI_for_interacting_with_Kafka Force a specific offset for a consumer grouphttps://wikitech.wikimedia.org/wiki/Kafka#Force_a_specific_offset_for_a_consumer_group Force a specific offset for a consumer group (more error prone)https://wikitech.wikimedia.org/wiki/Kafka#Force_a_specific_offset_for_a_consumer_group_(more_error_prone) See alsohttps://wikitech.wikimedia.org/wiki/Kafka#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/1Veertje Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nirakka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sindh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tim_Landscheidt_(Test) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jen_Montes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/O Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sofa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gnosygnu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmontepagano Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tarawneh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hans.hartl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kflorence Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taoliu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nucomm0011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zsaigol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bluyten Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carolsand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sravya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jmorgan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wh652661 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yorg666 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Luxo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Renoirb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AndyRussG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Search The linked pages contain technical documentation on how search works on In case of emergencyhttps://wikitech.wikimedia.org/wiki/Search#In_case_of_emergency Overviewhttps://wikitech.wikimedia.org/wiki/Search#Overview Elasticahttps://wikitech.wikimedia.org/wiki/Search#Elastica CirrusSearchhttps://wikitech.wikimedia.org/wiki/Search#CirrusSearch Cirrus Streaming Updaterhttps://wikitech.wikimedia.org/wiki/Search#Cirrus_Streaming_Updater Elasticsearchhttps://wikitech.wikimedia.org/wiki/Search#Elasticsearch https://wikitech.wikimedia.org/wiki/Shell_Request/Delba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davids Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bommelbot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Etopeter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BMB409 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diaoxi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log == 2024-11-08 == 2024-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-08 2024-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-07 2024-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-06 2024-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-05 2024-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-04 2024-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-02 2024-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2024-11-01 Archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log#Archives https://wikitech.wikimedia.org/wiki/Shell_Request/Blahma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrey_Kiselev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yug Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Knakanohito Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Laryomaima Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Laryomaima234 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Liz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tfmorris Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty The SRE Clinic Duty was established to ensure that tickets (and thus requests and projects) are triaged and processed in a timely fashion, providing feedback and regular updates to SRE-supported projects/responsibilities. Expectationshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Expectations Handing off dutieshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Handing_off_duties Responsibilitieshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Responsibilities Review incoming taskshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Review_incoming_tasks Access requestshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Access_requests Task triagehttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Task_triage Maintain the maintenance calendarhttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Maintain_the_maintenance_calendar What needs to be added?https://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#What_needs_to_be_added? Handle incoming IRC requestshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Handle_incoming_IRC_requests Phabricator Administrationhttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Phabricator_Administration Mail aliaseshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Mail_aliases Mailman mailing listshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Mailman_mailing_lists Removing accesshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Removing_access Server power cyclinghttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Server_power_cycling Maps external usage requestshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty#Maps_external_usage_requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jehy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andreistroe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/HTTPS/Future_work *push them to caching frontends Scaling up SSL infrastructurehttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#Scaling_up_SSL_infrastructure Security enhancementshttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#Security_enhancements Performance enhancementshttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#Performance_enhancements Other considerationshttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#Other_considerations HTTPS by defaulthttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#HTTPS_by_default Server comparisonhttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#Server_comparison Whenhttps://wikitech.wikimedia.org/wiki/HTTPS/Future_work#When https://wikitech.wikimedia.org/wiki/Shell_Request/Yhager Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Entwickler37 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ralgis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peteforsyth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geoffarnold Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattmatt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Penn_Station Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrumeda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naveenpf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anonym Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ioannis_Protonotarios Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mpaa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emwiemaikel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alerkay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D9%85%D8%AD%D9%85%D8%AF_%D8%B4%D8%B9%DB%8C%D8%A8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nredigolo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/El_gran_Scott Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lilu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users It is possible, but not trivial, to rename a LDAP user account. The complication occurs mostly because multiple "primary" data stores all reference each other in interdependent ways. Prerequisiteshttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users#Prerequisites Rename the user in LDAPhttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users#Rename_the_user_in_LDAP Icingahttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users#Icinga Gerrithttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users#Gerrit Phabricatorhttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users#Phabricator Wikimedia Cloud Services (Horizon)https://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users#Wikimedia_Cloud_Services_(Horizon) https://wikitech.wikimedia.org/wiki/Shell_Request/%D8%A7%D9%84%D8%B3%D8%B9%D9%84%D8%A9_%D8%A7%D9%84%D8%B9%D8%A7%D9%84%D9%85%D9%8A Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Key_Wikimedia_software_projects Soft redirected pageshttps://wikitech.wikimedia.org/wiki/Category:Soft_redirected_pages https://wikitech.wikimedia.org/wiki/Shell_Request/Jo%C3%A3o_bonomo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ejegg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Creasy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Larrygloria0132 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hubtech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheNintendofan1209 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manuela Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siddharth_Patil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gpvos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jitse_Niesen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bcharles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sthottingal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Habatchii Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dirk_H%C3%BCnniger Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jagwar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FrAndy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chaosconst Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhumika.bharadia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gokulchandola Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lmcinnish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Equateur_ch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/R._Mednitzer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Samyak_bhuta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ytterbium ytterbium was the gerrit host since 2013-09-05 and was succeded by lead on 2016-07-25, [[[manganese]. Statushttps://wikitech.wikimedia.org/wiki/Ytterbium#Status https://wikitech.wikimedia.org/wiki/Shell_Request/Abi%C3%A1n Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reaper_Eternal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atest2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Paladox2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peaceray Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shabbir_Limdiwala Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dbellini Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hbalmes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Admindos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Porplemontage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment {{Ambox|text=For current information about Navigation Timing at Wikimedia, see Webperf#navtiming and [Navigation Timing API gets exact latency measurements from the browser. Experiment 1https://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Experiment_1 Goalhttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Goal Methodhttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Method Scripthttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Script Resultshttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Results Variant 1: defer work to $(document).readyhttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Variant_1:_defer_work_to_$(document).ready Variant 2: do busy work in sync script tag in headhttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Variant_2:_do_busy_work_in_sync_script_tag_in_head Experiment 2: slow vs. fast networkhttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Experiment_2:_slow_vs._fast_network Experiment 3: ResourceLoader Timinghttps://wikitech.wikimedia.org/wiki/Performance/Navigation_Timing_2013_Experiment#Experiment_3:_ResourceLoader_Timing https://wikitech.wikimedia.org/wiki/Shell_Request/Tiff_or_Nick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/APerson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rastus_Vernon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juanmi104 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jackmcbarn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smfarhad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rianjs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Waf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/YOUR1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Your1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Msanne704 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Toysofendearment Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FischTank Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robert.Labrie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stagingkai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aamin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sadbrute Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Willischen2013 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sucheta_Ghoshal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Plenz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sugandh_kumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LVilla_(WMF) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Sugandh_kumar Hi,My Name is Sugandh kumar.I live in patna. https://wikitech.wikimedia.org/wiki/Shell_Request/Christopherbattaglia3925 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prijoos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zfilipin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wudy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Luxfx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NE_Ent Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davidragan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jpfagerback Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Panos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Panoos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hedonil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Showzey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hellboy666onfire Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RLuts Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Calak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moin528 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/RFP_NfSen_Contractor RFP for a contractor for NfSen https://wikitech.wikimedia.org/wiki/Shell_Request/Sumanth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomesjs30 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Euroartsbd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jgrivolla Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Simeondahl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JAnstee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nakon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepanjan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pwirth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tweichart Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gunchat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GreenTara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yarl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Torty3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Otsoni Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manav_Akela Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sigbert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chapjones Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OSborn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mat%C4%9Bj_Such%C3%A1nek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattsmith321 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smuggli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Berinhardt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/555 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dkoukoul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dginev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sanjay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ProMobile Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sajog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Summiteventrentals Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ameerirshad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hillman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spacedeveloper Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zanaq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Idradm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Spares The tracking of spares has been migrated from the static wikitech page (here) to a google sheet that tracks more information (including warranty end date and such). Details for this depreciation can be found on this phabricator task. https://wikitech.wikimedia.org/wiki/Shell_Request/Luckyrand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Patcon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fannon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omsoftware Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sherief Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Southparkfan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NikiWiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Queentiffanny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haivu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ronisyahrony Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/George-s Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Webrequests_sampled The Requests stream is holding request logs from all caches. Availabilityhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Webrequests_sampled#Availability stat1002.eqiad.wmnet /a/squid/archive/sampledhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Webrequests_sampled#stat1002.eqiad.wmnet_/a/squid/archive/sampled Events and known problems since 2013-09-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Webrequests_sampled#Events_and_known_problems_since_2013-09-01 stat1002.eqiad.wmnet /a/log/webrequest/archive/sampledhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Webrequests_sampled#stat1002.eqiad.wmnet_/a/log/webrequest/archive/sampled Events and known problems since 2015-01-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Webrequests_sampled#Events_and_known_problems_since_2015-01-01 https://wikitech.wikimedia.org/wiki/Shell_Request/Hellboyonfire Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream The Mobile requests stream is holding request logs from the mobile caches. Contained datahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream#Contained_data Availabilityhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream#Availability stat1002.eqiad.wmnet /a/squid/archive/mobilehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream#stat1002.eqiad.wmnet_/a/squid/archive/mobile Events and known problems since 2013-09-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream#Events_and_known_problems_since_2013-09-01 stat1002.eqiad.wmnet /a/log/webrequest/archive/mobilehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream#stat1002.eqiad.wmnet_/a/log/webrequest/archive/mobile Events and known problems since 2015-01-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Mobile_requests_stream#Events_and_known_problems_since_2015-01-01 https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests The Zero requests stream is holding request logs from the mobile caches that got tagged as "zero". Contained datahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#Contained_data Availabilityhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#Availability stat1002.eqiad.wmnet /a/squid/archive/zerohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#stat1002.eqiad.wmnet_/a/squid/archive/zero Events and known problems since 2013-09-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#Events_and_known_problems_since_2013-09-01 stat1002.eqiad.wmnet /a/log/webrequest/archive/zerohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#stat1002.eqiad.wmnet_/a/log/webrequest/archive/zero Events and known problems since 2015-01-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#Events_and_known_problems_since_2015-01-01 Notehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Zero_webrequests#Note https://wikitech.wikimedia.org/wiki/X-Analytics X-Analytics is an HTTP header used for measurement purposes, including in cache log format and the webrequest data stream. Formathttps://wikitech.wikimedia.org/wiki/X-Analytics#Format Keyshttps://wikitech.wikimedia.org/wiki/X-Analytics#Keys Former keyshttps://wikitech.wikimedia.org/wiki/X-Analytics#Former_keys Codehttps://wikitech.wikimedia.org/wiki/X-Analytics#Code Extension documentationhttps://wikitech.wikimedia.org/wiki/X-Analytics#Extension_documentation Tasks and Bugshttps://wikitech.wikimedia.org/wiki/X-Analytics#Tasks_and_Bugs See alsohttps://wikitech.wikimedia.org/wiki/X-Analytics#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Severin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Process_Consult Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timekiller11 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yunmei313 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilalex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Msotirov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Richardkoike Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bpetty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuanbuyuan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DerFussi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrew_Maiman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Entlinkt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Larygloria0144 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ofoanler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oct Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Larygloria0156 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TimsonC2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boghog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nmarkov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zjabbari Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danielneri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Icode Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lambdafu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hassan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Toppainters Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mey2008 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raemes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Esrange Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rachel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jovander15 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DigitalGoetz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mario9662 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leloiandudu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB_Upgrade === MariaDB Upgrade === MariaDB Upgradehttps://wikitech.wikimedia.org/wiki/MariaDB_Upgrade#MariaDB_Upgrade https://wikitech.wikimedia.org/wiki/Shell_Request/Franciaio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Allouis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mogoeilor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Quiddity Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wagino_20100516 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Calcium == Services == Serviceshttps://wikitech.wikimedia.org/wiki/Calcium#Services https://wikitech.wikimedia.org/wiki/Carbon carbon was a TFTP install-server in eqiad. https://wikitech.wikimedia.org/wiki/Shell_Request/Raghunayyar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Capella capella is (as of April 2015) currently spare in codfw Historyhttps://wikitech.wikimedia.org/wiki/Capella#History https://wikitech.wikimedia.org/wiki/Chromium chromium is a Wikimedia Recursive DNS server (role::dns::recursor). Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server usage:Mischttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Misc Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Ekrem == Roles == Roleshttps://wikitech.wikimedia.org/wiki/Ekrem#Roles Serviceshttps://wikitech.wikimedia.org/wiki/Ekrem#Services https://wikitech.wikimedia.org/wiki/Erbium erbium is a Wikimedia log collector (role::logging). Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Eeden eeden is a Wikimedia Authoritative DNS server (authdns). (ns2. Esams data centerhttps://wikitech.wikimedia.org/wiki/Category:Esams_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Gadolinium gadolinium is a Wikimedia esams bits event logging to vanadium relay (misc::logging::relay::eventlogging). Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Shell_Request/Dev-zero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Hafnium hafnium was an EventLogging subscriber (role::eventlogging). Decom per [Former services == Former serviceshttps://wikitech.wikimedia.org/wiki/Hafnium#Former_services See alsohttps://wikitech.wikimedia.org/wiki/Hafnium#See_also https://wikitech.wikimedia.org/wiki/Harmon Harmon was... different. Decomhttps://wikitech.wikimedia.org/wiki/Harmon#Decom https://wikitech.wikimedia.org/wiki/Gurvin gurvin was a Wikimedia ISSLPv6 Proxy (ipv6proxy). Decomhttps://wikitech.wikimedia.org/wiki/Gurvin#Decom https://wikitech.wikimedia.org/wiki/Helium === Puppet roles === Puppet roleshttps://wikitech.wikimedia.org/wiki/Helium#Puppet_roles https://wikitech.wikimedia.org/wiki/Holmium holmium is a Wikimedia blog.wikimedia. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server usage:Mischttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Misc Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Hydrogen hydrogen is a Wikimedia Recursive DNS server (role::dns::recursor). Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server usage:Mischttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Misc Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Iodine iodine is a Wikimedia OTRS Web Application Server (role::otrs::webserver). Serviceshttps://wikitech.wikimedia.org/wiki/Iodine#Services https://wikitech.wikimedia.org/wiki/Shell_Request/Armando_Pacheco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KamranMackey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MistrX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zayantan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D9%84%D8%B7%D8%B1%D8%B4_%D8%A7%D8%AD%D9%85%D8%AF_%D8%A7%D9%84%D9%87%D8%A7%D8%B4%D9%85%D9%8A Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amalthea Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AalekhN Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Theonesean Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Crazycomputers Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nguyen_Duc_Hoang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nehagani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Charles_zeng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diptimoh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HYanWong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chrisabney Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dougwickle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sebrioth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mr.Z-man Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timothy_Gu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pepagajdos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Charitwo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Mexia mexia was a Wikimedia Authoritative DNS server (authdns). (ns1. Decomhttps://wikitech.wikimedia.org/wiki/Mexia#Decom https://wikitech.wikimedia.org/wiki/Rubidium rubidium was a Wikimedia Authoritative DNS server (authdns). (ns0. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Shell_Request/Raigo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Islander Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gerrit_Patch_Uploader Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rajachsvv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bennysitu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JuTa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manoel_afonso_da_silva Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shriti13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Performance Wikimedia Performance is an initiative to provide tools to analyze and improve the site performance of Wikipedia. We do this through a combination of live instrumentation, continuous monitoring, and debug profiling. Guideshttps://wikitech.wikimedia.org/wiki/Performance#Guides Toolshttps://wikitech.wikimedia.org/wiki/Performance#Tools Frontend synthetic testinghttps://wikitech.wikimedia.org/wiki/Performance#Frontend_synthetic_testing Frontend developmenthttps://wikitech.wikimedia.org/wiki/Performance#Frontend_development Frontend real-user traffichttps://wikitech.wikimedia.org/wiki/Performance#Frontend_real-user_traffic Analyze backend traffichttps://wikitech.wikimedia.org/wiki/Performance#Analyze_backend_traffic Backend developmenthttps://wikitech.wikimedia.org/wiki/Performance#Backend_development Public data and softwarehttps://wikitech.wikimedia.org/wiki/Performance#Public_data_and_software Essayshttps://wikitech.wikimedia.org/wiki/Performance#Essays External linkhttps://wikitech.wikimedia.org/wiki/Performance#External_link https://wikitech.wikimedia.org/wiki/Shell_Request/Revi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kurly2970 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fpigerre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SalimJah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fugimo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Duraseb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdd_2007 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Miller9904 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomw2005 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/R.k.mohapatra2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Samoalee12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nayer11 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kolavari Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pyr0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mc10 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cjpeople Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wilkinson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Myst Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mazandaran Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kkdubey1989 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Paulhandle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nanaki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkwind Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jephill2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Parker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Heddryin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Laurent_Jerry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rome2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frakir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ASammour Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zaher_kadour Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Helion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srikanth_Durbha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cherkaoui.mouad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Labs2_test_user Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jshm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Michaelyuwesoft Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Igorbeaz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ops:Templateeditor_right_for_enwiki All projectshttps://wikitech.wikimedia.org/wiki/Category:All_projects https://wikitech.wikimedia.org/wiki/Application_servers/Move_apache-config_to_tin October 2013 - list of crapola we need to do to move the last apache/deployment/config/etc stuff off fenari to tin Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Ahmed90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lonewolfstudio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Papasodaror Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jkrauska Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sindhukiranmai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tanvi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The_codebot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Humayun49 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Humayun499 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mmystry74 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kharoon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nan_deko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cillian.deRoiste Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/01tonythomas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ryasmeen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LaKing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepika Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjbrooks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sakshi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Matthewcutler9679 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jitendar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rcdeboer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarniakjr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Erjiang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kekomix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Monteirobrena Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kurniasan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sachi_gupta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RDBrown Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jjjjiijjjj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Drappmd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andyrom75 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oso96_2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20131030-Wikidata-ZeroRatedMobileAccess == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/20131030-Wikidata-ZeroRatedMobileAccess#Background What happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20131030-Wikidata-ZeroRatedMobileAccess#What_happened Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20131030-Wikidata-ZeroRatedMobileAccess#Timeline Recommendationshttps://wikitech.wikimedia.org/wiki/Incidents/20131030-Wikidata-ZeroRatedMobileAccess#Recommendations Follow-uphttps://wikitech.wikimedia.org/wiki/Incidents/20131030-Wikidata-ZeroRatedMobileAccess#Follow-up https://wikitech.wikimedia.org/wiki/Shell_Request/Sussahu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkowlzz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Staceyfiser1976 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Evandrix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HexaCore Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Durga94 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mayankmadan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Federico Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mariapacana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Natureshadow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/5xbe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pj100600 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pauls Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inchikutty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dragonfly Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JonasLundqvist Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lightswitch05 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SnowDragon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kolega2357 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20131104-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20131104-Parsoid#Summary What happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20131104-Parsoid#What_happened Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20131104-Parsoid#Timeline Recommendationshttps://wikitech.wikimedia.org/wiki/Incidents/20131104-Parsoid#Recommendations See alsohttps://wikitech.wikimedia.org/wiki/Incidents/20131104-Parsoid#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Jake1121 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tinaj1234 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ypnypn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phuedx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jwalling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Dickson.freenode.net Dickson, i.e. See alsohttps://wikitech.wikimedia.org/wiki/Dickson.freenode.net#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Aaronshaw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jakobj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Navdeep_Bagga Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dwhite21787 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arav93 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chmarkine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scottsdesk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RaymondYee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Virginia.weidhaas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Christian.dullweber Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexander.lehmann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moritz.Finke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Funcya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tchan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dkleinmann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Staeiou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rodrigo_Padula Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ineuw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Computermacgyver Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jodi.a.schneider Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdupont Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ayukaev28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dagwood Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Milara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joffemd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jpo742 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mcleodm3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nonban Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bkeegan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Behnam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chipdong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Utkarsh2012 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leila Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OSUBrit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mssemantics Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bublitzd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Libcub Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mcnabber091 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karineb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Viperwoman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexpeek1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Libcub2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Turicas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shashwat723 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vidhs28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mollybh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fhaidel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oliver.ferschke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frederico Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PierreSelim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tsikerdekis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Skyluke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frederik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Firilacroco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OTAVIO1981 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rodrisar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wertuose Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lekshmi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rudy752 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Csroychan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ymblanter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jhall Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tippytumbles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaare Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thrawn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alkamid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suchit3in Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aswn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Coet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jhidalgo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sbharti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shantanoo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20110926-PowerCable == What == Whathttps://wikitech.wikimedia.org/wiki/Incidents/20110926-PowerCable#What Causehttps://wikitech.wikimedia.org/wiki/Incidents/20110926-PowerCable#Cause Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20110926-PowerCable#Impact Mitigationhttps://wikitech.wikimedia.org/wiki/Incidents/20110926-PowerCable#Mitigation https://wikitech.wikimedia.org/wiki/Incidents/20110926-s7switchover ==What== Whathttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s7switchover#What Causehttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s7switchover#Cause Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s7switchover#Impact Mitigationhttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s7switchover#Mitigation https://wikitech.wikimedia.org/wiki/Incidents/20110926-s5switchover ==What== Whathttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s5switchover#What Causehttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s5switchover#Cause Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s5switchover#Impact Mitigationhttps://wikitech.wikimedia.org/wiki/Incidents/20110926-s5switchover#Mitigation https://wikitech.wikimedia.org/wiki/Logstash Logstash is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities. Overviewhttps://wikitech.wikimedia.org/wiki/Logstash#Overview OpenSearchhttps://wikitech.wikimedia.org/wiki/Logstash#OpenSearch Logstashhttps://wikitech.wikimedia.org/wiki/Logstash#Logstash OpenSearch Dashboardshttps://wikitech.wikimedia.org/wiki/Logstash#OpenSearch_Dashboards Kafkahttps://wikitech.wikimedia.org/wiki/Logstash#Kafka Rsysloghttps://wikitech.wikimedia.org/wiki/Logstash#Rsyslog OpenSearch quick introhttps://wikitech.wikimedia.org/wiki/Logstash#OpenSearch_quick_intro Systems feeding into logstashhttps://wikitech.wikimedia.org/wiki/Logstash#Systems_feeding_into_logstash Supported log shipping protocols & formats ("interfaces")https://wikitech.wikimedia.org/wiki/Logstash#Supported_log_shipping_protocols_&_formats_("interfaces") Kuberneteshttps://wikitech.wikimedia.org/wiki/Logstash#Kubernetes Systems not feeding into logstashhttps://wikitech.wikimedia.org/wiki/Logstash#Systems_not_feeding_into_logstash Writing & testing filtershttps://wikitech.wikimedia.org/wiki/Logstash#Writing_&_testing_filters Getting logs from misc systems into logstashhttps://wikitech.wikimedia.org/wiki/Logstash#Getting_logs_from_misc_systems_into_logstash Production Logstash Architecturehttps://wikitech.wikimedia.org/wiki/Logstash#Production_Logstash_Architecture Architecture Diagramhttps://wikitech.wikimedia.org/wiki/Logstash#Architecture_Diagram Web interfacehttps://wikitech.wikimedia.org/wiki/Logstash#Web_interface Authenticationhttps://wikitech.wikimedia.org/wiki/Logstash#Authentication Configurationhttps://wikitech.wikimedia.org/wiki/Logstash#Configuration Hostnameshttps://wikitech.wikimedia.org/wiki/Logstash#Hostnames Load Balancing and TLShttps://wikitech.wikimedia.org/wiki/Logstash#Load_Balancing_and_TLS Common Logging Schemahttps://wikitech.wikimedia.org/wiki/Logstash#Common_Logging_Schema APIhttps://wikitech.wikimedia.org/wiki/Logstash#API Extract data from Logstash (OpenSearch) with curl and jqhttps://wikitech.wikimedia.org/wiki/Logstash#Extract_data_from_Logstash_(OpenSearch)_with_curl_and_jq Pluginshttps://wikitech.wikimedia.org/wiki/Logstash#Plugins Plugin build processhttps://wikitech.wikimedia.org/wiki/Logstash#Plugin_build_process Deploymenthttps://wikitech.wikimedia.org/wiki/Logstash#Deployment Gotchashttps://wikitech.wikimedia.org/wiki/Logstash#Gotchas GELF transporthttps://wikitech.wikimedia.org/wiki/Logstash#GELF_transport Documentshttps://wikitech.wikimedia.org/wiki/Logstash#Documents Troubleshootinghttps://wikitech.wikimedia.org/wiki/Logstash#Troubleshooting Kafka consumer laghttps://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag Using the dead letter queuehttps://wikitech.wikimedia.org/wiki/Logstash#Using_the_dead_letter_queue Operationshttps://wikitech.wikimedia.org/wiki/Logstash#Operations Configuration changeshttps://wikitech.wikimedia.org/wiki/Logstash#Configuration_changes Test a configuration snippet before mergehttps://wikitech.wikimedia.org/wiki/Logstash#Test_a_configuration_snippet_before_merge Indexing errorshttps://wikitech.wikimedia.org/wiki/Logstash#Indexing_errors No logs indexedhttps://wikitech.wikimedia.org/wiki/Logstash#No_logs_indexed Drop spammy logshttps://wikitech.wikimedia.org/wiki/Logstash#Drop_spammy_logs UDP packet losshttps://wikitech.wikimedia.org/wiki/Logstash#UDP_packet_loss Replace failed disk and rebuild RAIDhttps://wikitech.wikimedia.org/wiki/Logstash#Replace_failed_disk_and_rebuild_RAID Restore Dashboards from backuphttps://wikitech.wikimedia.org/wiki/Logstash#Restore_Dashboards_from_backup Statshttps://wikitech.wikimedia.org/wiki/Logstash#Stats Documents and bytes countshttps://wikitech.wikimedia.org/wiki/Logstash#Documents_and_bytes_counts Data Retentionhttps://wikitech.wikimedia.org/wiki/Logstash#Data_Retention Extended Retentionhttps://wikitech.wikimedia.org/wiki/Logstash#Extended_Retention See alsohttps://wikitech.wikimedia.org/wiki/Logstash#See_also https://wikitech.wikimedia.org/wiki/Logstash/Tasks * Install Logstash stack in labs instance : http://logstash.instance-proxy. See alsohttps://wikitech.wikimedia.org/wiki/Logstash/Tasks#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/%CE%A3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jradd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lyumn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Simon04 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Parkaves Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lkozma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vladsv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/F%C3%A6 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bamyers99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haza-w Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JB567 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chandanpatro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gmt2001 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SMP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yufei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Erwin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MegaAlex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omshivaprakash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sumitzster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mhoover Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wmat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guoguo12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sushain97 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ojorgensen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rturlapati Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venomch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KWTech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mashiah_Davidson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HectorAE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aarcos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Areke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davidgumberg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tholam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ben Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Evan_M Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20131118-CirrusSearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20131118-CirrusSearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20131118-CirrusSearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20131118-CirrusSearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20131118-CirrusSearch#Actionables Bugs reported from this outagehttps://wikitech.wikimedia.org/wiki/Incidents/20131118-CirrusSearch#Bugs_reported_from_this_outage https://wikitech.wikimedia.org/wiki/Shell_Request/GlimmerPhoenix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Persia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TanviGupta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pp3345 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sniok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Schauer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chuckak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Christopher_Johnson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scimonster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M4tx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gtrainer108 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AlexanderGesinn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yamelnychuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jmcatani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wei2912 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jhertel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashleythenerd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shzad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kyle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AdityaSharmaMalladi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Expi1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RoelvandeMortel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NickelJohn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Richardll Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration == HDFS NameNodes == HDFS NameNodeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#HDFS_NameNodes Name Node Web Interfaceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Name_Node_Web_Interfaces HDFS Safe Modehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#HDFS_Safe_Mode Getting safemode statushttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Getting_safemode_status Entering safemodehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Entering_safemode Leaving safemodehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Leaving_safemode New NameNode Installationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#New_NameNode_Installation High Availabilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#High_Availability Manual Failoverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Manual_Failover Migrating to new HA NameNodeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Migrating_to_new_HA_NameNodes HDFS JournalNodeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#HDFS_JournalNodes Swap an existing Journal node with a new one in a running HA Hadoop Clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Swap_an_existing_Journal_node_with_a_new_one_in_a_running_HA_Hadoop_Cluster YARNhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#YARN YARN Job Browser Interfacehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#YARN_Job_Browser_Interface YARN Resource Managerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#YARN_Resource_Manager Yarn Labelshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Yarn_Labels Logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Logs Worker Nodeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Worker_Nodes Standard Worker Installationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Standard_Worker_Installation Standard Worker Reimagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Standard_Worker_Reimage Decommissioninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Decommissioning Excluding the host from HDFS and YARNhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Excluding_the_host_from_HDFS_and_YARN Removing the host from the HDFS topologyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Removing_the_host_from_the_HDFS_topology Proceed to decommission the host as per the regular procedurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Proceed_to_decommission_the_host_as_per_the_regular_procedure Balancing HDFShttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Balancing_HDFS Checking balanced-ness on HDFShttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Checking_balanced-ness_on_HDFS HDFS Balancer Cron Jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#HDFS_Balancer_Cron_Job Manually re-balancing HDFShttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Manually_re-balancing_HDFS HDFS mount at /mnt/hdfshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#HDFS_mount_at_/mnt/hdfs HDFS Namenode Heap settingshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#HDFS_Namenode_Heap_settings User Job taking too many resourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#User_Job_taking_too_many_resources Swapping broken diskhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Administration#Swapping_broken_disk https://wikitech.wikimedia.org/wiki/Shell_Request/.snoopy. Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akhil_T Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Get_involved If you are looking to get involved in improving the underlying infrastructure of Wikimedia projects, the Site Reliability Engineering (SRE) team may be just what you are looking for. Anyone can contribute to the effort to make Wikimedia's servers and software faster and more efficient. The SRE Teamhttps://wikitech.wikimedia.org/wiki/Get_involved#The_SRE_Team Server Infrastructurehttps://wikitech.wikimedia.org/wiki/Get_involved#Server_Infrastructure Code Repositoryhttps://wikitech.wikimedia.org/wiki/Get_involved#Code_Repository Skills Neededhttps://wikitech.wikimedia.org/wiki/Get_involved#Skills_Needed Permissions Neededhttps://wikitech.wikimedia.org/wiki/Get_involved#Permissions_Needed How to Find Taskshttps://wikitech.wikimedia.org/wiki/Get_involved#How_to_Find_Tasks How to Test Changeshttps://wikitech.wikimedia.org/wiki/Get_involved#How_to_Test_Changes How to Propose Changeshttps://wikitech.wikimedia.org/wiki/Get_involved#How_to_Propose_Changes https://wikitech.wikimedia.org/wiki/Shell_Request/Bitbytebit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Neon neon is a kubernetes::staging::master Serviceshttps://wikitech.wikimedia.org/wiki/Neon#Services Former Services on old host neonhttps://wikitech.wikimedia.org/wiki/Neon#Former_Services_on_old_host_neon https://wikitech.wikimedia.org/wiki/Tungsten tungsten was a misc server repurposed in various ways over the years. It was last used for XHGui. Connectinghttps://wikitech.wikimedia.org/wiki/Tungsten#Connecting Former serviceshttps://wikitech.wikimedia.org/wiki/Tungsten#Former_services https://wikitech.wikimedia.org/wiki/Shell_Request/Xlandroid666 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Water Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ffloeck Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Annabel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nandakumar96 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goodleinm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Niharika Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RAZVOR Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shakeelawaseem001 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frog23 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lsmll Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atethnekos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Voix- Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Renepick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robby Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jundergram Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aaron1011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JRhoads Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Husn_Shujaat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mohammedbas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boivie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hellboy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lethosor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ChiselBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tucoxn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LuaKT Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NativeForeigner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guerillero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D8%B9%D8%B1%D8%A7%D9%82%D9%8A1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sn1per Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jcf2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gr8kodr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DrCalculus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beegee-tokyo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jenkins-slave Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vldandrew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Merphant Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manu_yadv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AndrewX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Niharika29 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scottywong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andreeknilhcs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oleg_Alexandrov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LogsetGoran Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rabanks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhumbash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chaddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sharihareswara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lut4rp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Blink99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lordxeen46 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexandr_Efremov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madihaknwal786 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Linkdude101 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dllu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lluis_tgn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madihaknwal78 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madihaknwal7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gg4u Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smanikandan14 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeffreyjhang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Solomon7968 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raghsood Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Josh_Parris Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moursund Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Durgasubramanian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xiaomingyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gold0peace Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fluff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inductiveload Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Webstatscollector Webstatscollector was a set of services that computed unsampled hourly per page pageviews from udp2log. It powered pagecounts-raw until 2015-01-01. Architecturehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webstatscollector#Architecture Relevant sourceshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webstatscollector#Relevant_sources Updating and Deploying a New Versionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webstatscollector#Updating_and_Deploying_a_New_Version Used Page View definitionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webstatscollector#Used_Page_View_definition https://wikitech.wikimedia.org/wiki/Shell_Request/Arnaugir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reyaz_A Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vishrut Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wbm1058 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kambiz_Darabi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dmitry89 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Luckas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WikiAdmin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mopaydayloanstore Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elaragon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alaney2k Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daleyue Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lcmtwn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Masihakudisini Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20131205-Swift == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20131205-Swift#Summary What happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20131205-Swift#What_happened Lessons learnedhttps://wikitech.wikimedia.org/wiki/Incidents/20131205-Swift#Lessons_learned Actionshttps://wikitech.wikimedia.org/wiki/Incidents/20131205-Swift#Actions https://wikitech.wikimedia.org/wiki/Shell_Request/Vlad_John Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aloist Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naadya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anirudh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smith609 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cocu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sir_Lestaty_de_Lioncourt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Masonda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yatinmaan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sonet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Revolut1on1ze Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheOlympianZeus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lwoodyiii Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pere_prlpz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marcio_rodrigues Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ritu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bjarne Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/IlVan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Giumacedo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leaves_in_Motion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Operations ; Configuration Bot and monitoringhttps://wikitech.wikimedia.org/wiki/Category:Bot_and_monitoring https://wikitech.wikimedia.org/wiki/Shell_Request/Pho3nixHun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ssmith Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Duka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Puvanarajan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Margasovav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apsdehal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fabsouza1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SebSee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tokarev-ykt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Philias Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dshgna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xue_Fuqiao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gsahire Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Romaine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cmiller Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SirComputer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jino Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zhxsheng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ivanalzer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dmlovesu08 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zachia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Locino Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jisko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guybbb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nuria Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JakobVoss Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inefid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rzuwig Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kthx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ramzysamman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MEContreras Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ICeYmx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ni201512 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yellowcard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leaderboard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hayne_espedion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rilt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MSyed Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aquifacae Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Mingle Until April 2014,the Analytics team used a Thoughtworks provided Mingle instance to track its progress. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Christopher_Johnson_(WMDE) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vamston Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jmpcrunch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheOriginalSoni Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RashiqAhmad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maciej Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Showcase ==Background== Backgroundhttps://wikitech.wikimedia.org/wiki/Showcase#Background Proposalhttps://wikitech.wikimedia.org/wiki/Showcase#Proposal Participationhttps://wikitech.wikimedia.org/wiki/Showcase#Participation https://wikitech.wikimedia.org/wiki/Shell_Request/BassBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dwikimister Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cptanu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Markus.kosmal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vincentge Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alechko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Noamsp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hatul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Avavav1232 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thecohenoam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jossiekat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maccabi34 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yaron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ellaymil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Av3r4ge Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shiraz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lijealso Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Meeples10 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Murfel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JAn_Dud%C3%ADk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Laserprinter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ESC Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ori.levi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sapirgutman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mad_dr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tanyaguerra455 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vishnunk90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oferfi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anup_rockzz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Echetz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guesswho$ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Limormek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naoioue Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aviramabi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DHeyward Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jenkins-17 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Coral_nave Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tsahee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GeorgeBarnick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cryptomaniac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karipe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ertugrul_Bahtiyar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Avner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dura-Ace Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nicola.lonzi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JustTal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guy.oren Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Syst3mw0rm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Blop Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vimishor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DanieLionX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tangl922 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arieljannai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ohadkotler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomer.scles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ageblade Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Magister_Mathematicae Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omerisimo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dotan1988 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ariels Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Noam787 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haruko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MrMaker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rovack Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeongran.jang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KimiNewt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guydu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eliranefron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ethically_Yours Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dmtintner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Burgi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jbarta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomer.cd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rostim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/L%C3%A9na Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dekel_E Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chricho Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beegeesfan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AboHeidi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/3D-ICON Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Rsync_alternatives Rsync isn't the only game in town when it comes to high-performance bulk data transfers. https://wikitech.wikimedia.org/wiki/Shell_Request/Kartik1507 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chaumes55 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geek400 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D7%9C%D7%A2%D7%A8%D7%99_%D7%A8%D7%99%D7%99%D7%A0%D7%94%D7%90%D7%A8%D7%98 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anon126 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Colinmcnamara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alhages Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robertb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GolezTrol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CoderXpert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mudkip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Felixmo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JmdPpl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ross_Hill Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexroig Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lwsimpson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gomoko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Angelo_Michael Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kittypillai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tvandame Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dhofer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cargan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oswebsupport Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swiperrat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mno2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gilles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Draceane Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/HTTP_proxy To allow HTTP requests reach the outside world, we maintain a caching HTTP proxy in each datacenter. They are exposed using services entries of the form webproxy.. How-to?https://wikitech.wikimedia.org/wiki/HTTP_proxy#How-to? Helper commandshttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Helper_commands Manual confighttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Manual_config Internal endpointshttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Internal_endpoints APIhttps://wikitech.wikimedia.org/wiki/HTTP_proxy#API LiftWinghttps://wikitech.wikimedia.org/wiki/HTTP_proxy#LiftWing Example usagehttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Example_usage curlhttps://wikitech.wikimedia.org/wiki/HTTP_proxy#curl wgethttps://wikitech.wikimedia.org/wiki/HTTP_proxy#wget Maven proxy configuration examplehttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Maven_proxy_configuration_example anthttps://wikitech.wikimedia.org/wiki/HTTP_proxy#ant Sparkhttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Spark Monitoringhttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Monitoring Future/possible improvementshttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Future/possible_improvements Referencehttps://wikitech.wikimedia.org/wiki/HTTP_proxy#Reference See alsohttps://wikitech.wikimedia.org/wiki/HTTP_proxy#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Cesdeva Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/One_week_mini https://wikitech.wikimedia.org/wiki/Deployments/BetaNotes == Purpose == Purposehttps://wikitech.wikimedia.org/wiki/Deployments/BetaNotes#Purpose example 1https://wikitech.wikimedia.org/wiki/Deployments/BetaNotes#example_1 example 2https://wikitech.wikimedia.org/wiki/Deployments/BetaNotes#example_2 https://wikitech.wikimedia.org/wiki/Shell_Request/Hanteng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Openfancy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joancreus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jangra.pankaj9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grimlock Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NamilaPerera Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mushroom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Balasankarc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haffman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mohamed_Ouda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shubh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Imprevo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ivanalvzer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/1vanalvzer0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anoopcs9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adrian_Lang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umzegher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johntanner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harrybrock Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Titoncio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Navneet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pravin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yexiaoxing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Storm-pearl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anjanasasindran123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amruthasangeeth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rupitha_M Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kunal.scm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JurajNyiri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jonr1994 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive Apache Hive is an abstraction built on top of MapReduce that allows SQL to be used on various file formats stored in HDFS. WMF's first use case was to enable querying of unsampled webrequest logs. Usehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Use Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Access Queryinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Querying Maintained tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Maintained_tables Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Notes Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Troubleshooting Subpages ofhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#Subpages_of Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive#References https://wikitech.wikimedia.org/wiki/Shell_Request/Hcohl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rodion.goritskov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Choucalate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Quassy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mstknk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aftab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bebirchall Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barras Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davidwr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qitang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maxion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Satish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tumurochir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vivi-1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chaopeng888 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WikidataJenkins Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression == Uncompressed vs. Snappy compressed Sequence Files == Uncompressed vs. Snappy compressed Sequence Fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression#Uncompressed_vs._Snappy_compressed_Sequence_Files Uncompressedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression#Uncompressed Sizehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression#Size Query Timehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression#Query_Time Snappy compressed Sequence Fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression#Snappy_compressed_Sequence_Files Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Compression#Summary https://wikitech.wikimedia.org/wiki/Shell_Request/Guido.iaquinti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leitoxx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kinky69kiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mark_Lai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ind.shrawan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hroest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seaside98 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wingoli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alhawiti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hypertrek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SelimBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ibrahim.ID Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mustafa_Selim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joeytje50 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chrumps Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venky2834 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andydrop Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Exploreroot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Selvatamilancse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Saranya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reshma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vaibhavgupta1809 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nandinivelam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/J-squared Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qitang1811 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rothshahar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bachounda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilnitskiy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SunetraPandit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Panam2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wnt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ocean_behind_ears Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kunalgrover05 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adi.iiita Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014#By_month https://wikitech.wikimedia.org/wiki/Shell_Request/ScrimpyCat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Noodles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Makyen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BANKBAL90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Charles-salvia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GeovanniCabrera Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Check_ganglia }} Puppet Usagehttps://wikitech.wikimedia.org/wiki/Check_ganglia#Puppet_Usage CLI usagehttps://wikitech.wikimedia.org/wiki/Check_ganglia#CLI_usage Querying gmondhttps://wikitech.wikimedia.org/wiki/Check_ganglia#Querying_gmond Query gmetadhttps://wikitech.wikimedia.org/wiki/Check_ganglia#Query_gmetad https://wikitech.wikimedia.org/wiki/Shell_Request/Klaus_Gebhardt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jackfang123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/09u984rf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Csalvia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Load_balancing_architecture Originally created on January 2014, edited from a conversation between Roan Kattouw, Gabriel Wicke and Inez See alsohttps://wikitech.wikimedia.org/wiki/Load_balancing_architecture#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Welterkj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages This page documents the in-flight format for donation messages. Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Overview Headershttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Headers One-time donationshttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#One-time_donations Recurring PayPal donationshttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Recurring_PayPal_donations Recurring other gateway donationshttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Recurring_other_gateway_donations Refundshttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Refunds Unsubscribehttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Unsubscribe Damagedhttps://wikitech.wikimedia.org/wiki/Fundraising/Normalized_donation_messages#Damaged https://wikitech.wikimedia.org/wiki/Shell_Request/Savage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pasleim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Westurner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fnc4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RMoretti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D8%B9%D8%B1%D9%81%D8%A7%D9%86_%D8%A7%D8%B1%D8%B4%D8%AF Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Irfan_Arshad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Simpsons_0223 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Schwink Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Malik33 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thia2304 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ZeaForUs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robert_Roos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pgokhale Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Microchip08 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Praz007 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Divya.krishnan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Divya.krishna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moontan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Santhosh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/XenonX3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marleen_Olde_Hartmann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dirkandthemac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140121-BitsApplicationServers == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140121-BitsApplicationServers#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140121-BitsApplicationServers#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140121-BitsApplicationServers#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Sarre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Artturnip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ArturKlajnerok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jenkins-mwext-sync Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atlantis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%E0%A4%B8%E0%A4%82%E0%A4%A4%E0%A5%8B%E0%A4%B7_%E0%A4%A6%E0%A4%B9%E0%A4%BF%E0%A4%B5%E0%A4%B3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jlloyd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siiubuntu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Veera.sj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/-jem- Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Felixkaiser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prtksxna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeremy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pinkky Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sanyi4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jarondl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jatin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hardikj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Wikimedia_infrastructure == Current infographics == Current infographicshttps://wikitech.wikimedia.org/wiki/Wikimedia_infrastructure#Current_infographics https://wikitech.wikimedia.org/wiki/Shell_Request/Stefan_Weil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nickispeaki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GuyMontag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kuwaity26 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yannis.theodosopoulos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yasir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JonnyMSI Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ismail_suge Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kchandra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeff.manning Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mahi4you93 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zulu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jhunter13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Debenben Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chiborg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ipchu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moyalgol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stepzhou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Keanu73 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BharathMG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Donyu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/LibreNMS LibreNMS is an autodiscovering PHP/MySQL/SNMP based network monitoring which includes support for a wide range of network hardware and operating systems including Cisco, Linux, Juniper, Foundry, and many more. Servicehttps://wikitech.wikimedia.org/wiki/LibreNMS#Service How tohttps://wikitech.wikimedia.org/wiki/LibreNMS#How_to Add a device to LibreNMShttps://wikitech.wikimedia.org/wiki/LibreNMS#Add_a_device_to_LibreNMS Upgrade LibreNMShttps://wikitech.wikimedia.org/wiki/LibreNMS#Upgrade_LibreNMS Updating LibreNMS in our repositorieshttps://wikitech.wikimedia.org/wiki/LibreNMS#Updating_LibreNMS_in_our_repositories Cherry picking commits from upstream-$old into upstream-$newhttps://wikitech.wikimedia.org/wiki/LibreNMS#Cherry_picking_commits_from_upstream-$old_into_upstream-$new Updating LibreNMS in productionhttps://wikitech.wikimedia.org/wiki/LibreNMS#Updating_LibreNMS_in_production Backing up the LibreNMS databasehttps://wikitech.wikimedia.org/wiki/LibreNMS#Backing_up_the_LibreNMS_database Rollbackhttps://wikitech.wikimedia.org/wiki/LibreNMS#Rollback Check the logshttps://wikitech.wikimedia.org/wiki/LibreNMS#Check_the_logs Mass update PDU alerting thresholdshttps://wikitech.wikimedia.org/wiki/LibreNMS#Mass_update_PDU_alerting_thresholds Reduce pooling timehttps://wikitech.wikimedia.org/wiki/LibreNMS#Reduce_pooling_time Featureshttps://wikitech.wikimedia.org/wiki/LibreNMS#Features Interface groupinghttps://wikitech.wikimedia.org/wiki/LibreNMS#Interface_grouping Prometheus push-gatewayhttps://wikitech.wikimedia.org/wiki/LibreNMS#Prometheus_push-gateway Alertmanager integrationhttps://wikitech.wikimedia.org/wiki/LibreNMS#Alertmanager_integration Known limitationshttps://wikitech.wikimedia.org/wiki/LibreNMS#Known_limitations External linkshttps://wikitech.wikimedia.org/wiki/LibreNMS#External_links https://wikitech.wikimedia.org/wiki/Shell_Request/Mikima Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aihtnyc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ekborra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaltenbrunner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cdavis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boogheta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pawanseerwani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jacomyal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pregie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gpeid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mildused Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xb2u7Zjzc32 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Giuseppe_Sirugo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ticher777 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RepublicMaster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Corkythehornetfan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Imjacobclark Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brando90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RHaworth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CodeBlock Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abdullahalmati Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reelfiles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/C-M Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Torin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vpowerrc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leinaddm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deshank Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thiemo_M%C3%A4ttig_(WMDE) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140203-LVS copy/pasted from Mark's email to Ops list Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140203-LVS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140203-LVS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140203-LVS#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140203-LVS#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/9emE0iL18gxCqLT Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marco74 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emijrp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Etienne Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Incelemeelemani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/G_Magni Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sanka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neutron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WikidataBuilder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Math/drmf = February 6, 2014 — DRMF meeting = February 6, 2014 — DRMF meetinghttps://wikitech.wikimedia.org/wiki/Math/drmf#February_6,_2014_—_DRMF_meeting February 7, 2014 — Meet and Greet with Marlon Pierce, IU, XSEDEhttps://wikitech.wikimedia.org/wiki/Math/drmf#February_7,_2014_—_Meet_and_Greet_with_Marlon_Pierce,_IU,_XSEDE February 10, 2014 — Discussion with Moritz Schubotzhttps://wikitech.wikimedia.org/wiki/Math/drmf#February_10,_2014_—_Discussion_with_Moritz_Schubotz February 19, 2014 — Discussion with Moritzhttps://wikitech.wikimedia.org/wiki/Math/drmf#February_19,_2014_—_Discussion_with_Moritz March 27, 2014 — DRMF meetinghttps://wikitech.wikimedia.org/wiki/Math/drmf#March_27,_2014_—_DRMF_meeting April 2, 2014 — Teleconference with XSEDE staffhttps://wikitech.wikimedia.org/wiki/Math/drmf#April_2,_2014_—_Teleconference_with_XSEDE_staff April 16, 2014 — Teleconference with Moritzhttps://wikitech.wikimedia.org/wiki/Math/drmf#April_16,_2014_—_Teleconference_with_Moritz April 17, 2014 — DRMF meetinghttps://wikitech.wikimedia.org/wiki/Math/drmf#April_17,_2014_—_DRMF_meeting May 12, 2014 — Teleconference(s) with Moritz Schubotzhttps://wikitech.wikimedia.org/wiki/Math/drmf#May_12,_2014_—_Teleconference(s)_with_Moritz_Schubotz June 23, 2014 — Teleconference with Moritz Schubotzhttps://wikitech.wikimedia.org/wiki/Math/drmf#June_23,_2014_—_Teleconference_with_Moritz_Schubotz June 24, 2014 — Teleconference with Moritz Schubotzhttps://wikitech.wikimedia.org/wiki/Math/drmf#June_24,_2014_—_Teleconference_with_Moritz_Schubotz July 24, 2014 — DRMF meetinghttps://wikitech.wikimedia.org/wiki/Math/drmf#July_24,_2014_—_DRMF_meeting October 16, 2014 — DRMF meetinghttps://wikitech.wikimedia.org/wiki/Math/drmf#October_16,_2014_—_DRMF_meeting https://wikitech.wikimedia.org/wiki/Kafka/Administration == Safe Broker Restarts == Safe Broker Restartshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Safe_Broker_Restarts Network switch restarts; or, groups of Kafka brokers offlinehttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Network_switch_restarts;_or,_groups_of_Kafka_brokers_offline Replica Electionshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Replica_Elections Verify the leader of a topichttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Verify_the_leader_of_a_topic Alter topic partitions numberhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Alter_topic_partitions_number Alter topic retention settingshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Alter_topic_retention_settings Delete a topichttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Delete_a_topic Handling a downed brokerhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Handling_a_downed_broker Recovering a laggy broker replicahttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Recovering_a_laggy_broker_replica num.replica.fetchershttps://wikitech.wikimedia.org/wiki/Kafka/Administration#num.replica.fetchers replica.fetch.max.byteshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#replica.fetch.max.bytes Checking consumer offsetshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Checking_consumer_offsets CLIhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#CLI Purge broker logshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Purge_broker_logs Temporarily Modify Per Topic Retention Settingshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Temporarily_Modify_Per_Topic_Retention_Settings Temporarily Edit Global Retention Settingshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Temporarily_Edit_Global_Retention_Settings Kafka Certificateshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Kafka_Certificates Kafka ACLshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Kafka_ACLs Swapping broken diskhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Swapping_broken_disk Upgrade Checklisthttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Upgrade_Checklist MirrorMakerhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#MirrorMaker main mirroringhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#main_mirroring jumbo mirroringhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#jumbo_mirroring Broker Migrationshttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Broker_Migrations Kafka-logginghttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Kafka-logging Rebalance topic partitions to new brokershttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Rebalance_topic_partitions_to_new_brokers Rebalance topic partitions to equalize broker storagehttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Rebalance_topic_partitions_to_equalize_broker_storage Rebalance topic partitions to equalize broker throughputhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Rebalance_topic_partitions_to_equalize_broker_throughput Rollback/Stop topic partitions rebalancehttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Rollback/Stop_topic_partitions_rebalance Renew TLS certificatehttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Renew_TLS_certificate Is there a way to reload the keystores without restarting?https://wikitech.wikimedia.org/wiki/Kafka/Administration#Is_there_a_way_to_reload_the_keystores_without_restarting? Increase a topic's replication factorhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Increase_a_topic's_replication_factor Hardware replace a brokerhttps://wikitech.wikimedia.org/wiki/Kafka/Administration#Hardware_replace_a_broker https://wikitech.wikimedia.org/wiki/Dbtree.wikimedia.org dbtree.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Dbtree.wikimedia.org#Service Deployhttps://wikitech.wikimedia.org/wiki/Dbtree.wikimedia.org#Deploy See alsohttps://wikitech.wikimedia.org/wiki/Dbtree.wikimedia.org#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Itmdco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Junjunc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shinnoki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aldnonymous Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lynnvo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sandeepvignesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nazmul02 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/QpSHiNqp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smw_lana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cklim074 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FMorifuji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhinandan_Bhattacharjee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dungodung Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tlevine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HACKER_WITH_FIRE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chococookies Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aizhuli90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hchuying Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johnmclear Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vandewilly Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gvemula Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elena.renda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/RT/Reporting_issues == How to report an issue via RT == How to report an issue via RThttps://wikitech.wikimedia.org/wiki/RT/Reporting_issues#How_to_report_an_issue_via_RT Reporting an issuehttps://wikitech.wikimedia.org/wiki/RT/Reporting_issues#Reporting_an_issue Following an issuehttps://wikitech.wikimedia.org/wiki/RT/Reporting_issues#Following_an_issue Who to ask about new ticketshttps://wikitech.wikimedia.org/wiki/RT/Reporting_issues#Who_to_ask_about_new_tickets https://wikitech.wikimedia.org/wiki/Shell_Request/Leilaz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robertasinatra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yucesoyb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emreg00 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/S4intlion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Henry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sahar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140206-Math == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140206-Math#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140206-Math#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140206-Math#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140206-Math#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Espreon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tariuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akshay_tiwari Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Criedl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krusher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Patchon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaiserincarla13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Punitkoura Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Monitoring Monitoring is a multi-faceted topic covering testing and collecting metrics to audit the availability and performance of networks, servers, and clustered applications, as well as processing collected data for fault detection, notification, graphing, capacity planning, and analytics. Stakeholdershttps://wikitech.wikimedia.org/wiki/Monitoring#Stakeholders Goalshttps://wikitech.wikimedia.org/wiki/Monitoring#Goals Designhttps://wikitech.wikimedia.org/wiki/Monitoring#Design Art, Sciencehttps://wikitech.wikimedia.org/wiki/Monitoring#Art,_Science Componentshttps://wikitech.wikimedia.org/wiki/Monitoring#Components Targetshttps://wikitech.wikimedia.org/wiki/Monitoring#Targets Implementationhttps://wikitech.wikimedia.org/wiki/Monitoring#Implementation Available toolshttps://wikitech.wikimedia.org/wiki/Monitoring#Available_tools Current generationhttps://wikitech.wikimedia.org/wiki/Monitoring#Current_generation Next generationhttps://wikitech.wikimedia.org/wiki/Monitoring#Next_generation Desiredhttps://wikitech.wikimedia.org/wiki/Monitoring#Desired Recommendedhttps://wikitech.wikimedia.org/wiki/Monitoring#Recommended External linkshttps://wikitech.wikimedia.org/wiki/Monitoring#External_links See alsohttps://wikitech.wikimedia.org/wiki/Monitoring#See_also Subpageshttps://wikitech.wikimedia.org/wiki/Monitoring#Subpages https://wikitech.wikimedia.org/wiki/Shell_Request/Harsha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Navin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Norayr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepali Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nonox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freescran Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roycwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ysangkok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harsha3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beane Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ema Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hassen.Houssein Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjnovice Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140211-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140211-Parsoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140211-Parsoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140211-Parsoid#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140211-Parsoid#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Ryan2758 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zeetherocker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pdev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nickdoherty81 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Snow8261 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahulpatidarr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kisses888 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Projekt_ANA Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fatemi127 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JordanKyser22 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roman_Tsukanov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ritu_S Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apond95 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nicole Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fsainsbu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Tendril }} Servicehttps://wikitech.wikimedia.org/wiki/Tendril#Service Featureshttps://wikitech.wikimedia.org/wiki/Tendril#Features Reportshttps://wikitech.wikimedia.org/wiki/Tendril#Reports Replication treehttps://wikitech.wikimedia.org/wiki/Tendril#Replication_tree Host viewerhttps://wikitech.wikimedia.org/wiki/Tendril#Host_viewer Service dependencieshttps://wikitech.wikimedia.org/wiki/Tendril#Service_dependencies See alsohttps://wikitech.wikimedia.org/wiki/Tendril#See_also External linkhttps://wikitech.wikimedia.org/wiki/Tendril#External_link https://wikitech.wikimedia.org/wiki/Shell_Request/NintendoFan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ds406 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Binar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rupitha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kgraney Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gdanielwesley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dguerrar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Titodutta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Search/lsearchd_inventory In February 2014 we decided to look at what we're using in lsearchd with an eye to what can be reallocated to Elasticsearch. This page serves to document each server's status. https://wikitech.wikimedia.org/wiki/Shell_Request/Scottlee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ZhouX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mother_Zhou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yudd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mballard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VRBank_im_Kreis_Rendsburg_eG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pianogould Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dnaber Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freshsmuse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkbyte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ggospodinov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anand21nanda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scott_Martin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation Fundraising and Analytics both use IP geolocation to better understand how users behave and how best to interact with them. Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#Data Access and formatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#Access_and_formats Raw datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#Raw_data Librarieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#Libraries Command-line utilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#Command-line_utility Example functionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#Example_functions Rhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Geolocation#R https://wikitech.wikimedia.org/wiki/Shell_Request/Cgallardoalba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Terrynguyen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vincenzo_Laudizio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Withoutaname Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chedasaurus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ameen.Akbar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rush Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chasemp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danorton Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mayur_Kothari Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rezonansowy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VityUvieu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GBT248 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Green_Giant Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nachaz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Caio1478 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dharmana.prudhvi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Giuliano Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akeron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CFricks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nicotnik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tim_Landscheidt_(Test_2) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sdm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vikas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jdumouchel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhinandan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ingenierouga Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MTK81249 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wenquan.zhong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mess Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The4DGovernment Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alina8989 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tahir_mq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gmansi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diwanshipandey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JaimeLyn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Memethief Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ariconte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anirudh24seven Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aisyah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sandaru Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Soccer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kalyansriram Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tdu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jmedved Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MrDmitriy65 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattorange Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Er.varunbansal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Newyorkadam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Motahreh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akashagarwal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nemith Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SamB Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sonalgupta011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vikassy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shobhit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aboyarski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boulli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/8ohit.dua Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rbaior Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Santosh2201 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Risto_Nordman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boa0332 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prince_Oyelami_Babatunde Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carnevalegiacomo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Greg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yarda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mep62 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashe540 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aboluay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goldenburg111 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jagori79 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jlemley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Otech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tejuforvasu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NigelSoft Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Remilram Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timpal13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xfer8850 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rotpunkt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JACKHORROR Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lepidoptera Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oorestisime Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruchita Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahul_mishra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sahildua2305 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ranjithraj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nordyorn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gdeva Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Enichesol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nitika26 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Durgeshsuthar92 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zahara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mugsy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import This is a proposed extension to CiviCRM, which will facilitate decoupled payment processing and event registration, nightly auditing of donations, and importing from spreadsheet. Intake moduleshttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Intake_modules Messaginghttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Messaging CSVhttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#CSV Auditinghttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Auditing Exception handlinghttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Exception_handling Metadatahttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Metadata Fundraising deploymenthttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Fundraising_deployment Data retentionhttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#Data_retention See alsohttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Abstract_CRM_import#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Pharos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yoloswag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Halvors Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GitMedWiki14 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rlb408 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tools-info Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva Apache Archiva is a Maven Build Artifact Repository Manager, similar to Nexus and Artifactory. WMF uses Archiva as its sole Java build repository, and uses it in a unique way for production deployments of artifacts via Scap and git-fat. Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Setup Repositorieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Repositories Developmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Development Setup a master passwordhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Setup_a_master_password Using pom.xmlhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Using_pom.xml Using settings.xmlhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Using_settings.xml Deploy to Archivahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Deploy_to_Archiva Deploy artifacts using scap3https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Deploy_artifacts_using_scap3 Setting up git-fat for your projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Setting_up_git-fat_for_your_project Initializing git-fat for a new clone of an already configured repositoryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Initializing_git-fat_for_a_new_clone_of_an_already_configured_repository Initializing git-fat for the first time on your repositoryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Initializing_git-fat_for_the_first_time_on_your_repository Adding an artifact to your projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Adding_an_artifact_to_your_project Deploying your project and artifacts using scap3https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Deploying_your_project_and_artifacts_using_scap3 Uploading dependency artifactshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Uploading_dependency_artifacts Uploading jars with shttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Uploading_jars_with_s Using new Let's Encrypt SSL certshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Using_new_Let's_Encrypt_SSL_certs Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Administration Upgradehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Upgrade Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Configuration Backupshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Archiva#Backups https://wikitech.wikimedia.org/wiki/Shell_Request/Mohhamad_Rehan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/RFC/Direct_Mail_Appeal_campaign_management This is a specification for a new feature to allow Fundraising Major Gifts to set up their own Direct Mail appeals. Backgroundhttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Direct_Mail_Appeal_campaign_management#Background Basic requirementshttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Direct_Mail_Appeal_campaign_management#Basic_requirements Additional developmenthttps://wikitech.wikimedia.org/wiki/Fundraising/RFC/Direct_Mail_Appeal_campaign_management#Additional_development https://wikitech.wikimedia.org/wiki/Shell_Request/Jeremylee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Machiaweliczny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umang13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AusShowjumping Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prod Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdgreenb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ppdouble Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thamiziniyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tuxnani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/L10nupdate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TBloemink Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karan100 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pubudu538 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/XXN Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bo.mi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pavanaja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Psubhashish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nitika.t Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mvolz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M0tty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robolobster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rxy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Backport_windows Backport windows are set times for Wikimedia production deployments, are done by a member(s) of the backport deploy team (see below). Despite the name, they are used for configuration changes to production wikis as well as backports. Guidelineshttps://wikitech.wikimedia.org/wiki/Backport_windows#Guidelines How to submit a patch for backporthttps://wikitech.wikimedia.org/wiki/Backport_windows#How_to_submit_a_patch_for_backport Submitting a manual cherry-pickhttps://wikitech.wikimedia.org/wiki/Backport_windows#Submitting_a_manual_cherry-pick Doing the deployhttps://wikitech.wikimedia.org/wiki/Backport_windows#Doing_the_deploy Backport Team members' roles, responsibilities, and tipshttps://wikitech.wikimedia.org/wiki/Backport_windows#Backport_Team_members'_roles,_responsibilities,_and_tips Trusthttps://wikitech.wikimedia.org/wiki/Backport_windows#Trust Knowledgehttps://wikitech.wikimedia.org/wiki/Backport_windows#Knowledge Decisivenesshttps://wikitech.wikimedia.org/wiki/Backport_windows#Decisiveness New Backport Team member check-listhttps://wikitech.wikimedia.org/wiki/Backport_windows#New_Backport_Team_member_check-list Subpageshttps://wikitech.wikimedia.org/wiki/Backport_windows#Subpages https://wikitech.wikimedia.org/wiki/Shell_Request/Nikitsaraf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CeeGee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maduranga Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nilchhay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dynamicwork Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jjanes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140313-API-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140313-API-Parsoid#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140313-API-Parsoid#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/ImPacific Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/YehudaDe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wangdfc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Dumps.wikimedia.org dumps.wikimedia. External linkhttps://wikitech.wikimedia.org/wiki/Dumps.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Releases.wikimedia.org releases.wikimedia. Debian repositoryhttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Debian_repository Upload a packagehttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Upload_a_package Use the repositoryhttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Use_the_repository Add a distrohttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Add_a_distro Running reprepro commandshttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Running_reprepro_commands GPG operationshttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#GPG_operations Generate a new keyhttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Generate_a_new_key Refresh signatureshttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#Refresh_signatures External linkhttps://wikitech.wikimedia.org/wiki/Releases.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Shell_Request/Nknudsen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frank_Geerlings Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sms2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AkshataDM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lil%27_Miss_Rarity Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arvindch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scooter7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23 == December 31 == December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_29 December 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_28 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_27 December 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_26 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#October_1 September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_28 August 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_27 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_9 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_8 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_23#August_1 https://wikitech.wikimedia.org/wiki/Shell_Request/Shrees Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mnyore Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Riser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zerabat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AndMG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity As of March 2014, 2 Kafka brokers in eqiad are being sent webrequest logs from bits and mobile varnishes. This data maxes at around 50,000 messages/second and 9 MB/second. Current Eqiad Setuphttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Current_Eqiad_Setup Memory Usagehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Memory_Usage CPU Loadhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#CPU_Load Disk Usagehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Disk_Usage Throughputhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Throughput Storagehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Storage Transatlantic throughputhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Transatlantic_throughput Hardware Requestshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Hardware_Requests eqiadhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#eqiad New (primary) Datacenterhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#New_(primary)_Datacenter Caching Datacentershttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kafka/Capacity#Caching_Datacenters https://wikitech.wikimedia.org/wiki/Shell_Request/Paracel63 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Monitoring_sources An enumeration of all sources of monitoring data Bot and monitoringhttps://wikitech.wikimedia.org/wiki/Category:Bot_and_monitoring Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Shell_Request/SuperSymmetry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Younipro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hawkeye7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gopalkoduri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Agathoclea Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Otis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Charithyak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/IiDemon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yantoheri634 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peteruetz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cliveverghese Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joynathrava Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harpagornis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mr._Stradivarius Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140113-Poolcounter == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140113-Poolcounter#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140113-Poolcounter#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140113-Poolcounter#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20140313-Deploy == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140313-Deploy#Summary First occurence - March 13thhttps://wikitech.wikimedia.org/wiki/Incidents/20140313-Deploy#First_occurence_-_March_13th Second - March 19thhttps://wikitech.wikimedia.org/wiki/Incidents/20140313-Deploy#Second_-_March_19th Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140313-Deploy#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Rhpsystems Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140228-Cirrus == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140228-Cirrus#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140228-Cirrus#Timeline Explanationhttps://wikitech.wikimedia.org/wiki/Incidents/20140228-Cirrus#Explanation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140228-Cirrus#Actionables https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403 = Quarterly Review of post-mortems - 2014-03 = Quarterly Review of post-mortems - 2014-03https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#Quarterly_Review_of_post-mortems_-_2014-03 Questions we want to be able to answerhttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#Questions_we_want_to_be_able_to_answer Agendahttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#Agenda The post mortemshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#The_post_mortems site outage ~ 2014-01-11 22:10 UTChttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#site_outage_~_2014-01-11_22:10_UTC ../20140113-Poolcounter/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140113-Poolcounter/ ../20140203-LVS/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140203-LVS/ ../20131205-Swift/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20131205-Swift/ ../20140206-Math/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140206-Math/ ../20140211-Parsoid/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140211-Parsoid/ ../20140228-Cirrus/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140228-Cirrus/ ../20140313-API-Parsoid/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140313-API-Parsoid/ ../20140313-Deploy/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201403#../20140313-Deploy/ https://wikitech.wikimedia.org/wiki/Shell_Request/Sishangu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Severin_Anatoliy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xiaoxiangquan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ryanx7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wgachi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Justin_ZW Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ChristofferH Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Virendra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xiawj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Integration.wikimedia.org integration.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Integration.wikimedia.org#Service Deploymenthttps://wikitech.wikimedia.org/wiki/Integration.wikimedia.org#Deployment See alsohttps://wikitech.wikimedia.org/wiki/Integration.wikimedia.org#See_also External linkhttps://wikitech.wikimedia.org/wiki/Integration.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Doc.wikimedia.org doc.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Service Architecturehttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Architecture Landing pageshttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Landing_pages Micrositeshttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Microsites Publishinghttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Publishing Cachinghttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Caching Runbookhttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Runbook Switch primary hosthttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Switch_primary_host Deploy landing pagehttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#Deploy_landing_page See alsohttps://wikitech.wikimedia.org/wiki/Doc.wikimedia.org#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Mdowdell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Violetto Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ejeffers.bur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Perohanych Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mitchelln Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarveshgpt1991 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/(euer_Kraftf%C3%BChrer) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmatta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apoorvu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Feedintm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/J%C3%B6rg_Wiegels Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krassotkin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hoboristi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rishy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Michele_Fella Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gloriawick1181 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gotno Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Besi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cortina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jkendall Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Olexandertimkov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Olexander_Timkov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sahehco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Underlying_lk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fish_storm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Zookeeper Zookeeper is used by Analytics systems like Hadoop and Druid, and for Kafka. Clustershttps://wikitech.wikimedia.org/wiki/Zookeeper#Clusters Packaginghttps://wikitech.wikimedia.org/wiki/Zookeeper#Packaging Changing Zookeeper IP addresseshttps://wikitech.wikimedia.org/wiki/Zookeeper#Changing_Zookeeper_IP_addresses https://wikitech.wikimedia.org/wiki/Zookeeper/Administration Content on this page has been moved to Zookeeper https://wikitech.wikimedia.org/wiki/Shell_Request/Theduderog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Doc_Taxon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Balbeko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NightParrot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sdbck Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Acstech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stanlekub Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DeanthonyTaylor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DavidCary Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JustJustin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cyde Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OlEnglish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dongmok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anskar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robert_vinet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Giuseppe_Lavagetto Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bluma.Gelley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xudong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140328-DB-Queries == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140328-DB-Queries#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140328-DB-Queries#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140328-DB-Queries#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140328-DB-Queries#Actionables Warningshttps://wikitech.wikimedia.org/wiki/Incidents/20140328-DB-Queries#Warnings https://wikitech.wikimedia.org/wiki/Shell_Request/Anorange0409 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krzysztof.kluczynski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eternalworm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ZelOD Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vikesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Salembream Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Putnik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rogerio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fconaway Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Retsam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joshdcomp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Morisdov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Db-robot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vichoos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy#Timeline Roanhttps://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy#Roan Niklashttps://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy#Niklas Bryanhttps://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy#Bryan Actionshttps://wikitech.wikimedia.org/wiki/Incidents/20140403-Deploy#Actions https://wikitech.wikimedia.org/wiki/Shell_Request/Naoinoue Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smtchahal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RB_ASHISH Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ryush00 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TeddyJC Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lee_Miller Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tzav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bralex1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Silver_Spoon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daursas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dan.bellandi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daggi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jliu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140318-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140318-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140318-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140318-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140318-EventLogging#Actionables Referenceshttps://wikitech.wikimedia.org/wiki/Incidents/20140318-EventLogging#References https://wikitech.wikimedia.org/wiki/Shell_Request/JimmyLi97 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kongrath Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ahmad.aea.99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Filippo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Filippo_Giunchedi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fbstj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gallaecio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maintenance-bot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PhiLiP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Morray Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sh3nhu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjaiswal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flappybirdcheats Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xpddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emassip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lenkd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dsulej Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Blakroku Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dcirovic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abu_Raihan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peterh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Preillyme Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joseph Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Devarsh_thakkar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Natanael Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ianalis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chirag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gleki.arxokuna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stevenroddis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cubozoa1980 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xhlv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Happychen0903 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepwaterdivernw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taueres Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oilpullingcoconutoil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ZHK_BLUE_ROSE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akkakk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Karibekov_Vladislav_Y. Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sivashanmugam.K Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Patrikelias414 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sandeep_kedari Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sheb-habil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hyacinth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jblz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sirtomash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alsilebi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atgomez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oxygen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nosy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omar_kimg-0z Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bennkenn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access In addition to a variety of [data sources], Wikimedia has a parallel set of private data sources. The main reason is to allows a carefully vetted set of users to perform research and analysis on confidential user data (such as the IP addresses of readers and editors) which is stored according to our [policy] and [retention guidelines]. Do you need it?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Do_you_need_it? User responsibilitieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#User_responsibilities Requesting accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Requesting_access Access Levelshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Access_Levels What access should I request?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#What_access_should_I_request? Dashboards in web tools like Turnilo and/or Superset that do not access private datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Dashboards_in_web_tools_like_Turnilo_and/or_Superset_that_do_not_access_private_data Dashboards in Superset / Hive interfaces (like Hue) that do access private datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Dashboards_in_Superset_/_Hive_interfaces_(like_Hue)_that_do_access_private_data ssh login to analytics client servers (AKA stat boxes) without Hadoop, Hive, Presto accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#ssh_login_to_analytics_client_servers_(AKA_stat_boxes)_without_Hadoop,_Hive,_Presto_access ssh login to analytics client servers (AKA stat boxes) with Hadoop, Hive, Presto accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#ssh_login_to_analytics_client_servers_(AKA_stat_boxes)_with_Hadoop,_Hive,_Presto_access All of the abovehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#All_of_the_above Analytics shell (posix) groups explainedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Analytics_shell_(posix)_groups_explained Generic data access (can go together with the Team specific ones)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Generic_data_access_(can_go_together_with_the_Team_specific_ones) Team specific (they do not grant access to PII data on Hadoop, for that see analytics-privatedata-users)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Team_specific_(they_do_not_grant_access_to_PII_data_on_Hadoop,_for_that_see_analytics-privatedata-users) Groups to avoid (deprecated)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Groups_to_avoid_(deprecated) Host access grantedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Host_access_granted Data access grantedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Data_access_granted Shell access expirationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Shell_access_expiration LDAP accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#LDAP_access Accounts and passwords explained: LDAP/Wikitech/MW Developer vs shell/ssh/posix vs Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Accounts_and_passwords_explained:_LDAP/Wikitech/MW_Developer_vs_shell/ssh/posix_vs_Kerberos tl;drhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#tl;dr LDAPhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#LDAP POSIXhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#POSIX Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Kerberos https://wikitech.wikimedia.org/wiki/Shell_Request/Ana27 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frankenstone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vijayee.kulkaa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Celiaf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Msaunier Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fatib Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Puppet_3.x_migration Migration from puppet 2.7. Things to watch out forhttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Things_to_watch_out_for Dynamic scope is gonehttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Dynamic_scope_is_gone Dashes in class names are not allowedhttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Dashes_in_class_names_are_not_allowed Templates should be written correctlyhttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Templates_should_be_written_correctly Custom function argument must always be an arrayhttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Custom_function_argument_must_always_be_an_array Puppet Catalogs compilerhttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Puppet_Catalogs_compiler Preparing the environmenthttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Preparing_the_environment Default node selectionhttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#Default_node_selection Licensehttps://wikitech.wikimedia.org/wiki/Puppet_3.x_migration#License https://wikitech.wikimedia.org/wiki/Shell_Request/Zilch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DerHexer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The_Herald Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%E0%A4%B8%E0%A4%82%E0%A4%9C%E0%A5%80%E0%A4%B5_%E0%A4%95%E0%A5%81%E0%A4%AE%E0%A4%BE%E0%A4%B0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kevinator Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Erne_Mogilevich Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%3D Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Song%C3%BCl_%C5%9Eahin_Ayg%C3%BCn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_Drupal __TOC__ Creating a Drupal upgrade patchhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_Drupal#Creating_a_Drupal_upgrade_patch Deploying a Drupal upgradehttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_Drupal#Deploying_a_Drupal_upgrade CiviCRM upgradehttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_Drupal#CiviCRM_upgrade See alsohttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_Drupal#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Dbrant Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AntanO Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bkfunk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arjun024 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rcbutcher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Csharonbb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jorge.Contreras Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lvii Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashok_Vignesh_K Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dario77 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gallilama Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Correogsk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kiwiroy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sitebotthink Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hoahm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Search/Rebuilds We'll use this to track rebuilds that are required. https://wikitech.wikimedia.org/wiki/Fundraising/tech/crm https://wikitech.wikimedia.org/wiki/Fundraising/analytics https://wikitech.wikimedia.org/wiki/Shell_Request/David_Winslow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suresh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PeterFisk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ptaff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Schutz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Azimut2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sexdealer4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aktivix123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Batpad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Triump0870 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Igcmysticdaniel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents This describes a method for maintaining a separate ssh-agent to hold your ssh key for connecting to Toolforge/CloudVPS. The problemhttps://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents#The_problem MacOS solutionhttps://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents#MacOS_solution Using multiple agents via launchd (better)https://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents#Using_multiple_agents_via_launchd_(better) Run one agent per terminalhttps://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents#Run_one_agent_per_terminal Linux solutionshttps://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents#Linux_solutions Using multiple agents via systemdhttps://wikitech.wikimedia.org/wiki/Managing_multiple_SSH_agents#Using_multiple_agents_via_systemd https://wikitech.wikimedia.org/wiki/Shell_Request/Daniel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vijay2112 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Stat1003 stat1003 is an analytics server for accessing the Analytics MariaDB databases. Successor to Stat1. Deprecationhttps://wikitech.wikimedia.org/wiki/Stat1003#Deprecation Usagehttps://wikitech.wikimedia.org/wiki/Stat1003#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1003#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1003#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Paladox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB For emergencies, check the subpage about MariaDB troubleshooting. Sections and shardshttps://wikitech.wikimedia.org/wiki/MariaDB#Sections_and_shards Core MediaWiki databaseshttps://wikitech.wikimedia.org/wiki/MariaDB#Core_MediaWiki_databases External storagehttps://wikitech.wikimedia.org/wiki/MariaDB#External_storage Parsercacheshttps://wikitech.wikimedia.org/wiki/MariaDB#Parsercaches Extension storagehttps://wikitech.wikimedia.org/wiki/MariaDB#Extension_storage x1https://wikitech.wikimedia.org/wiki/MariaDB#x1 x2https://wikitech.wikimedia.org/wiki/MariaDB#x2 Miscellaneoushttps://wikitech.wikimedia.org/wiki/MariaDB#Miscellaneous Database creation templatehttps://wikitech.wikimedia.org/wiki/MariaDB#Database_creation_template Cloud Services (WMCS) Wiki replicashttps://wikitech.wikimedia.org/wiki/MariaDB#Cloud_Services_(WMCS)_Wiki_replicas Data Platformhttps://wikitech.wikimedia.org/wiki/MariaDB#Data_Platform Replicashttps://wikitech.wikimedia.org/wiki/MariaDB#Replicas Cloud Services Wiki Replicashttps://wikitech.wikimedia.org/wiki/MariaDB#Cloud_Services_Wiki_Replicas Analytics MariaDB clusterhttps://wikitech.wikimedia.org/wiki/MariaDB#Analytics_MariaDB_cluster Database backupshttps://wikitech.wikimedia.org/wiki/MariaDB#Database_backups Rebooting or reimaging a hosthttps://wikitech.wikimedia.org/wiki/MariaDB#Rebooting_or_reimaging_a_host Packageshttps://wikitech.wikimedia.org/wiki/MariaDB#Packages Installationhttps://wikitech.wikimedia.org/wiki/MariaDB#Installation Hardware installation checklisthttps://wikitech.wikimedia.org/wiki/MariaDB#Hardware_installation_checklist Setting up a fresh serverhttps://wikitech.wikimedia.org/wiki/MariaDB#Setting_up_a_fresh_server Loading Data / provisioninghttps://wikitech.wikimedia.org/wiki/MariaDB#Loading_Data_/_provisioning Schema Changeshttps://wikitech.wikimedia.org/wiki/MariaDB#Schema_Changes Offline Schema Changeshttps://wikitech.wikimedia.org/wiki/MariaDB#Offline_Schema_Changes Sanitarium and clouddb instanceshttps://wikitech.wikimedia.org/wiki/MariaDB#Sanitarium_and_clouddb_instances Table Metadata Lockinghttps://wikitech.wikimedia.org/wiki/MariaDB#Table_Metadata_Locking Monitoringhttps://wikitech.wikimedia.org/wiki/MariaDB#Monitoring Replication laghttps://wikitech.wikimedia.org/wiki/MariaDB#Replication_lag Manipulating the Replication Treehttps://wikitech.wikimedia.org/wiki/MariaDB#Manipulating_the_Replication_Tree Child to Siblinghttps://wikitech.wikimedia.org/wiki/MariaDB#Child_to_Sibling Sibling to Childhttps://wikitech.wikimedia.org/wiki/MariaDB#Sibling_to_Child Stop Siblings in Synchttps://wikitech.wikimedia.org/wiki/MariaDB#Stop_Siblings_in_Sync HAProxyhttps://wikitech.wikimedia.org/wiki/MariaDB#HAProxy Failoverhttps://wikitech.wikimedia.org/wiki/MariaDB#Failover Load Balancinghttps://wikitech.wikimedia.org/wiki/MariaDB#Load_Balancing Puppethttps://wikitech.wikimedia.org/wiki/MariaDB#Puppet Long running querieshttps://wikitech.wikimedia.org/wiki/MariaDB#Long_running_queries Storage engineshttps://wikitech.wikimedia.org/wiki/MariaDB#Storage_engines Importing table spaces from other hostshttps://wikitech.wikimedia.org/wiki/MariaDB#Importing_table_spaces_from_other_hosts Transportable tablespaceshttps://wikitech.wikimedia.org/wiki/MariaDB#Transportable_tablespaces Account handlinghttps://wikitech.wikimedia.org/wiki/MariaDB#Account_handling How unix_socket authentication workshttps://wikitech.wikimedia.org/wiki/MariaDB#How_unix_socket_authentication_works Dumping tables with mydumperhttps://wikitech.wikimedia.org/wiki/MariaDB#Dumping_tables_with_mydumper What is mydumper?https://wikitech.wikimedia.org/wiki/MariaDB#What_is_mydumper? From the documentation:https://wikitech.wikimedia.org/wiki/MariaDB#From_the_documentation: Why do we use ithttps://wikitech.wikimedia.org/wiki/MariaDB#Why_do_we_use_it Quick cheatsheethttps://wikitech.wikimedia.org/wiki/MariaDB#Quick_cheatsheet Dump datahttps://wikitech.wikimedia.org/wiki/MariaDB#Dump_data Load datahttps://wikitech.wikimedia.org/wiki/MariaDB#Load_data Production section failover checklisthttps://wikitech.wikimedia.org/wiki/MariaDB#Production_section_failover_checklist Switch masterhttps://wikitech.wikimedia.org/wiki/MariaDB#Switch_master Restarting switch master toolhttps://wikitech.wikimedia.org/wiki/MariaDB#Restarting_switch_master_tool Old switchover steps (not used anymore)https://wikitech.wikimedia.org/wiki/MariaDB#Old_switchover_steps_(not_used_anymore) External store section failover checklisthttps://wikitech.wikimedia.org/wiki/MariaDB#External_store_section_failover_checklist Misc section failover checklist (example with m2)https://wikitech.wikimedia.org/wiki/MariaDB#Misc_section_failover_checklist_(example_with_m2) Special section: x1 master switchoverhttps://wikitech.wikimedia.org/wiki/MariaDB#Special_section:_x1_master_switchover Decommissioning a mariadb host server checklisthttps://wikitech.wikimedia.org/wiki/MariaDB#Decommissioning_a_mariadb_host_server_checklist Depool a broken or lagged replicahttps://wikitech.wikimedia.org/wiki/MariaDB#Depool_a_broken_or_lagged_replica Testing servershttps://wikitech.wikimedia.org/wiki/MariaDB#Testing_servers People with accesshttps://wikitech.wikimedia.org/wiki/MariaDB#People_with_access How to enable a new external storage (es) sectionhttps://wikitech.wikimedia.org/wiki/MariaDB#How_to_enable_a_new_external_storage_(es)_section Pre stepshttps://wikitech.wikimedia.org/wiki/MariaDB#Pre_steps Setting up the servers with dbctlhttps://wikitech.wikimedia.org/wiki/MariaDB#Setting_up_the_servers_with_dbctl Mediawiki patches and deploymenthttps://wikitech.wikimedia.org/wiki/MariaDB#Mediawiki_patches_and_deployment How to set a external storage (es) section to read onlyhttps://wikitech.wikimedia.org/wiki/MariaDB#How_to_set_a_external_storage_(es)_section_to_read_only IPv6 and MariaDBhttps://wikitech.wikimedia.org/wiki/MariaDB#IPv6_and_MariaDB Tables drift between code and productionhttps://wikitech.wikimedia.org/wiki/MariaDB#Tables_drift_between_code_and_production Warming up production databaseshttps://wikitech.wikimedia.org/wiki/MariaDB#Warming_up_production_databases MW warmup scripthttps://wikitech.wikimedia.org/wiki/MariaDB#MW_warmup_script Comparing tableshttps://wikitech.wikimedia.org/wiki/MariaDB#Comparing_tables Warming up ES hosts with comparehttps://wikitech.wikimedia.org/wiki/MariaDB#Warming_up_ES_hosts_with_compare Warming up parsercache hostshttps://wikitech.wikimedia.org/wiki/MariaDB#Warming_up_parsercache_hosts Warming up x1 hostshttps://wikitech.wikimedia.org/wiki/MariaDB#Warming_up_x1_hosts Replaying traffichttps://wikitech.wikimedia.org/wiki/MariaDB#Replaying_traffic Which queries to replayhttps://wikitech.wikimedia.org/wiki/MariaDB#Which_queries_to_replay Live traffichttps://wikitech.wikimedia.org/wiki/MariaDB#Live_traffic https://wikitech.wikimedia.org/wiki/Shell_Request/Raimundo_Pastor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rubenkleiman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alpherafinancial Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JasonReiche Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beatsr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iwontedit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marsupilami Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Undercut Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Avantika Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ugoel1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/InsaynAsasin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tanvi.gandhi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rohan013 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KTC Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rockrs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Matthew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ybeybe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Stat1002 The stat1002 server was an Analytics Cluster client node for accessing Analytics MariaDB databases or Hadoop. It was replaced in July 2017 by stat1005. Deprecationhttps://wikitech.wikimedia.org/wiki/Stat1002#Deprecation Usagehttps://wikitech.wikimedia.org/wiki/Stat1002#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1002#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1002#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1002#Notes https://wikitech.wikimedia.org/wiki/Shell_Request/Noobbot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Check_graphite check_graphite is a nagios/icinga plugin script that can be used to generate alerts based on metric values in Graphite. It simply queries graphite to fetch data in JSON format through the /render endpoint of the graphite server. Puppet Usagehttps://wikitech.wikimedia.org/wiki/Check_graphite#Puppet_Usage Define monitor_graphite_thresholdhttps://wikitech.wikimedia.org/wiki/Check_graphite#Define_monitor_graphite_threshold Define monitor_graphite_anomalyhttps://wikitech.wikimedia.org/wiki/Check_graphite#Define_monitor_graphite_anomaly https://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral/Paranoid.xml wikimedia.mirrored https://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral Maven projects based on the discovery-parent-pom should not follow the instructions below, but instead look at the Building and Release sections of this README. Walkthroughhttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral#Walkthrough What can go wronghttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral#What_can_go_wrong git push --tagshttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral#git_push_--tags mvn release:performhttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral#mvn_release:perform git reviewhttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral#git_review mvn clean install -s ~/.m2/paranoid.xmlhttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral#mvn_clean_install_-s_~/.m2/paranoid.xml https://wikitech.wikimedia.org/wiki/Shell_Request/Shaheralaghwat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roopam_Sharma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Susiecutie1986 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/StuartFeldt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gilpinj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Heyhellocc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Achechen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Irc.wikimedia.org irc.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#Service Privacyhttps://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#Privacy Why do I see only my nick and rc-pmtpa in various channels?https://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#Why_do_I_see_only_my_nick_and_rc-pmtpa_in_various_channels? Usehttps://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#Use Formathttps://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#Format Avoid new usehttps://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#Avoid_new_use Referenceshttps://wikitech.wikimedia.org/wiki/Irc.wikimedia.org#References https://wikitech.wikimedia.org/wiki/Shell_Request/Deveseattle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anovia_lewis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/20after4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Damnit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jianhui67 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naveen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chandres Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pandiyarajan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mhenning-exelis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Awight Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nadeem_akhtar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Monotica Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aysunbozanta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ALOK_PANDEY Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jessejarvi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sabas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cortesimone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sayginer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AlexNew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wmddefensecontractors Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venpras03 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sbiribizio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eccenux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TOLA Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/James.chen2012 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mhernandez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bloom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Horacio_Polemann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aluberht Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rrobinson82 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Malika_Labrecque Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ramon_Lua Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elvey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pandiyarajan_Pitchaimuthu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pitchp1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployment-prep/deployment-pdf There are two varieties of PDF server, only one of which is in labs. mwlib configurationhttps://wikitech.wikimedia.org/wiki/Deployment-prep/deployment-pdf#mwlib_configuration Upstart configurationshttps://wikitech.wikimedia.org/wiki/Deployment-prep/deployment-pdf#Upstart_configurations https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys __TOC__ Weekly stepshttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Weekly_steps Monday: Sync up with your deployment partnerhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Monday:_Sync_up_with_your_deployment_partner Tuesday: New branch creation and deployhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Tuesday:_New_branch_creation_and_deploy Before the deploy windowhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Before_the_deploy_window https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys# Wednesday: group0 to group1 deployhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Wednesday:_group0_to_group1_deploy Thursday: group{0,1} to all deployhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Thursday:_group{0,1}_to_all_deploy Breakagehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Breakage Rollbackhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Rollback Troubleshoot Kubernetes deploymenthttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Troubleshoot_Kubernetes_deployment Places to Watch for Breakagehttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Places_to_Watch_for_Breakage Places we monitorhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Places_we_monitor Other places to lookhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Other_places_to_look If the train is blockedhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#If_the_train_is_blocked Troubleshooting automated jobshttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Troubleshooting_automated_jobs Incident documentationhttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Incident_documentation See alsohttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#See_also Footnoteshttps://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Footnotes https://wikitech.wikimedia.org/wiki/Shell_Request/HaithamS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nayan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Michell123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/replagstats #!/usr/bin/perl -w Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation https://wikitech.wikimedia.org/wiki/Shell_Request/Ironholds Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WhyIsItReal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/toolhistory #!/bin/bash https://wikitech.wikimedia.org/wiki/Incidents/20140503-Thumbnails (From Antoine's email to mediawiki-l) Timeline of eventshttps://wikitech.wikimedia.org/wiki/Incidents/20140503-Thumbnails#Timeline_of_events how it happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20140503-Thumbnails#how_it_happened What can be improvedhttps://wikitech.wikimedia.org/wiki/Incidents/20140503-Thumbnails#What_can_be_improved Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140503-Thumbnails#Actionables Referenceshttps://wikitech.wikimedia.org/wiki/Incidents/20140503-Thumbnails#References https://wikitech.wikimedia.org/wiki/Shell_Request/Wleizero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reise_Reise Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AfroThundr3007730 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ossi96 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JulesWinnfield-hu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gumzer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cmarqu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pkdake Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bcoughlan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Password_and_2FA_reset/Confirming_identities == How to confirm identities == How to confirm identitieshttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset/Confirming_identities#How_to_confirm_identities Process to re-claim accountshttps://wikitech.wikimedia.org/wiki/Password_and_2FA_reset/Confirming_identities#Process_to_re-claim_accounts https://wikitech.wikimedia.org/wiki/Shell_Request/Micha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Achimbode Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zub Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kishanio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Q%C3%A9bax Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Metaodi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Paul.robillard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries == Writing queries == Writing querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Writing_queries Handy column nameshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Handy_column_names Use partitionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Use_partitions INSERT OVERWRITE ... IF NOT EXISTShttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#INSERT_OVERWRITE_..._IF_NOT_EXISTS Earliest data available in hadoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Earliest_data_available_in_hadoop Avoiding overgreedy scans / Operator precedencehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Avoiding_overgreedy_scans_/_Operator_precedence User-defined functionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#User-defined_functions Slow querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Slow_queries Counting rows which match a criterionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Counting_rows_which_match_a_criterion Create your own databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Create_your_own_database Running querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Running_queries Command linehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Command_line Use wmfhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Use_wmf Output to a filehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Output_to_a_file Run queries in Cronhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Run_queries_in_Cron Run long queries in a screen sessionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Run_long_queries_in_a_screen_session Vertical query resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Vertical_query_results Loading datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Loading_data TSV filehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#TSV_file Editing Schemashttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Editing_Schemas Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Troubleshooting Query fails with generic "Execution Error"https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Query_fails_with_generic_"Execution_Error" Hadoop containers run out of memoryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Hadoop_containers_run_out_of_memory JsonSerDe Errorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#JsonSerDe_Errors Killing a running queryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Killing_a_running_query Scratch spacehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Scratch_space Batch modehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Batch_mode Dateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Dates Out of Memory Errors on Clienthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Out_of_Memory_Errors_on_Client Out of Memory Errors when exporting large datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Out_of_Memory_Errors_when_exporting_large_datasets My query does not starthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#My_query_does_not_start My query does not progress / finishhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#My_query_does_not_progress_/_finish Search through logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Search_through_logs More debugging information in CLIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#More_debugging_information_in_CLI Use RLIKE instead of LIKE when working with multi-line texthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#Use_RLIKE_instead_of_LIKE_when_working_with_multi-line_text EventLogginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries#EventLogging https://wikitech.wikimedia.org/wiki/Shell_Request/Nonoxb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AbshirBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jaredzimmerman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shbib_Al-Subaie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mojavelinux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Limn [can do stuff Graph typeshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Limn#Graph_types Time serieshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Limn#Time_series Mapshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Limn#Maps Exampleshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Limn#Examples https://wikitech.wikimedia.org/wiki/Shell_Request/Mukil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ato_01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scnd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheDJ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ibrahim_Husain_Meraj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Retama Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yu_Suzuki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frappeisthebest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bustard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Simmacoferriero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zellfaze Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BearND Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Holek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prabin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Petermahlzahn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24 == March 31 == March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#March_1 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_24#January_1 https://wikitech.wikimedia.org/wiki/Shell_Request/Naudefj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Unbeatsr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sockpuppetofnoob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suckerf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sima_Chavoshi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shanmuganathan.N Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Http Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guenthermi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Helperf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aaa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinawill9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sorpaas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FreeRangeFrog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vibhorgoel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ekastner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Palerdot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mat%C4%9Bj_Grabovsk%C3%BD Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HelloAnnyong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wildrover Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KatherineMichel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Noobbot2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rebeatsr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iekhanx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pixelpapst Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barichd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aroom92 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nathmatics Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iowajason Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hamzeh77 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thisaccountwillnotvandalismitdogoodthingsonly I hope my shell access will be accept! Treat signature as wikitext (without an automatic link) 10:21, 20 May 2014 (UTC) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aok1425 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freit003.309 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naveen09185 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xu_Qian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Camelia.boban Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sand!13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%3D%3D%3Dpk%3D%3D%3D Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PabloCastellano Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Astuti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apphorse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bleksy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinsha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vladimir_Goloubtzoff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chiefwei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ghilt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ziad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ussiik1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rhonny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepwaterdiver Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nivha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bugsbunny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sardar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Astuti11 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mothersucker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ian_Kelling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atsirlin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hongchan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Astutisharma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/K0pernikus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wavylips Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grafzahl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/1rabbitmoon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdann52 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Liang860908 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Drzmbs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BPositive Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rommel-christian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sebschlicht Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leshy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joerg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jbhambhwani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vlsergey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prahlad1981 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kraghu306 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phuzion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zedlik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dduvall Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daouda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fruitmaster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ofekalef Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jchancellor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maiden_taiwan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raghdasa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MengWu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zhx828 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chuenlye Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D8%AC%D8%A7%D9%81%D9%8A%D8%AF Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gc.chiron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Illucent Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Opopovitch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pitbull_1979 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Horcrux92 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Windhamdavid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pravinxyz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Faiza_Malik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mifter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140529-appservers == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140529-appservers#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140529-appservers#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140529-appservers#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Jefflee8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Safar2011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stgriffi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lixxx235 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Antlabs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timothy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rabimba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vedpalr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apepeskul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yejianfei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SyrzKnight Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Singhalawap Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ninkov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spacegeek31 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yasmanis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oursana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zetud Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pradeep_Banavara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akdhavre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LoopZilla Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guest82 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaan.dulgar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140517-bits == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140517-bits#Summary Detailshttps://wikitech.wikimedia.org/wiki/Incidents/20140517-bits#Details Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140517-bits#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140517-bits#Actionables https://wikitech.wikimedia.org/wiki/Ganeti_evaluation = Goal = Goalhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Goal Quick breakdown of designhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Quick_breakdown_of_design Rammifications of the designhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Rammifications_of_the_design Important infohttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Important_info Installationhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Installation Operationshttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Operations Create a new VMhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Create_a_new_VM Login in to the console of a VMhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Login_in_to_the_console_of_a_VM Reboot/shutdown/startup a VMhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Reboot/shutdown/startup_a_VM Modify the VM attributeshttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Modify_the_VM_attributes Live migrate a VMhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Live_migrate_a_VM Non-Live migration of a VMhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Non-Live_migration_of_a_VM Run cluster verificationhttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Run_cluster_verification Node statisticshttps://wikitech.wikimedia.org/wiki/Ganeti_evaluation#Node_statistics https://wikitech.wikimedia.org/wiki/Shell_Request/Itsmeprabha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amitpp23 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rterrero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Audiodude Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/S.gurenkova Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gregbard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer This is a draft specification for a data transformation component to be used throughout Fundraising. Backgroundhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer#Background Implementationhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer#Implementation FieldTransformationhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer#FieldTransformation Transformerhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer#Transformer Request Mushhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer#Request_Mush Data Systemhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Transformer#Data_System https://wikitech.wikimedia.org/wiki/Shell_Request/Perhelion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gogianaman Placeholder page https://wikitech.wikimedia.org/wiki/Shell_Request/Subhash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhinav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jnanninga Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peter17 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140607-Elasticsearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140607-Elasticsearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140607-Elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140607-Elasticsearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140607-Elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Nihiltres Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bistenes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6 == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Background Preparationhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Preparation Schedulinghttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Scheduling Warn everyonehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Warn_everyone Do ithttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Do_it Take the Site Offlinehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Take_the_Site_Offline Disable watchdogs and timeouts for MySQLhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Disable_watchdogs_and_timeouts_for_MySQL Kill the slow db query process killer.https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Kill_the_slow_db_query_process_killer. Ensure that CiviCRM is not your Drupal homepagehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Ensure_that_CiviCRM_is_not_your_Drupal_homepage Disable all CiviCRM integration / extension modules (NOT CiviCRM itself)https://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Disable_all_CiviCRM_integration_/_extension_modules_(NOT_CiviCRM_itself) Clear cacheshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Clear_caches Backup your CiviCRM databasehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Backup_your_CiviCRM_database Do any pending OS maintenancehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Do_any_pending_OS_maintenance Run the Upgrade scripthttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Run_the_Upgrade_script Re-enable compatible CiviCRM integration / extension moduleshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Re-enable_compatible_CiviCRM_integration_/_extension_modules Restore CiviCRM as the Drupal homepage if appropriatehttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Restore_CiviCRM_as_the_Drupal_homepage_if_appropriate Unkill the slow db query killerhttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Unkill_the_slow_db_query_killer Noteshttps://wikitech.wikimedia.org/wiki/CiviCRM_upgrade_4.6#Notes https://wikitech.wikimedia.org/wiki/Swift/TODO Category:Swift Swifthttps://wikitech.wikimedia.org/wiki/Category:Swift https://wikitech.wikimedia.org/wiki/Incidents/20140608-Kafka == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140608-Kafka#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140608-Kafka#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140608-Kafka#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Amomin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ineditable Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PhotoshopDesk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stemoc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lucie_Kaffee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cesascur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Outages EventLogging outages are recorded along with ops incidents on the Wikitech page Incident documentation. Look for incidents with "EventLogging" in the title. Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems https://wikitech.wikimedia.org/wiki/Shell_Request/Yuyuh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cjb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140509-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140509-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140509-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140509-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140509-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Mattclare Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cstfpp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sachin_Magdum Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danielfurrer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Orfest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chrisn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/U269c Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ngc891 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JulienM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Viola Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phabtest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jsembera Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Findsolution Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Francisp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nkurtov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lode Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joleitner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kshitij28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Muriel_Staub_(WMCH) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OccultZone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MuralidharB Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Talktodan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Utakoueda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140612-Math == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140612-Math#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140612-Math#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140612-Math#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140612-Math#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Hufi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/17luca17 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DINKIN Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RichB Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sahithip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kayd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jbbot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DangSunM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Telefood Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kalina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clc19 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140613-Videoscalers == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140613-Videoscalers#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140613-Videoscalers#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140613-Videoscalers#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140613-Videoscalers#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Vivek_Dhande Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Miguillen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Blackfire Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gardener Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/All1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JoelKP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Steinjr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anuj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stof999 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Comtebenoit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suriyaa_Kudo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Volunteer_NDA == Privileged Phabricator access == Privileged Phabricator accesshttps://wikitech.wikimedia.org/wiki/Volunteer_NDA#Privileged_Phabricator_access Create a requesthttps://wikitech.wikimedia.org/wiki/Volunteer_NDA#Create_a_request Get supporthttps://wikitech.wikimedia.org/wiki/Volunteer_NDA#Get_support Welcome to the NDA club!https://wikitech.wikimedia.org/wiki/Volunteer_NDA#Welcome_to_the_NDA_club! Privileged LDAP or shell accesshttps://wikitech.wikimedia.org/wiki/Volunteer_NDA#Privileged_LDAP_or_shell_access Create a request (privileged LDAP access)https://wikitech.wikimedia.org/wiki/Volunteer_NDA#Create_a_request_(privileged_LDAP_access) Create a request (shell access)https://wikitech.wikimedia.org/wiki/Volunteer_NDA#Create_a_request_(shell_access) Get accesshttps://wikitech.wikimedia.org/wiki/Volunteer_NDA#Get_access https://wikitech.wikimedia.org/wiki/Shell_Request/Joegong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Navodhj8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adikhajuria Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joechan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kmosher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Symac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stephankn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DbproSS14 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache#Conclusions Proposalshttps://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache#Proposals Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache#Actionables https://wikitech.wikimedia.org/wiki/Codfw_data_center codfw (pronounced code-ef-double-you, or the Dallas DC) is located at Carrollton, Texas, United States]. Historyhttps://wikitech.wikimedia.org/wiki/Codfw_data_center#History Cabinet name mappinghttps://wikitech.wikimedia.org/wiki/Codfw_data_center#Cabinet_name_mapping Media galleryhttps://wikitech.wikimedia.org/wiki/Codfw_data_center#Media_gallery See alsohttps://wikitech.wikimedia.org/wiki/Codfw_data_center#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Kigess Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Josse.Cottenier Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruben_Demus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Genesys225 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DavisNT Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wahrani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Douglas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankitsood Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ailura Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Drobbins Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harej Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140619-parsercache/IRC_log IRC conversion on #wikimedia-operations during the 2014-06-19 pc1002 outage. All times are UTC. https://wikitech.wikimedia.org/wiki/Shell_Request/Eeggleston Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hot4bbbw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siddharth_Singh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Para Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hyaocuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jdorlus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tadasv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140625-CirrusSearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140625-CirrusSearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140625-CirrusSearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140625-CirrusSearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140625-CirrusSearch#Actionables https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407 = Quarterly Review of post-mortems - 2014-07 = Quarterly Review of post-mortems - 2014-07https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#Quarterly_Review_of_post-mortems_-_2014-07 Questions we want to be able to answerhttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#Questions_we_want_to_be_able_to_answer Agendahttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#Agenda Groupingshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#Groupings The post mortemshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#The_post_mortems ../20140318-EventLogging/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140318-EventLogging/ ../20140328-DB-Queries/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140328-DB-Queries/ ../20140403-Deploy/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140403-Deploy/ ../20140503-Thumbnails/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140503-Thumbnails/ ../20140509-EventLogging/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140509-EventLogging/ ../20140517-bits/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140517-bits/ ../20140526-m1/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140526-m1/ ../20140529-appservers/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140529-appservers/ ../20140607-Elasticsearch/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140607-Elasticsearch/ ../20140608-Kafka/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140608-Kafka/ ../20140612-Math/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140612-Math/ ../20140613-Videoscalers/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140613-Videoscalers/ ../20140618-Wikitech/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140618-Wikitech/ ../20140619-parsercache/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140619-parsercache/ ../20140622-es1006/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140622-es1006/ ../20140622-imagescaler/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140622-imagescaler/ ../20140625-CirrusSearch/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407#../20140625-CirrusSearch/ https://wikitech.wikimedia.org/wiki/Incidents/20140618-Wikitech == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140618-Wikitech#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140618-Wikitech#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140618-Wikitech#Conclusions Proposalshttps://wikitech.wikimedia.org/wiki/Incidents/20140618-Wikitech#Proposals Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140618-Wikitech#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20140526-m1 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140526-m1#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140526-m1#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140526-m1#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140526-m1#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20140622-es1006 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140622-es1006#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140622-es1006#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140622-es1006#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140622-es1006#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Lala Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140622-imagescaler == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140622-imagescaler#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140622-imagescaler#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140622-imagescaler#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140622-imagescaler#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Verdy_p Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vnodecg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siddharth.28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siddharth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jongfeli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Docker == Intro == Introhttps://wikitech.wikimedia.org/wiki/Docker#Intro Networking woeshttps://wikitech.wikimedia.org/wiki/Docker#Networking_woes Persistent Storage woeshttps://wikitech.wikimedia.org/wiki/Docker#Persistent_Storage_woes Orchestration, configuration and UX woeshttps://wikitech.wikimedia.org/wiki/Docker#Orchestration,_configuration_and_UX_woes Running docker in production?https://wikitech.wikimedia.org/wiki/Docker#Running_docker_in_production? However...https://wikitech.wikimedia.org/wiki/Docker#However... Registryhttps://wikitech.wikimedia.org/wiki/Docker#Registry Installationhttps://wikitech.wikimedia.org/wiki/Docker#Installation Publishing production imageshttps://wikitech.wikimedia.org/wiki/Docker#Publishing_production_images Updating CI docker imageshttps://wikitech.wikimedia.org/wiki/Docker#Updating_CI_docker_images https://wikitech.wikimedia.org/wiki/Docker/apparmor Docker apparmor on Ubuntu Trusty: https://wikitech.wikimedia.org/wiki/Shell_Request/Kyawzawhein Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ranjithsiji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GeorgiaBerouka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Budi_heriyadi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Polotree Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smriti1346 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rraj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140616-LuceneSearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140616-LuceneSearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140616-LuceneSearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140616-LuceneSearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140616-LuceneSearch#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Berthold_Werner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wikitecmf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Swift/Icehouse Category:Swift upgrade to icehousehttps://wikitech.wikimedia.org/wiki/Swift/Icehouse#upgrade_to_icehouse proposed timeline for eqiadhttps://wikitech.wikimedia.org/wiki/Swift/Icehouse#proposed_timeline_for_eqiad upgrade procedure and rollbackhttps://wikitech.wikimedia.org/wiki/Swift/Icehouse#upgrade_procedure_and_rollback rollbackhttps://wikitech.wikimedia.org/wiki/Swift/Icehouse#rollback post-upgradehttps://wikitech.wikimedia.org/wiki/Swift/Icehouse#post-upgrade https://wikitech.wikimedia.org/wiki/Shell_Request/PJosepherum Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Training Person/Project knowledge table. https://wikitech.wikimedia.org/wiki/Shell_Request/Sayantan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gg5800 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sayant_Mahato Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/McAusten Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkohric Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruthy_gg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruthgavi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aguha93 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phatom87 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ronaldmexico Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mayte37 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jamesgolovich Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abghrtw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chalani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Osmium osmium is a server in eqiad for testing HHVM. Fingerprintshttps://wikitech.wikimedia.org/wiki/Osmium#Fingerprints https://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria The general outline of changes that require scheduling on the Deployments calendar as their own window, outside of Backport windows. Things that require their own deploy windowhttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Things_that_require_their_own_deploy_window Long running taskshttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Long_running_tasks Could make the cluster fall overhttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Could_make_the_cluster_fall_over Notable production code changehttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Notable_production_code_change Needs read-only timehttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Needs_read-only_time Cross-cutting impact or large unknownshttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Cross-cutting_impact_or_large_unknowns How to add a special deployment windowhttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#How_to_add_a_special_deployment_window Unsurehttps://wikitech.wikimedia.org/wiki/Deployments/Inclusion_criteria#Unsure https://wikitech.wikimedia.org/wiki/Shell_Request/Chinissai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_CiviCRM __TOC__ Creating a CiviCRM upgrade patchhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_CiviCRM#Creating_a_CiviCRM_upgrade_patch Deploying a CiviCRM upgradehttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_CiviCRM#Deploying_a_CiviCRM_upgrade See alsohttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Upgrade_CiviCRM#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Mandakini.S Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iman_Rahman_RI Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moolerian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RichardHeigl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jakob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moxy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tauhid16 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lobo2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheWatcher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vin09 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reiner_L._Sauer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/H_Scholten Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DanielPenfield Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Devanw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Osint981 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rolandcardoza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rovine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yatot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vanjagenije Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cmccolli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edoderoo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cory Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mr_toasty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JonahAragon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shreya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/Coinbase == Import == Importhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Coinbase#Import Questionshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Coinbase#Questions Answershttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Coinbase#Answers Schedulehttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Coinbase#Schedule Refundshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Coinbase#Refunds https://wikitech.wikimedia.org/wiki/Shell_Request/Jgoettlich Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bthfan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Estela_rubio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brajeshkumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1 = Quarterly Review of post-mortems - 2014-07 - Group 1 = Quarterly Review of post-mortems - 2014-07 - Group 1https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#Quarterly_Review_of_post-mortems_-_2014-07_-_Group_1 Questions we want to be able to answerhttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#Questions_we_want_to_be_able_to_answer Agendahttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#Notes The post mortemshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#The_post_mortems ../../20140318-EventLogging/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140318-EventLogging/ ../../20140328-DB-Queries/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140328-DB-Queries/ ../../20140509-EventLogging/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140509-EventLogging/ ../../20140526-m1/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140526-m1/ ../../20140607-Elasticsearch/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140607-Elasticsearch/ ../../20140613-Videoscalers/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140613-Videoscalers/ ../../20140619-parsercache/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140619-parsercache/ ../../20140622-es1006/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140622-es1006/ ../../20140622-imagescaler/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140622-imagescaler/ ../../20140625-CirrusSearch/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1#../../20140625-CirrusSearch/ https://wikitech.wikimedia.org/wiki/Shell_Request/Anemirovsky Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2 = Quarterly Review of post-mortems - 2014-07 = Quarterly Review of post-mortems - 2014-07https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#Quarterly_Review_of_post-mortems_-_2014-07 Questions we want to be able to answerhttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#Questions_we_want_to_be_able_to_answer Agendahttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#Notes The post mortemshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#The_post_mortems ../../20140328-DB-Queries/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140328-DB-Queries/ ../../20140403-Deploy/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140403-Deploy/ ../../20140503-Thumbnails/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140503-Thumbnails/ ../../20140517-bits/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140517-bits/ ../../20140529-appservers/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140529-appservers/ ../../20140608-Kafka/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140608-Kafka/ ../../20140612-Math/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140612-Math/ ../../20140618-Wikitech/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2#../../20140618-Wikitech/ https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group1/notes ../.. https://wikitech.wikimedia.org/wiki/Shell_Request/Gwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/HTTPS/Domains == What's included here == What's included herehttps://wikitech.wikimedia.org/wiki/HTTPS/Domains#What's_included_here List of wikimedia.org one-off domains' HTTPS support statushttps://wikitech.wikimedia.org/wiki/HTTPS/Domains#List_of_wikimedia.org_one-off_domains'_HTTPS_support_status Audit methodhttps://wikitech.wikimedia.org/wiki/HTTPS/Domains#Audit_method https://wikitech.wikimedia.org/wiki/Shell_Request/Fanliyang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nurul_Ashikin_Ashikin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sh4doww4lker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ldapsearch ldapsearch is a unix command line tool for querying an LDAP directory. Example querieshttps://wikitech.wikimedia.org/wiki/Ldapsearch#Example_queries Helper aliaseshttps://wikitech.wikimedia.org/wiki/Ldapsearch#Helper_aliases https://wikitech.wikimedia.org/wiki/Shell_Request/Joern Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Litanwei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maucdtbk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Query_killer The query killer on production databases is supposed to stop queries on replicas that take more than 60 seconds. It is implemented in native MySQL, see [Under high load, it may not function properly, see db-kill] for how to kill slow queries manually in emergencies. Statisticshttps://wikitech.wikimedia.org/wiki/Query_killer#Statistics https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes See also: ../../../20140328-DB-Queries/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140328-DB-Queries/ ../../../20140403-Deploy/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140403-Deploy/ ../../../20140503-Thumbnails/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140503-Thumbnails/ ../../../20140517-bits/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140517-bits/ ../../../20140529-appservers/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140529-appservers/ ../../../20140608-Kafka/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140608-Kafka/ ../../../20140612-Math/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140612-Math/ ../../../20140618-Wikitech/https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/QR201407/group2/notes#../../../20140618-Wikitech/ https://wikitech.wikimedia.org/wiki/Shell_Request/If0xx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dkalina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alifeofpossibilities Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Artcelestine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ninaro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clumsybirds Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Stat1001 stat1001 used to a generic server used by Analytics and to host web-access points. Serviceshttps://wikitech.wikimedia.org/wiki/Stat1001#Services https://wikitech.wikimedia.org/wiki/Metrics.wikimedia.org metrics.wikimedia. Historyhttps://wikitech.wikimedia.org/wiki/Metrics.wikimedia.org#History External linkhttps://wikitech.wikimedia.org/wiki/Metrics.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Shell_Request/Bsimmers Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phantomsteve Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MohandesWiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gadget850 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anurag619 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Svankmajer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frahaman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Khaister Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mt_motahar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dexter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Cobalt cobalt is the gerrit host since 2016-10-07 and replaced lead. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Shell_Request/Eyinwag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asgreebling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Devon7120 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Borbaa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bansod_deven Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mterrazas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists#Timeline 07/14/2014https://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists#07/14/2014 07/15/2014https://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists#07/15/2014 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Lists#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Kuailong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chrismeller Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peters242 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Llbraughler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkpsy3934 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Totten Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freewing999 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DimeCadmium Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Benlisquare Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/T_Meyarivan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jforrester Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ivob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barista00 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arvalus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140715_CirrusSearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140715_CirrusSearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140715_CirrusSearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140715_CirrusSearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140715_CirrusSearch#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Tjone270 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cheshirecat1337 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oliverb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Plucas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF This page documents the operational history of job queue runners at WMF. A jobrunner is a service that continuously processes items from [queue|MediaWiki's job queue]. jobs-loop.shhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#jobs-loop.sh jobrunner & jobchronhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#jobrunner_&_jobchron Overviewhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#Overview Configurationhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#Configuration Deploymenthttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#Deployment Logging and metricshttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#Logging_and_metrics SRE runbookhttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#SRE_runbook EventBushttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#EventBus See alsohttps://wikitech.wikimedia.org/wiki/History_of_job_queue_runners_at_WMF#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/USRI Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vronko2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qdb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mauool Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Openstack_evaluation = Goal = Goalhttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Goal Quick breakdown of designhttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Quick_breakdown_of_design Rammifications of the designhttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Rammifications_of_the_design Installationhttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Installation Operationshttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Operations Create a new VMhttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Create_a_new_VM Reading the instance consolehttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Reading_the_instance_console Listing instanceshttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Listing_instances Deleting instanceshttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Deleting_instances Power actions on instanceshttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Power_actions_on_instances Resize serverhttps://wikitech.wikimedia.org/wiki/Openstack_evaluation#Resize_server https://wikitech.wikimedia.org/wiki/Incidents/20140716-DNS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140716-DNS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140716-DNS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140716-DNS#Conclusions Impact Scope/Depthhttps://wikitech.wikimedia.org/wiki/Incidents/20140716-DNS#Impact_Scope/Depth Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140716-DNS#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Sorim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anita Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mitar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wllm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ninovolador Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ArsenArsen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Toddkcarlson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scott-linder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Judahmeek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daniel78 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zergash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OmarEinea Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140714-Etherpad == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Etherpad#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Etherpad#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Etherpad#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Etherpad#Actionables Etherpad-lite stack tracehttps://wikitech.wikimedia.org/wiki/Incidents/20140714-Etherpad#Etherpad-lite_stack_trace https://wikitech.wikimedia.org/wiki/Shell_Request/Nick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grzhan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrew_Gray Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lt2818 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Swift/ObjectExpiration Investigation in how object expiration works in swift. caveatshttps://wikitech.wikimedia.org/wiki/Swift/ObjectExpiration#caveats https://wikitech.wikimedia.org/wiki/Shell_Request/Geugeor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M.krasniuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Safons Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mazzax5 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarciszewski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Niroj_khadgi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eland_Zhou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amydrom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JigarShah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Codebully Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Visbarooney Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shield-9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/Alerts === Self-recurring checks === Self-recurring checkshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/Alerts#Self-recurring_checks https://wikitech.wikimedia.org/wiki/Shell_Request/Dchan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ramtonz_08 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arkiver Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rodrigolopes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ciaopeps Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Josutus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maheshwaghmare Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sponge33333 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lwarrenwiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/XayasithL Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naresh_Krishna_Raja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tabatabaey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Singhabhishek43 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/XZise Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bennatpjose Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Liran2010 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tuandm3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PAC2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Enock4seth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/OCG OCG, or Offline Content Generation, was a Node.js service that converted Parsoid RDF into some offline form, typically a PDF document. Installing a development instancehttps://wikitech.wikimedia.org/wiki/OCG#Installing_a_development_instance Monitoringhttps://wikitech.wikimedia.org/wiki/OCG#Monitoring When something goes wronghttps://wikitech.wikimedia.org/wiki/OCG#When_something_goes_wrong Reverting an OCG deploymenthttps://wikitech.wikimedia.org/wiki/OCG#Reverting_an_OCG_deployment Tracking down the source of a sudden traffic spikehttps://wikitech.wikimedia.org/wiki/OCG#Tracking_down_the_source_of_a_sudden_traffic_spike Deploying changeshttps://wikitech.wikimedia.org/wiki/OCG#Deploying_changes Pre-deploy checks; preparing the deploy commithttps://wikitech.wikimedia.org/wiki/OCG#Pre-deploy_checks;_preparing_the_deploy_commit Deploying the latest version of OCGhttps://wikitech.wikimedia.org/wiki/OCG#Deploying_the_latest_version_of_OCG Post-deploy checkshttps://wikitech.wikimedia.org/wiki/OCG#Post-deploy_checks Scriptshttps://wikitech.wikimedia.org/wiki/OCG#Scripts Maintenance scriptshttps://wikitech.wikimedia.org/wiki/OCG#Maintenance_scripts Pruning the queuehttps://wikitech.wikimedia.org/wiki/OCG#Pruning_the_queue Decommissioning a hosthttps://wikitech.wikimedia.org/wiki/OCG#Decommissioning_a_host Clearing the job queuehttps://wikitech.wikimedia.org/wiki/OCG#Clearing_the_job_queue Clearing the cache for a given date rangehttps://wikitech.wikimedia.org/wiki/OCG#Clearing_the_cache_for_a_given_date_range Regression testinghttps://wikitech.wikimedia.org/wiki/OCG#Regression_testing Test scriptshttps://wikitech.wikimedia.org/wiki/OCG#Test_scripts Finding crashers / Debugging "Error: 1"https://wikitech.wikimedia.org/wiki/OCG#Finding_crashers_/_Debugging_"Error:_1" Older hintshttps://wikitech.wikimedia.org/wiki/OCG#Older_hints See alsohttps://wikitech.wikimedia.org/wiki/OCG#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Jsahleen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Quibilia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sahus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bep Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fbicknel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omid.koli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Okumaw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wikicology Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Markdav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nataev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/S.charag11 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PowerUser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kritika Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OsamaK Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DD2K Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/OCG/Deployments Planned deployments, linked from Deployments. For a list of past deployments, look for 'ocg' in Server Admin Log. 2016-10-03https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-10-03 2016-08-17https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-08-17 2016-05-10https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-05-10 2016-05-01https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-05-01 2016-04-27https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-04-27 2016-04-25https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-04-25 2016-03-17https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-03-17 2016-01-26 - 2016-01-27https://wikitech.wikimedia.org/wiki/OCG/Deployments#2016-01-26_-_2016-01-27 2015-09-16https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-09-16 2015-09-14https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-09-14 2015-06-23 pmhttps://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-06-23_pm 2015-06-23 am (reverted)https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-06-23_am_(reverted) 2015-06-22 (beta only)https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-06-22_(beta_only) 2015-06-22 (cancelled)https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-06-22_(cancelled) 2015-05-20https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-05-20 2015-05-13https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-05-13 2015-03-23https://wikitech.wikimedia.org/wiki/OCG/Deployments#2015-03-23 2014-12-11https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-12-11 2014-12-03https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-12-03 2014-12-01https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-12-01 2014-11-26https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-11-26 2014-11-10https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-11-10 2014-11-03https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-11-03 2014-10-27https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-27 2014-10-22https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-22 2014-10-21https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-21 Prepared 2014-10-9, Deployed 2014-10-20https://wikitech.wikimedia.org/wiki/OCG/Deployments#Prepared_2014-10-9,_Deployed_2014-10-20 2014-10-8https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-8 2014-10-7https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-7 2014-10-6 (afternoon)https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-6_(afternoon) 2014-10-6 (morning)https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-6_(morning) 2014-10-2https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-2 2014-10-1https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-10-1 2014-09-29https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-29 2014-09-25https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-25 2014-09-24https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-24 2014-09-23https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-23 2014-09-18https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-18 2014-09-15https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-15 2014-09-09https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-09-09 2014-08-13https://wikitech.wikimedia.org/wiki/OCG/Deployments#2014-08-13 https://wikitech.wikimedia.org/wiki/Shell_Request/Priegol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bengvr3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Papaul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Baku Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Napo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140730-Icinga == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140730-Icinga#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140730-Icinga#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140730-Icinga#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140730-Icinga#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/SkullCrusher12D Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jan_Spousta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Negative24 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Protonk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Matrixblend Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rohitsharma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CUTTHOATZ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WikitechAnio243 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dacry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D8%B2%D9%83%D8%B1%D9%8A%D8%A7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fako85 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DSExp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edward Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Baku2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hitomi333 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kataldi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NLIGuy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gbilder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Choicefresh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeremy.Osborn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nada_ALBUNNI Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chuenlok Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Areutenauer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Youxiu.wang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alharbif Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/UEBERLA Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dannyboy2498 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MatthewIreland Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kanwaljit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lyhana8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JuliusCaesar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Slashme Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Touzrimounir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shamma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smansour Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mloki0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrew_Davidson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fabior1984 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Slowking4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xavriley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sampablokuper Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tar_L%C3%B3cesilion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pankowdeluxe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Minarush Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lloffiwr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tango_Mike_Bravo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Natbrown Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stemd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AGLV01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thomas.W Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wesalius Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ibrahim_khashrowdi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Probal_deep_saikia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KRLS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_roles Some information that used to appear here may be found at: Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Anon0x1105 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kkarimi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SamStudio8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Falkirks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dusty2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moony22 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shilad_Sen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Majr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Singuvenkatesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Castor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stuchka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TechnoAyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stickee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seraph08 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Terraroot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gooki8888 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SomeRandomTest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Makisyu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MiranJ81 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dcanaud Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lohapul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140806-Upload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140806-Upload#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140806-Upload#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140806-Upload#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140806-Upload#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Shrikarsan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hnbljq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/1408lilid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dstone1029 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/StanProg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lqbilbo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sergento Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Snail Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ritikarora1012 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jicksy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manojk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdelcambre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thaiszochi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chikki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chikki18 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DOIDCCO Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bluedeck Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barcex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rodrigoprimo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Valepert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mfb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Conrad.Irwin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjuehj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dianagr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aviator Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Michael0156 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/F1V3T3N7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dirschneid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SnehaPathak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abohadi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mehtanisarg3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dorgold Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WMDE-Fisch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mn_sale Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Morgan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Caiob3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johnhoder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkaico Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pintoch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manlikemishap Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spoirier01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rushafi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mahfuzsust Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pavikkdi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jongleur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/EarnThis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omerbaror Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marcobra.ubuntu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Caiy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/XOXOXO Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adampatterson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Klgswitch1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kracekumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Priyanob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Coiby Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kyawthuya1985 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Superbee76 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sophia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edwin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankit_ks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mark.Spansel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mazzax6 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hyctctc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adam_R_Smith Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gwiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Villiamc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/T3rminat0r Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140820-SwiftMemcache == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140820-SwiftMemcache#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140820-SwiftMemcache#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140820-SwiftMemcache#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140820-SwiftMemcache#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Mampionona Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Zinc zinc is a server (which?) active since August 2011 or earlier, running solr. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Shell_Request/Aunghtike Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ethancedrik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aprilbluedahy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Isaacb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diego_Queiroz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ziaun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adityab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nareshcmu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cmnaresh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/10asus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Matthew111 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mroszka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SATYENDRA Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leolivier Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frank_Baxmann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Catherine_444 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Merbst Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Caothu9669 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Az09 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Remagio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ysag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nilesh_Kokane Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vpovilaitis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timathom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yummy.bian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Olgawolfson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GOIII Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Linux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Worldbruce Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Az99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Loomi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stryn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Automatik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Codeispoetry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boshomi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Unapersona Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jos1950 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nicholun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yavorstoynov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Meshr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jheald Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kurtjak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AlexETF Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gordan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ljuomirg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goricastevanovic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherbbv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MichalZatkalik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mgooley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PDD Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yl01152002 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ibalutoiu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BD2412 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nitesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adamzhang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eldur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FuzzyDice Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinacmistry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prudhvi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL == 2024-11-08 == 2024-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-11-08 2024-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-11-06 2024-11-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-11-05 2024-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-11-04 2024-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-11-02 2024-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-31 2024-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-30 2024-10-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-29 2024-10-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-23 2024-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-21 2024-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-19 2024-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-18 2024-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-16 2024-10-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-15 2024-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-11 2024-10-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-10 2024-10-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-09 2024-10-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-08 2024-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-06 2024-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-04 2024-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-10-02 2024-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-28 2024-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-27 2024-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-25 2024-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-24 2024-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-23 2024-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-20 2024-09-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-19 2024-09-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-18 2024-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-17 2024-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-12 2024-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-11 2024-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-06 2024-09-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-05 2024-09-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-03 2024-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-09-02 2024-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-29 2024-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-27 2024-08-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-26 2024-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-23 2024-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-22 2024-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-21 2024-08-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-19 2024-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-16 2024-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-13 2024-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-12 2024-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-10 2024-08-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-09 2024-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-08 2024-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-07 2024-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-06 2024-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-08-01 2024-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-26 2024-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-24 2024-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-23 2024-07-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-22 2024-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-20 2024-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-19 2024-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-18 2024-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-17 2024-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-16 2024-07-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-15 2024-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-12 2024-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-11 2024-07-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-10 2024-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-08 2024-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-06 2024-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-05 2024-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-03 2024-07-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-02 2024-07-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-07-01 2024-06-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-26 2024-06-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-25 2024-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-24 2024-06-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-20 2024-06-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-19 2024-06-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-18 2024-06-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-17 2024-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-15 2024-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-14 2024-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-13 2024-06-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-12 2024-06-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-11 2024-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-10 2024-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-07 2024-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-06 2024-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-05 2024-06-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-04 2024-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-06-02 2024-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-30 2024-05-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-29 2024-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-28 2024-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-24 2024-05-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-23 2024-05-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-22 2024-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-20 2024-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-17 2024-05-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-16 2024-05-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-15 2024-05-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-14 2024-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-13 2024-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-10 2024-05-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-07 2024-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-06 2024-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-05 2024-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-04 2024-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-03 2024-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-05-02 2024-04-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-30 2024-04-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-29 2024-04-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-28 2024-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-26 2024-04-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-24 2024-04-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-23 2024-04-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-22 2024-04-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-21 2024-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-20 2024-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-19 2024-04-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-16 2024-04-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-15 2024-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-12 2024-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-11 2024-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-10 2024-04-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-08 2024-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-05 2024-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-04 2024-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-03 2024-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-04-02 2024-03-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-30 2024-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-29 2024-03-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-28 2024-03-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-26 2024-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-25 2024-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-23 2024-03-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-21 2024-03-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-20 2024-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-19 2024-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-18 2024-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-14 2024-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-13 2024-03-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-12 2024-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-11 2024-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-10 2024-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-08 2024-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-07 2024-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-03 2024-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-02 2024-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-03-01 2024-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-28 2024-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-27 2024-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-26 2024-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-23 2024-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-22 2024-02-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-21 2024-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-20 2024-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-19 2024-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-14 2024-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-13 2024-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-12 2024-02-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-09 2024-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-08 2024-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-07 2024-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-06 2024-02-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-05 2024-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-04 2024-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-03 2024-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-02 2024-02-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-02-01 2024-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-31 2024-01-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-30 2024-01-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-29 2024-01-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-27 2024-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-26 2024-01-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-25 2024-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-22 2024-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-18 2024-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-17 2024-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-16 2024-01-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-15 2024-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-12 2024-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-11 2024-01-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-10 2024-01-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-09 2024-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-08 2024-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-05 2024-01-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL#2024-01-01 https://wikitech.wikimedia.org/wiki/Shell_Request/Krelnik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NightlyNexus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Release_Engineering This page is simply a link dumping ground for Release Engineering related topics on wikitech. Runbookshttps://wikitech.wikimedia.org/wiki/Release_Engineering#Runbooks See alsohttps://wikitech.wikimedia.org/wiki/Release_Engineering#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/CMiller356 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Puppet/Wmflib wmflib is a Puppet module in the operations/puppet repository which contains generic custom functions, à la PuppetLab's stdlib. You can use these functions anywhere without having to explicitly include the module. apply_format (removed)https://wikitech.wikimedia.org/wiki/Puppet/Wmflib#apply_format_(removed) ensure_directoryhttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#ensure_directory ordered_jsonhttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#ordered_json ordered_yamlhttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#ordered_yaml require_packagehttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#require_package requires_realmhttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#requires_realm requires_ubuntuhttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#requires_ubuntu shell_exportshttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#shell_exports ssl_ciphersuitehttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#ssl_ciphersuite ubuntu_versionhttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#ubuntu_version validate_ensurehttps://wikitech.wikimedia.org/wiki/Puppet/Wmflib#validate_ensure https://wikitech.wikimedia.org/wiki/Shell_Request/Jeckep Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Damienkan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexsandroccarv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jiangt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eladb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rflps Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Okoigkakog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gzszxwklxv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nfrgdnbmej Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Egel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tacy_lee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140905-BitsVarnishMobileApp == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140905-BitsVarnishMobileApp#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140905-BitsVarnishMobileApp#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140905-BitsVarnishMobileApp#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140905-BitsVarnishMobileApp#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Akhamar2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uyefcsonxk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Bast1001 bast1001 was the main bastion for Eqiad. It has been superseded by bast1002. Serviceshttps://wikitech.wikimedia.org/wiki/Bast1001#Services https://wikitech.wikimedia.org/wiki/Mw1017 mw1017 was one of the many application server. While it received code during deployments as any other app server, this server was different in that the load balancer only served traffic with a X-Wikimedia-Debug header to this server. See alsohttps://wikitech.wikimedia.org/wiki/Mw1017#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/MBisanz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KHammerstein Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yfeng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jgfnmtrgur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jesus10vv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140910-swift-syslog == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140910-swift-syslog#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20140910-swift-syslog#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140910-swift-syslog#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140910-swift-syslog#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Tor_Vidvei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tr%E1%BA%A7n_Nguy%E1%BB%85n_Minh_Huy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NahidSultan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dminor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sijugchacko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arthur_B Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Steko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dugsupdappy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ottotest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dared Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pasaban Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vichak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ewulczyn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Savana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anupmehra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20140910-BetaCluster Summary from Jeremy B Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20140910-BetaCluster#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140910-BetaCluster#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Vwtrslhtvy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zdfllevnet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shigiouth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kthomp12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmlineditor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guycn2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nruest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lbjay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Datasets.wikimedia.org http://datasets.wikimedia. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Ramjan.ali55 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rachmat.Wahidi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rosheko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lmorillas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lots.0.logs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roland Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Supreetha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jrconner384 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LuddeBlaesild Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rukmini Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lubaochuan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HarryButtle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nostream Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pelevinec Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jhobs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arif39 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emadelwany Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qgil-test Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Green_Cardamom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Houstor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rogersinel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Saltymule Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sudhakar_reddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Antvio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jacques_Ballieu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/He7d3r Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Praveenp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jimmy_Xu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaiserwroth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SimonaDom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Braden1911 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nattonerd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anrao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Redirect Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manuel_Bieling Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mangelrp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nimeta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Wikimetrics == Administration == Administrationhttps://wikitech.wikimedia.org/wiki/Wikimetrics#Administration Logshttps://wikitech.wikimedia.org/wiki/Wikimetrics#Logs IP tableshttps://wikitech.wikimedia.org/wiki/Wikimetrics#IP_tables Local setuphttps://wikitech.wikimedia.org/wiki/Wikimetrics#Local_setup Labs setuphttps://wikitech.wikimedia.org/wiki/Wikimetrics#Labs_setup Deploying wikimetricshttps://wikitech.wikimedia.org/wiki/Wikimetrics#Deploying_wikimetrics https://wikitech.wikimedia.org/wiki/Shell_Request/Gerardduenas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RobinHood70 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bmansurov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rdicerb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jeremyb-test Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nikolov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dougal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Faragan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Keegan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yolda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sushmareddy05 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrolfb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarahli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Larrypaul Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mehrpouya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ourweakness Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elitre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Konstantinpetrov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Saintsukey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ini%C8%9Bi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mshearer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lulusanmsj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andriana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Palexis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iwffxjdmor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Olion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hargup Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prianka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tuxilina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hargup13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Priyanka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jcayala Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nottrobin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nikhil_Menghani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maxbiohazard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nbrouard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abrahamsustaita Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fanofaria Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akatuocheche Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ezdclcuhxn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yangkhy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pewkahwsvr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ephem Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruhrfisch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bearamy12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nnnesueks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srramanathan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PhilrocWP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abojebah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkblueb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shirish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joyceg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hkk12369 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Puppet/Hiera Hiera is a component of Puppet which allows storing configuration data outside of manifests. See Puppet coding for more general information about how, when, and where to use Puppet and Hiera on the Wikimedia cluster, and the upstream Hiera documentation for more general information about Hiera. Organizationhttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#Organization The lookup hierarchyhttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#The_lookup_hierarchy Backendshttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#Backends Role-based lookuphttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#Role-based_lookup wmflib::regexhttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#wmflib::regex wmflib::expand_pathhttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#wmflib::expand_path Practical examplehttps://wikitech.wikimedia.org/wiki/Puppet/Hiera#Practical_example In Wikimedia Cloud Services (formerly known as Labs)https://wikitech.wikimedia.org/wiki/Puppet/Hiera#In_Wikimedia_Cloud_Services_(formerly_known_as_Labs) https://wikitech.wikimedia.org/wiki/Shell_Request/Aparna Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/K-maks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sjoerddebruin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Luser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Search/Trouble Here's a bunch of ways ES can get into trouble (or has gotten into trouble before) and ways you can help diagnose and/or fix them: Stuck in redhttps://wikitech.wikimedia.org/wiki/Search/Trouble#Stuck_in_red Stuck in yellowhttps://wikitech.wikimedia.org/wiki/Search/Trouble#Stuck_in_yellow Reindexing based on a queryhttps://wikitech.wikimedia.org/wiki/Search/Trouble#Reindexing_based_on_a_query Updates don't go anywhere and Cirrus's jobs look stuckhttps://wikitech.wikimedia.org/wiki/Search/Trouble#Updates_don't_go_anywhere_and_Cirrus's_jobs_look_stuck Reshardinghttps://wikitech.wikimedia.org/wiki/Search/Trouble#Resharding Crashed node stuck in clusterhttps://wikitech.wikimedia.org/wiki/Search/Trouble#Crashed_node_stuck_in_cluster Master eligible node crashed and won't come backhttps://wikitech.wikimedia.org/wiki/Search/Trouble#Master_eligible_node_crashed_and_won't_come_back RemoteTransportException looping between 2 nodeshttps://wikitech.wikimedia.org/wiki/Search/Trouble#RemoteTransportException_looping_between_2_nodes High loadhttps://wikitech.wikimedia.org/wiki/Search/Trouble#High_load Unbalanced numbers of shards/Constantly moving shards around/One node using much more disk then the othershttps://wikitech.wikimedia.org/wiki/Search/Trouble#Unbalanced_numbers_of_shards/Constantly_moving_shards_around/One_node_using_much_more_disk_then_the_others Other useful functionshttps://wikitech.wikimedia.org/wiki/Search/Trouble#Other_useful_functions Cleanup logshttps://wikitech.wikimedia.org/wiki/Search/Trouble#Cleanup_logs https://wikitech.wikimedia.org/wiki/Hyper-threading A great way to troll Ops is to bring up Hyper-threading. So let's document the debate and situation. Historyhttps://wikitech.wikimedia.org/wiki/Hyper-threading#History Securityhttps://wikitech.wikimedia.org/wiki/Hyper-threading#Security Performance claimshttps://wikitech.wikimedia.org/wiki/Hyper-threading#Performance_claims Drawbackshttps://wikitech.wikimedia.org/wiki/Hyper-threading#Drawbacks Current practicehttps://wikitech.wikimedia.org/wiki/Hyper-threading#Current_practice Checkinghttps://wikitech.wikimedia.org/wiki/Hyper-threading#Checking See alsohttps://wikitech.wikimedia.org/wiki/Hyper-threading#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Gustavo_Girardelli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Showmemark Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qdinar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hari_chandana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Istrice Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DanielKurtjak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kormang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daman11 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw NOTE: This dataset is deprecated since 2016-08-01, see this thread Contained datahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#Contained_data Data not includedhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#Data_not_included Aggregation for .mwhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#Aggregation_for_.mw Availabilityhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#Availability dumps.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#dumps.wikimedia.org stat1004 and stat007https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#stat1004_and_stat007 pagecounts-ezhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#pagecounts-ez Toolforgehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#Toolforge Events and known problems since 2014-03-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#Events_and_known_problems_since_2014-03-01 See alsohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-raw#See_also https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites NOTEː This dataset is deprecated since 2016-08-01, see this thread Contained datahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Contained_data Disambiguating abbreviations ending in “.m”https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Disambiguating_abbreviations_ending_in_“.m” Differences to the pagecounts-raw datasethttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Differences_to_the_pagecounts-raw_dataset Requests to the mobile site and requests from mobile devices or appshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Requests_to_the_mobile_site_and_requests_from_mobile_devices_or_apps Requests to the zero site and Wikipedia Zero requestshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Requests_to_the_zero_site_and_Wikipedia_Zero_requests Availabilityhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Availability dumps.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#dumps.wikimedia.org stat1002.eqiad.wmnethttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#stat1002.eqiad.wmnet Analytics clusterhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Analytics_cluster Events and known problems since 2014-10-01https://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Events_and_known_problems_since_2014-10-01 Idiosyncrasieshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Idiosyncrasies Capitalization is split uphttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Capitalization_is_split_up See alsohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#See_also Notehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Data/Pagecounts-all-sites#Note https://wikitech.wikimedia.org/wiki/Shell_Request/Andrybiola Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sheeshmohsin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ishegatron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dima_st_bk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hugin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Webert.lima Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lyuflamb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haiyanx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MoranFine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alishajain Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aforn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jesusdavis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jakeanderson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexapenson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Valeriacarter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Virtwolf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Livnetata Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arpitachandra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uppsilon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stephenliang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Girija Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suinkim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sonic8Forum Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sam09 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zeshman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sophiejjj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Norbrt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freayd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming This page will eventually become a really great document on how to use Hadoop streaming with Wikimedia data in Hadoop. What is Hadoop Streaminghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming#What_is_Hadoop_Streaming Sample Codehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming#Sample_Code Count number of lines in SequenceFileshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming#Count_number_of_lines_in_SequenceFiles Word Count with Pythonhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming#Word_Count_with_Python Shipping Python Moduleshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming#Shipping_Python_Modules Using WikiHadoop to parse XML dumpshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_Streaming#Using_WikiHadoop_to_parse_XML_dumps https://wikitech.wikimedia.org/wiki/Shell_Request/Catchmrbharath Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sergiofernandezcarro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cacycle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mforns Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Redis_Bloom_Filter MediaWiki is configured to use a bloom filter located on a single Redis server (which a backup slave). Currently the servers are rbf1001 (master) and rbf1002 (slave). Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Rodi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jason.ji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kellyspeca Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ng_HooiCheng-CHN042 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lfourie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nerdbrain Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ianjay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rakeshkumar4294 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rathore Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jm3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Meeraleela Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pawel2014 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kopiersperre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brainzest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bandolero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Japiot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pallavi_shastry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Belutka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Memeht Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankitashukla Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ProgVal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dsrikarreddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Francois-kawala Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Duplicatebug Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Devendra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/West.andrew.g Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lemnisk9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Cloudmetrics1001 cloudmetrics1001 was a part of the Cloud VPS monitoring infrastructure. See alsohttps://wikitech.wikimedia.org/wiki/Cloudmetrics1001#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Shahin_et Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Papapasan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Galgeek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Teles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chinmaygupta28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lingvist200 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clintonm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zetifree Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maverick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mohammed_Mashagbeh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sam_bhayani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherjkd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Cassandra == Clusters == Clustershttps://wikitech.wikimedia.org/wiki/Cassandra#Clusters RESTBasehttps://wikitech.wikimedia.org/wiki/Cassandra#RESTBase AQS / Generated Dataset Platformhttps://wikitech.wikimedia.org/wiki/Cassandra#AQS_/_Generated_Dataset_Platform Sessionstorehttps://wikitech.wikimedia.org/wiki/Cassandra#Sessionstore Staginghttps://wikitech.wikimedia.org/wiki/Cassandra#Staging Network Topologyhttps://wikitech.wikimedia.org/wiki/Cassandra#Network_Topology Multi-instance Cassandrahttps://wikitech.wikimedia.org/wiki/Cassandra#Multi-instance_Cassandra Common admin taskshttps://wikitech.wikimedia.org/wiki/Cassandra#Common_admin_tasks Rolling restarthttps://wikitech.wikimedia.org/wiki/Cassandra#Rolling_restart Restart & check statushttps://wikitech.wikimedia.org/wiki/Cassandra#Restart_&_check_status https://wikitech.wikimedia.org/wiki/Cassandra# Adding a new (empty) nodehttps://wikitech.wikimedia.org/wiki/Cassandra#Adding_a_new_(empty)_node On Bootstrappinghttps://wikitech.wikimedia.org/wiki/Cassandra#On_Bootstrapping Boostrapping new nodeshttps://wikitech.wikimedia.org/wiki/Cassandra#Boostrapping_new_nodes Run all the Puppetshttps://wikitech.wikimedia.org/wiki/Cassandra#Run_all_the_Puppets Bootstrap all the instanceshttps://wikitech.wikimedia.org/wiki/Cassandra#Bootstrap_all_the_instances Getting a CQL shellhttps://wikitech.wikimedia.org/wiki/Cassandra#Getting_a_CQL_shell Installing and generating certificateshttps://wikitech.wikimedia.org/wiki/Cassandra#Installing_and_generating_certificates Rollover / expirationhttps://wikitech.wikimedia.org/wiki/Cassandra#Rollover_/_expiration Add a new host to a multi-instance clusterhttps://wikitech.wikimedia.org/wiki/Cassandra#Add_a_new_host_to_a_multi-instance_cluster Provisioninghttps://wikitech.wikimedia.org/wiki/Cassandra#Provisioning Cassandra setuphttps://wikitech.wikimedia.org/wiki/Cassandra#Cassandra_setup Other updateshttps://wikitech.wikimedia.org/wiki/Cassandra#Other_updates On-boardinghttps://wikitech.wikimedia.org/wiki/Cassandra#On-boarding Schema creationhttps://wikitech.wikimedia.org/wiki/Cassandra#Schema_creation Keyspace & table parametershttps://wikitech.wikimedia.org/wiki/Cassandra#Keyspace_&_table_parameters Roles & Grantshttps://wikitech.wikimedia.org/wiki/Cassandra#Roles_&_Grants Using cumin to execute commands on a per-rack basishttps://wikitech.wikimedia.org/wiki/Cassandra#Using_cumin_to_execute_commands_on_a_per-rack_basis Cassandra version upgradeshttps://wikitech.wikimedia.org/wiki/Cassandra#Cassandra_version_upgrades What to do if...https://wikitech.wikimedia.org/wiki/Cassandra#What_to_do_if... A corrupt commitlog segment prevents node startuphttps://wikitech.wikimedia.org/wiki/Cassandra#A_corrupt_commitlog_segment_prevents_node_startup Monitoringhttps://wikitech.wikimedia.org/wiki/Cassandra#Monitoring RESTBase (major Cassandra user)https://wikitech.wikimedia.org/wiki/Cassandra#RESTBase_(major_Cassandra_user) On going cassandra bootstrap/decommissionhttps://wikitech.wikimedia.org/wiki/Cassandra#On_going_cassandra_bootstrap/decommission Toolshttps://wikitech.wikimedia.org/wiki/Cassandra#Tools Uncommon admin taskshttps://wikitech.wikimedia.org/wiki/Cassandra#Uncommon_admin_tasks Monitor compactionshttps://wikitech.wikimedia.org/wiki/Cassandra#Monitor_compactions Bootstrap a brand new clusterhttps://wikitech.wikimedia.org/wiki/Cassandra#Bootstrap_a_brand_new_cluster Switch to multiple cassandra instances per hardware nodehttps://wikitech.wikimedia.org/wiki/Cassandra#Switch_to_multiple_cassandra_instances_per_hardware_node Handling JBOD disk failureshttps://wikitech.wikimedia.org/wiki/Cassandra#Handling_JBOD_disk_failures Cluster Setuphttps://wikitech.wikimedia.org/wiki/Cassandra#Cluster_Setup Authenticationhttps://wikitech.wikimedia.org/wiki/Cassandra#Authentication Replicating system_authhttps://wikitech.wikimedia.org/wiki/Cassandra#Replicating_system_auth Time-window compaction strategyhttps://wikitech.wikimedia.org/wiki/Cassandra#Time-window_compaction_strategy Prometheus JMX Exporterhttps://wikitech.wikimedia.org/wiki/Cassandra#Prometheus_JMX_Exporter See alsohttps://wikitech.wikimedia.org/wiki/Cassandra#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Federico-arias Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rretzbach Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pietro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Katescgu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vivekiitkgp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Phawikibugs {{Notice|text=See [is an instance of the [https://secure.phabricator. Starting and stoppinghttps://wikitech.wikimedia.org/wiki/Phawikibugs#Starting_and_stopping Configurationhttps://wikitech.wikimedia.org/wiki/Phawikibugs#Configuration Statushttps://wikitech.wikimedia.org/wiki/Phawikibugs#Status https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs You can write user-defined functions (or UDFs) which encapsulate complex query logic for easy reuse within Hive. Using an existing UDFhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Using_an_existing_UDF Using Reflect UDFhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Using_Reflect_UDF Writing a UDFhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Writing_a_UDF Testing a UDF you just wrotehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Testing_a_UDF_you_just_wrote On Stat*https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#On_Stat* On Huehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#On_Hue Testing changes to existing UDFhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Testing_changes_to_existing_UDF Debugginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Debugging Sampling Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Sampling_Data With predefined bucketshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#With_predefined_buckets Without predefined bucketshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Without_predefined_buckets Using Hive UDFs with Sparkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#Using_Hive_UDFs_with_Spark About multi-threaded environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#About_multi-threaded_environment About Serializationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#About_Serialization See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#See_also Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Querying_using_UDFs#References https://wikitech.wikimedia.org/wiki/Shell_Request/Ribbles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geagea Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deathnerd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MasayaMizuhara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gott71 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pokras Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phrmaedits Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Magier_Der_Schwarzen_Magie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daniel.m.maxwell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AlStudant Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Housewifehacker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Orgads Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruabazhaye Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krabina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Itsxiaode Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lanjiang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Caoxuan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ArthuruhtrA Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qodevoms Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jhernandez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shiminsh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomthirteen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hqhhguwh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marshallsumter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jrf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jboy90730 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zvcrgtwm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wallin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinoguy1000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/EventLogging/Storage/PurgeData Read the newest data retention and auto-purging criteria and implementation here: Schemas that can be purgedhttps://wikitech.wikimedia.org/wiki/EventLogging/Storage/PurgeData#Schemas_that_can_be_purged Purging mechanismhttps://wikitech.wikimedia.org/wiki/EventLogging/Storage/PurgeData#Purging_mechanism https://wikitech.wikimedia.org/wiki/Shell_Request/Sudhir123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lesliek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kevinleslie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darenwelsh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jkatz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Katemzzc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hnxbyoix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wmareci Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naewddcq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hublwvdn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Itncbpar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ymfjuchd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BurntSushi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gsazspst Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hardiholpus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Katehqyf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mipmlqim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pkhucsar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Colteeck Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rkcapqrw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lrpqfiwe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jwjjlfyb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ciagusjb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jjhuswfc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TomerFried Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bxwdyljb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uzrgtqfq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Trankil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmcclory Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilxgypuz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cydrobolt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wjvxnblo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Efvhmxbj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Samudranb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qrjoehoo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ugcjsdny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wdnylnih Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bjcacjsf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dkonto Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ratin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jwzozygo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gcfokueu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Czauyzfm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hhnnmyqu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zhvqrefu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dutfobey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rnelson0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bepqcnyo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wwaqivoz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uiizykeq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sergio-mtz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Tan.corp.wikimedia.org tan[1-4].corp. Networkhttps://wikitech.wikimedia.org/wiki/Category:Network https://wikitech.wikimedia.org/wiki/Shell_Request/Roviluca Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dubtrubal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edward_Chernenko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jayanthan_JC Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sickdbcx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sbfdgpdx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stewx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kateuauu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oxtuopnt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atjia27 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hckiang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xsctraxr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bkrhptep Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jcnlmyhr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rnavunanmuth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rbaasland Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Liliya_Rafikova Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jvdclioz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Zap/Hat Zap and Hat represent our current and future MediaWiki application server stacks. Zaphttps://wikitech.wikimedia.org/wiki/Zap/Hat#Zap Hathttps://wikitech.wikimedia.org/wiki/Zap/Hat#Hat https://wikitech.wikimedia.org/wiki/Shell_Request/Jacqvyuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wyywfagj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/D_sivakumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahdev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qfai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Choing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/HHVM == Useful reading material == Useful reading materialhttps://wikitech.wikimedia.org/wiki/HHVM#Useful_reading_material Light processeshttps://wikitech.wikimedia.org/wiki/HHVM#Light_processes Usage of APChttps://wikitech.wikimedia.org/wiki/HHVM#Usage_of_APC Packaginghttps://wikitech.wikimedia.org/wiki/HHVM#Packaging Adding patcheshttps://wikitech.wikimedia.org/wiki/HHVM#Adding_patches Upgrade HHVM to a new upstream versionhttps://wikitech.wikimedia.org/wiki/HHVM#Upgrade_HHVM_to_a_new_upstream_version Rebuild the packageshttps://wikitech.wikimedia.org/wiki/HHVM#Rebuild_the_packages Troubleshootinghttps://wikitech.wikimedia.org/wiki/HHVM#Troubleshooting Config changeshttps://wikitech.wikimedia.org/wiki/HHVM#Config_changes https://wikitech.wikimedia.org/wiki/Shell_Request/Jmdeppif Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lbertolotti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Exezbhmm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fcbkjova Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tilt_power Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rapportani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madhurimachatterjee03 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HermannSchwaerzler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch#Summary First Timehttps://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch#First_Time Second Timehttps://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch#Second_Time Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141027-CirrusSearch#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Anjali Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vgangpr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Roel013666 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Graphite/Scaling graphite is used to store/display/aggregate both system-level metrics and application-level metrics. Currently, most of the metrics come in via statsd for aggregation/calculation via UDP and then written to graphite (carbon-relay). problemshttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#problems solutionshttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#solutions performance: revisit aggregation periodshttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance:_revisit_aggregation_periods availability: statsd+graphite active/standby behind LVShttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#availability:_statsd+graphite_active/standby_behind_LVS availability: statsd+graphite clustered setup behind LVShttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#availability:_statsd+graphite_clustered_setup_behind_LVS performance+availability: switch graphite backendhttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance+availability:_switch_graphite_backend performance+availability: influxdb backendhttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance+availability:_influxdb_backend performance+availability: cassandra backend (cyanite)https://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance+availability:_cassandra_backend_(cyanite) performance+availability: cassandra backend (newts)https://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance+availability:_cassandra_backend_(newts) performance+availability: opentsdb backendhttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance+availability:_opentsdb_backend performance+availability: switch away from graphitehttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#performance+availability:_switch_away_from_graphite clusteringhttps://wikitech.wikimedia.org/wiki/Graphite/Scaling#clustering current setup as of 2014/11/14https://wikitech.wikimedia.org/wiki/Graphite/Scaling#current_setup_as_of_2014/11/14 current setup as of 2015/10/02https://wikitech.wikimedia.org/wiki/Graphite/Scaling#current_setup_as_of_2015/10/02 https://wikitech.wikimedia.org/wiki/Shell_Request/Icebear Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mmtoiuwr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wmsifnpy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qykkgote Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gipsctia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fhocutt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vijayan012 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zykova.alzbeta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hwlvbmpe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Risingflames39 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lnqzqeor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yxpgfuak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juanto121 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Drdmjzfi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stwhyrpl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Llgxltbv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mszell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Samirjoglekar1234 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VictorBjelkholm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ozbkkzfpj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kiwuser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Snohh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Csersoft Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wolbo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chayyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hcritcxpe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dand0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pwufvvcav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lars.roemheld Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deemeng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xetqpklyr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Viptipnip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Masashi_Morikawa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apmartos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sreelakshmi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Mobile_Reportcard NOTE: This dashboard is no longer available. Contact the Wikimedia Editing and Reading teams to find out their plans for it. How to get access to stat1006https://wikitech.wikimedia.org/wiki/Mobile_Reportcard#How_to_get_access_to_stat1006 How to create new graphs and dashboardshttps://wikitech.wikimedia.org/wiki/Mobile_Reportcard#How_to_create_new_graphs_and_dashboards 1. Install Limnhttps://wikitech.wikimedia.org/wiki/Mobile_Reportcard#1._Install_Limn 2. Install analytics-limn-mobile-datahttps://wikitech.wikimedia.org/wiki/Mobile_Reportcard#2._Install_analytics-limn-mobile-data 3. Configure analytics-limn-mobile-datahttps://wikitech.wikimedia.org/wiki/Mobile_Reportcard#3._Configure_analytics-limn-mobile-data 4. View Mobile Graphshttps://wikitech.wikimedia.org/wiki/Mobile_Reportcard#4._View_Mobile_Graphs https://wikitech.wikimedia.org/wiki/Shell_Request/Tteoeolsg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qtbocftpp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gbuluvxtf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pierrebeldor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankit_Maity Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dhandapani87 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sferrini Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Earjan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkoneko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Finny100 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Onilqmue Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pptuelno Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/OCG/Open_Tasks See phab:maniphest/query/EGrxClpdjFF_/#R Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Shell_Request/Qvbjivcb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/J5lx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Voddlyasg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Buizqdth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ewjnvlcb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gographinsight Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flammekueche Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GPHemsley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shweta_Chandrakant_Pawar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thuya_Myo_Nyunt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freephile Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pyguerder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tsmiley3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grandlynx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harrisonfeng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn "I use EventLogging to collect data, and I'd like a dashboard to visualize it." Make repository for queries and configurationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Make_repository_for_queries_and_configuration Make Limn instancehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Make_Limn_instance Configure cron to generate datahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Configure_cron_to_generate_data Get SQL and configuration Just Right (TM)https://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Get_SQL_and_configuration_Just_Right_(TM) Disclose your dashboardhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Disclose_your_dashboard Expected time spenthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Expected_time_spent Supporthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Dashboards_-_Limn#Support https://wikitech.wikimedia.org/wiki/Shell_Request/Hvaara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure Cloud VPS is a virtualization cloud that uses OpenStack Compute. Base images are managed with Glance, and authentication uses LDAP-backed Keystone. Cloud VPS Eqiad (Ashburn, VA)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Cloud_VPS_Eqiad_(Ashburn,_VA) Regionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Regions Horizonhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Horizon Controllerhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Controller Networkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Network Virtualizationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Virtualization Storagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Storage Monitoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#Monitoring LDAPhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#LDAP DNShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Infrastructure#DNS https://wikitech.wikimedia.org/wiki/Shell_Request/Diegottt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mihau Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/HHVM/Troubleshooting == Problem determination and data collection == Problem determination and data collectionhttps://wikitech.wikimedia.org/wiki/HHVM/Troubleshooting#Problem_determination_and_data_collection Light process dyinghttps://wikitech.wikimedia.org/wiki/HHVM/Troubleshooting#Light_process_dying https://wikitech.wikimedia.org/wiki/Shell_Request/Hangd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shahzaib.qasim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141106-Labstore == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141106-Labstore#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141106-Labstore#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141106-Labstore#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141106-Labstore#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Prodigalsun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25 == September 30 == September 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_30 September 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_29 September 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_28 September 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_27 September 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_26 September 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_25 September 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_24 September 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_23 September 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_22 September 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_21 September 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_20 September 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_19 September 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_18 September 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_17 September 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_16 September 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_15 September 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_14 September 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_13 September 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_12 September 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_11 September 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_10 September 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_9 September 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_8 September 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_7 September 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_6 September 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_5 September 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_4 September 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_3 September 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_2 September 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#September_1 August 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_31 August 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_30 August 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_29 August 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_28 August 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_26 August 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_25 August 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_24 August 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_23 August 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_22 August 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_21 August 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_20 August 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_19 August 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_18 August 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_17 August 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_16 August 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_15 August 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_14 August 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_13 August 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_12 August 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_11 August 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_10 August 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_9 August 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_8 August 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_7 August 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_6 August 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_5 August 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_4 August 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_3 August 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_2 August 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#August_1 July 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_31 July 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_30 July 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_29 July 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_28 July 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_27 July 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_26 July 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_25 July 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_24 July 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_23 July 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_22 July 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_21 July 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_20 July 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_19 July 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_18 July 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_17 July 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_16 July 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_15 July 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_14 July 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_13 July 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_12 July 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_11 July 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_4 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#July_1 June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_25#April_1 https://wikitech.wikimedia.org/wiki/Shell_Request/Eldhose104 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Icampbell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rubberpaw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venireman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wpryvuaz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/XSmeets Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cdwddf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Itonic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joosep-Georg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hxbaljblwv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marcos_dias_de_oliveira Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tabzcqxn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjxkcjhd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Tor_relay Wikimedia Foundation runs a tor relay in the past. https://wikitech.wikimedia.org/wiki/Shell_Request/Jflsldob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Psyko0815 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Redcau Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinswujc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Getaaron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Favarect Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Infungano Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prerfarce Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zsprackett Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Demndom21eqz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Firtina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jee1mr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinswddf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinswgdx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Demndom21xir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Demndom21vch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Biancini Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Feldo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Basvb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Henery1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrew_Su Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ost316 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fayyazurrehman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bobbyshabangu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nitin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Agrachit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fsteinel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweefvqoerged Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fedenko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srovevzz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Npmtravis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Crkukla1993 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ahdian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bztnnbzu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amruthsoft9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141113-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141113-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141113-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141113-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141113-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Francinum Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tpre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ckoerner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fabiano_Tatsch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nkaihcuo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wgpghihi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rolphin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Josher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ziqumu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Royce Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Psixsmyq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Riskmanager53 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reticulated_Spline Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tiefpunkt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maries5150 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LtPowers Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deba Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DaviKaur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ridwaan.sayyed Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rtrad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sanjay_jbp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rtnpro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tischler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jonatamarcelino Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gvaibhavraj2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lbillett Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LeonNef Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/West1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho == Pentaho instance on labs == Pentaho instance on labshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Pentaho_instance_on_labs Start/Stop Pentahohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Start/Stop_Pentaho Import Cubehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Import_Cube Dump the data you want to import into a TSV filehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Dump_the_data_you_want_to_import_into_a_TSV_file Create a table in the database Pentaho is looking athttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Create_a_table_in_the_database_Pentaho_is_looking_at Import the data into the newly created tablehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Import_the_data_into_the_newly_created_table Create an XML file with the cube descriptionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Create_an_XML_file_with_the_cube_description Upload the cube file to Pentahohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pentaho#Upload_the_cube_file_to_Pentaho https://wikitech.wikimedia.org/wiki/Shell_Request/Jdouglas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mintao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Richhiey1996 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Demize Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smalyshev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hedoport Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcwemlshoerkbi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjbmr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Waliwali Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweicjtoerwrb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timesking Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tbhgeo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CAMPUS21_EU_project Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lilianatinoco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweckvwoerkch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shubhabala Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rcmiller356 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141118-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141118-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141118-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141118-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141118-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Sanschezzz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141114-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141114-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141114-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141114-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141114-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster The consumer side of event logging can be easily tested on Beta Cluster. Instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Instance How to create test eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#How_to_create_test_events How to log a client-side event to Beta Cluster directlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#How_to_log_a_client-side_event_to_Beta_Cluster_directly How to log via the websitehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#How_to_log_via_the_website How to load test with a bunch of eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#How_to_load_test_with_a_bunch_of_events How to verify eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#How_to_verify_events Validated eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Validated_events In MySQLhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#In_MySQL In fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#In_files In Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#In_Kafka Raw stream of events (including unvalidated events)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Raw_stream_of_events_(including_unvalidated_events) Where is eventlogging code?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Where_is_eventlogging_code? See all EventLogging schema Kafka topicshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#See_all_EventLogging_schema_Kafka_topics Databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Database Adminhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Admin Give people accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Give_people_access How to deploy codehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#How_to_deploy_code Restart EventLogginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/TestingOnBetaCluster#Restart_EventLogging https://wikitech.wikimedia.org/wiki/Shell_Request/Github Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Livha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amper Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KKcorps Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eduardo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankit_Sood Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dan_Koehl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tracemedia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Destroyer5k7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BENWORK83 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/FAQ == Data Requests == Data Requestshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/FAQ#Data_Requests What is the Analytics Cluster?https://wikitech.wikimedia.org/wiki/Analytics/Archive/FAQ#What_is_the_Analytics_Cluster? How do I transfer files between stat boxes?https://wikitech.wikimedia.org/wiki/Analytics/Archive/FAQ#How_do_I_transfer_files_between_stat_boxes? What do I do if I don't know what to dohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/FAQ#What_do_I_do_if_I_don't_know_what_to_do https://wikitech.wikimedia.org/wiki/Shell_Request/DarkPrince Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PtQa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pravox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qlypjtif Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maraton Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DaFranker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash Hadoop consists of several components running on several hosts with several logfiles, some stored inside HDFS. To make this less irritating, we send copies of all log events to a central location: Logstash! ELK Stackhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#ELK_Stack Event sourceshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Event_sources Logstash: stream processinghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Logstash:_stream_processing Inputhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Input Filteringhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Filtering Outputhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Output Elasticsearchhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Elasticsearch Kibanahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Kibana FAQhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#FAQ How do I find the error when my job fails?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#How_do_I_find_the_error_when_my_job_fails? How do I see the details of an event?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#How_do_I_see_the_details_of_an_event? How do I narrow my results?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#How_do_I_narrow_my_results? Querieshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Queries Filtershttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Filters Date rangehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Date_range Excluding event typeshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Excluding_event_types How do I automatically see new events as they arrive?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#How_do_I_automatically_see_new_events_as_they_arrive? Why is my query so slow?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Why_is_my_query_so_slow? How do I make my own dashboard?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#How_do_I_make_my_own_dashboard? How do I share what I've found using Kibana?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#How_do_I_share_what_I've_found_using_Kibana? Hadoop logging configurationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#Hadoop_logging_configuration See alsohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hadoop_-_Logstash#See_also https://wikitech.wikimedia.org/wiki/Phabricator [is an open-source software development platform. In Wikimedia, Phabricator is used for project management, software bug reporting, and feature requests. Operations Projects Workflowshttps://wikitech.wikimedia.org/wiki/Phabricator#Operations_Projects_Workflows Hardware Request Stagehttps://wikitech.wikimedia.org/wiki/Phabricator#Hardware_Request_Stage Hardware/Server Setup / Deployment Stage Workflowhttps://wikitech.wikimedia.org/wiki/Phabricator#Hardware/Server_Setup_/_Deployment_Stage_Workflow Misc. Production Virtual Machine Requests Workflowhttps://wikitech.wikimedia.org/wiki/Phabricator#Misc._Production_Virtual_Machine_Requests_Workflow Administrative Commandshttps://wikitech.wikimedia.org/wiki/Phabricator#Administrative_Commands Dump the entire databasehttps://wikitech.wikimedia.org/wiki/Phabricator#Dump_the_entire_database Remove a repohttps://wikitech.wikimedia.org/wiki/Phabricator#Remove_a_repo Remove a filehttps://wikitech.wikimedia.org/wiki/Phabricator#Remove_a_file Ban a userhttps://wikitech.wikimedia.org/wiki/Phabricator#Ban_a_user Delete a userhttps://wikitech.wikimedia.org/wiki/Phabricator#Delete_a_user Removing Two Factor Authenticationhttps://wikitech.wikimedia.org/wiki/Phabricator#Removing_Two_Factor_Authentication Revoking a Conduit tokenhttps://wikitech.wikimedia.org/wiki/Phabricator#Revoking_a_Conduit_token Revoking a user's sessionshttps://wikitech.wikimedia.org/wiki/Phabricator#Revoking_a_user's_sessions Revoking a user's ssh keyshttps://wikitech.wikimedia.org/wiki/Phabricator#Revoking_a_user's_ssh_keys Rebuild phabricator search indexhttps://wikitech.wikimedia.org/wiki/Phabricator#Rebuild_phabricator_search_index Revert all activity of a given userhttps://wikitech.wikimedia.org/wiki/Phabricator#Revert_all_activity_of_a_given_user Converting a parent project into a subprojecthttps://wikitech.wikimedia.org/wiki/Phabricator#Converting_a_parent_project_into_a_subproject Run a bulk job silently (suppressing notification spam)https://wikitech.wikimedia.org/wiki/Phabricator#Run_a_bulk_job_silently_(suppressing_notification_spam) read-only mode / restarting mariadbhttps://wikitech.wikimedia.org/wiki/Phabricator#read-only_mode_/_restarting_mariadb Disabling a Herald rulehttps://wikitech.wikimedia.org/wiki/Phabricator#Disabling_a_Herald_rule Check on a Phabricator userhttps://wikitech.wikimedia.org/wiki/Phabricator#Check_on_a_Phabricator_user Unlocking edit permissions on a taskhttps://wikitech.wikimedia.org/wiki/Phabricator#Unlocking_edit_permissions_on_a_task Unlocking edit permissions on random objectshttps://wikitech.wikimedia.org/wiki/Phabricator#Unlocking_edit_permissions_on_random_objects Mail debugginghttps://wikitech.wikimedia.org/wiki/Phabricator#Mail_debugging Ban an IP addresshttps://wikitech.wikimedia.org/wiki/Phabricator#Ban_an_IP_address Rate Limitinghttps://wikitech.wikimedia.org/wiki/Phabricator#Rate_Limiting Network Architecturehttps://wikitech.wikimedia.org/wiki/Phabricator#Network_Architecture Fixing Common Problemshttps://wikitech.wikimedia.org/wiki/Phabricator#Fixing_Common_Problems PhutilMissingSymbolExceptionhttps://wikitech.wikimedia.org/wiki/Phabricator#PhutilMissingSymbolException Phabricator is intermittently down or slowhttps://wikitech.wikimedia.org/wiki/Phabricator#Phabricator_is_intermittently_down_or_slow Pybal alerts for git-ssh after rebooting Phabricator servershttps://wikitech.wikimedia.org/wiki/Phabricator#Pybal_alerts_for_git-ssh_after_rebooting_Phabricator_servers Failure Scenarios / Failoverhttps://wikitech.wikimedia.org/wiki/Phabricator#Failure_Scenarios_/_Failover Simple failure of the phabricator serverhttps://wikitech.wikimedia.org/wiki/Phabricator#Simple_failure_of_the_phabricator_server Steps to fail-over an existing Phabricator server to a new serverhttps://wikitech.wikimedia.org/wiki/Phabricator#Steps_to_fail-over_an_existing_Phabricator_server_to_a_new_server Steps to re-create a warm standby serverhttps://wikitech.wikimedia.org/wiki/Phabricator#Steps_to_re-create_a_warm_standby_server Complete data center failoverhttps://wikitech.wikimedia.org/wiki/Phabricator#Complete_data_center_failover Master database failurehttps://wikitech.wikimedia.org/wiki/Phabricator#Master_database_failure Referenceshttps://wikitech.wikimedia.org/wiki/Phabricator#References External linkshttps://wikitech.wikimedia.org/wiki/Phabricator#External_links https://wikitech.wikimedia.org/wiki/Incidents/20141125-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141125-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141125-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141125-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141125-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Lorenzocipriani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hkjacksonhk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darklca Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141126-ocg == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141126-ocg#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141126-ocg#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141126-ocg#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141126-ocg#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20141126-oauth == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141126-oauth#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141126-oauth#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141126-oauth#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141126-oauth#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/APictche Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/01 === Week of January 6 === Week of January 6https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/01#Week_of_January_6 Week of January 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/01#Week_of_January_13 Week of January 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/01#Week_of_January_20 Week of January 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/01#Week_of_January_27 https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/02 === Week of February 3 === Week of February 3https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/02#Week_of_February_3 Week of February 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/02#Week_of_February_10th Week of February 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/02#Week_of_February_17th Week of February 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/02#Week_of_February_24th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/03 === Week of March 3rd === Week of March 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/03#Week_of_March_3rd Week of March 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/03#Week_of_March_10th Week of March 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/03#Week_of_March_17th Week of March 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/03#Week_of_March_24th Week of March 31sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/03#Week_of_March_31st https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/04 === Week of April 7th === Week of April 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/04#Week_of_April_7th Week of April 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/04#Week_of_April_14th Week of April 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/04#Week_of_April_21st Week of April 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/04#Week_of_April_28th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/05 === Week of May 5th === Week of May 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/05#Week_of_May_5th Week of May 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/05#Week_of_May_12th Week of May 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/05#Week_of_May_19th Week of May 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/05#Week_of_May_26th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/06 === Week of June 2nd === Week of June 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/06#Week_of_June_2nd Week of June 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/06#Week_of_June_9th Week of June 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/06#Week_of_June_16th Week of June 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/06#Week_of_June_23rd Week of June 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/06#Week_of_June_30th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/07 === Week of July 7th === Week of July 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/07#Week_of_July_7th Week of July 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/07#Week_of_July_14th Week of July 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/07#Week_of_July_21st Week of July 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/07#Week_of_July_28th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/08 === Week of August 4th === Week of August 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/08#Week_of_August_4th Week of Aug 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/08#Week_of_Aug_11th Week of Aug 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/08#Week_of_Aug_18th Week of Aug 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/08#Week_of_Aug_25th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/09 === Week of September 1st === Week of September 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/09#Week_of_September_1st Week of September 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/09#Week_of_September_8th Week of September 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/09#Week_of_September_15th Week of September 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/09#Week_of_September_22nd Week of September 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/09#Week_of_September_29th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/10 === Week of October 6th === Week of October 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/10#Week_of_October_6th Week of October 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/10#Week_of_October_13th Week of October 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/10#Week_of_October_20th Week of October 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/10#Week_of_October_27th https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/11 === Week of November 3rd === Week of November 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/11#Week_of_November_3rd Week of November 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/11#Week_of_November_10th Week of November 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/11#Week_of_November_17th Week of November 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/11#Week_of_November_24th https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcwepulgoerdjl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweofiyoerfco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tizitob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tamslo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Soeren.oldag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dominic.sauer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dimitri.schmidt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jonaskeutel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andreasburmeister Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Krishna262 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Catbirdsongs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Allworldson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cactus26 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweqhscoerdqj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Digimer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweqehdoeriiv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ranja008 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexander_Mashin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JogoBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Foo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boblast Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/David.c.welch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xvcweqsukoerjjk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Mathoid Mathoid is a stateless Node.js service hosted in the Kubernetes cluster. Deploymenthttps://wikitech.wikimedia.org/wiki/Mathoid#Deployment Monitoringhttps://wikitech.wikimedia.org/wiki/Mathoid#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/Mathoid#Troubleshooting Logshttps://wikitech.wikimedia.org/wiki/Mathoid#Logs Fail-overhttps://wikitech.wikimedia.org/wiki/Mathoid#Fail-over Restarting a Podhttps://wikitech.wikimedia.org/wiki/Mathoid#Restarting_a_Pod Restarting all pods for the servicehttps://wikitech.wikimedia.org/wiki/Mathoid#Restarting_all_pods_for_the_service See alsohttps://wikitech.wikimedia.org/wiki/Mathoid#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Uatici Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Marek69 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Citoid Citoid is a stateless Node.js service running in Kubernetes. Updatinghttps://wikitech.wikimedia.org/wiki/Citoid#Updating Deploymenthttps://wikitech.wikimedia.org/wiki/Citoid#Deployment Monitoringhttps://wikitech.wikimedia.org/wiki/Citoid#Monitoring Logshttps://wikitech.wikimedia.org/wiki/Citoid#Logs Statshttps://wikitech.wikimedia.org/wiki/Citoid#Stats See alsohttps://wikitech.wikimedia.org/wiki/Citoid#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Dsptokesnz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dpstokesnz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jedipi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Secretname101 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Temptuousinsolence Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Patrug Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emeric84 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hoang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Warpinswqrz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mloc-gci Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/McIntireEvan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Regzand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashwinpp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M1r0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hannolans Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141130-Eqiad-Rack-C4 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141130-Eqiad-Rack-C4#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141130-Eqiad-Rack-C4#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141130-Eqiad-Rack-C4#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141130-Eqiad-Rack-C4#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Unicodesnowman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tymon.r Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gunter_Shwartz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prozmamw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kanjy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xwqthhry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vdeylbse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rwong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ggellerman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mlawnik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wadyx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Egraf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vigneshv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daviskr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/David_Greydanus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ggzdexfq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JoseJimenezNYC Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Csheedyp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bdegrafft Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Etuvxkgx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cjsihbmk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jcrhatcj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ceypdjja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarigabr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/David392 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rzhonjlb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qbbgmtgf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ljudusika Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Heiser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sparkandsmile Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nphubhhe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Padmanaban1027 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asrajmane193 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Djjwdawavm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ph Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qxcryvir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gxxpgafrqa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aaron_Beaty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aaronbeaty123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bobrayner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Almagul_Ibragimova Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KevinPayravi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vctmpxhg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bddpaux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fredebertog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OR_drohowa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gaiusjuliuscaesarsalad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phani.vemulapalli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thatiparthy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kronf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zaed.zaman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shpysmiyqb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hichris123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MusikAnimal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kelson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sdqhoirigy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tony_Tan_98 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alatec Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Poori Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sathiamour Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/IKhitron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sushma_Reddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DikkieDick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sinsrj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ewpsxigq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dfko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kidbees Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lnpzvirolt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Unicornisaurous Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ads7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mlabarre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OWS1981 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thomas5 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mpolon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fouad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jnash99 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pingram Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swanhtet1992 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gituserscm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mirzali Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freddan80 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Slepice1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aman0506 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anshoe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tradihassen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments = webrequest = webrequesthttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#webrequest Load Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#Load_Data Experimentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#Experiments wmf_raw.webrequest (JSON)https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#wmf_raw.webrequest_(JSON) webrequest_parquet_clustered_snappy (Clustered Parquet no sorting)https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#webrequest_parquet_clustered_snappy_(Clustered_Parquet_no_sorting) webrequest_parquet_clustered_snappy_sorted (Clustered Parquet with sorting)https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#webrequest_parquet_clustered_snappy_sorted_(Clustered_Parquet_with_sorting) Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#Results revision xmldumpshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#revision_xmldumps create hive tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Data_Format_Experiments#create_hive_tables https://wikitech.wikimedia.org/wiki/Shell_Request/Damln Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phoenix303 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Whitevil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deebee412 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kabhi2104 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zsnsbd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Paju Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Practikalmind Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Choose3344444 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ukexpat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12 === Week of December 1st === Week of December 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12#Week_of_December_1st Week of December 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12#Week_of_December_8th Week of December 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12#Week_of_December_15th Week of December 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12#Week_of_December_22nd Week of December 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12#Week_of_December_29th https://wikitech.wikimedia.org/wiki/Shell_Request/Natebailey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sudha_Chandran Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xumeng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Namit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gogo212121 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srgkmpot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eytan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xapl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Toolboxx8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yrayupvpta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gph004 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Octzivdtum Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchersre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Coatavetle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Slakr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Praveen_shukla Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchergfi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherupx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyroxdh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BWBW Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherwlz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eshapiro42 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BeeBoffin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sudharsananvvdn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jkt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%C3%81l Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mzwiyqilwu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Martini69290 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ddueodjfuh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Applicab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nuled Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Givemeascream Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swpb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dzkzhoge Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sumit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phamvanmmki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ddrager Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brokedahmouth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pajz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Unify_Everything Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mobrovac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ghcnauumln Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Testuser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Spencerk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhinand1234 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eeevanbbb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ashishk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Btrvvzpjbn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DaMax Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qkixifpvpd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rictagu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tekny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qrfvnzesax Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Datingnew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maheshmns Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Monclerrcfv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Julien2512 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ani310 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fkarimighasemi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moncleruiak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Autobiz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/HS97 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Benjavalero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Topfirms Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xdb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ngadv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BATESY1979 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dianakc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Owellpromise Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruboudew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Skipper Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gamweb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Knohl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zulis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lgretton Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Performance/Metrics This page documents metrics provided by Wikimedia Performance. We collect metrics using real user monitoring, running synthetic tests and some backend metrics. navtiminghttps://wikitech.wikimedia.org/wiki/Performance/Metrics#navtiming Milestoneshttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Milestones Durationshttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Durations See alsohttps://wikitech.wikimedia.org/wiki/Performance/Metrics#See_also Save Timinghttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Save_Timing Backend Save Timinghttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Backend_Save_Timing Frontend Save Timinghttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Frontend_Save_Timing Synthetic tests metricshttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Synthetic_tests_metrics Visual Metricshttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Visual_Metrics Google Web Vitalshttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Google_Web_Vitals Other metricshttps://wikitech.wikimedia.org/wiki/Performance/Metrics#Other_metrics CruXhttps://wikitech.wikimedia.org/wiki/Performance/Metrics#CruX https://wikitech.wikimedia.org/wiki/Shell_Request/Morristech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ananthrk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Husn_97 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Husn79 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Husun1297 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gerard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sputniza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dlhbaew Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Soumyadip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Georggi199 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Polybuildr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Treffflirt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Muhammedabuali.e Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Georggi1999 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Divyang.ch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ChetanAnandK Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VictorBrice Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sterndeuter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Agirldate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zart9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phoenix101 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Webysther Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vghphzwj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hbuvzmbg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmassindia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Indielives010 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhilashkrishn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smita786 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Warrior2005 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Artshanda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuglxmob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ptolusque Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TechOP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adarsh_lr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nishita Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Datesingle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rajparikh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Futur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RuchirangaW Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maituanmte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques Determining the number of distinct elements in a set (known as cardinality estimation) is a challenge when the set is very large. Since computing the exact cardinality of a set is linear in the cardinality itself, algorithms should be used to approximate cardinality in many of our use cases. Challengehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#Challenge Samplinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#Sampling Linear Probabilistic Counterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#Linear_Probabilistic_Counter HyperLogLoghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#HyperLogLog Better than HyperLogLoghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#Better_than_HyperLogLog Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#Hive Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Counting_uniques#References https://wikitech.wikimedia.org/wiki/Shell_Request/GseSro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Userblaz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Antonipedia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goelakash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Milad_A380 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Namans Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RowanBeentje Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jehovahsays Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Plalseged Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Itsthedoc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wikipedian_2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bharath_g Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dbarish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Username112 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Obaid_Raza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Earth_god_blasting Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adu_beach Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anmol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yowhann Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jedrzej44 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The_death_wish2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Beimbrink Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sergei68 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mohammednasiruddin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mnasiruddin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chocozoan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nirjal_shrestha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danial Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PranavK Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chameleon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Apoo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gmbo_2013 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ho_Kwon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bharath1097 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harmageddon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jitendriyag2a Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Poulpy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aeuswwa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aflirting Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS This page contains information about how DNS domains are setup in Cloud VPS and Toolforge. Domain nameshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#Domain_names *.wikimediacloud.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.wikimediacloud.org *.wmcloud.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.wmcloud.org *.{deployment}.wikimedia.cloudhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.{deployment}.wikimedia.cloud *.{vlan-shortname}.{datacenter}.wikimedia.cloudhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.{vlan-shortname}.{datacenter}.wikimedia.cloud *.toolforge.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.toolforge.org *.svc.toolforge.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.svc.toolforge.org Legacy domainshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#Legacy_domains *.{datacenter}.wmflabshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.{datacenter}.wmflabs *.wmflabs.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#*.wmflabs.org Servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#Servers See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Tapananand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AnjaJentzsch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TigerII Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Antonbabenko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015#By_month https://wikitech.wikimedia.org/wiki/Shell_Request/Eacrzrobu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150103-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150103-Parsoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150103-Parsoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150103-Parsoid#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150103-Parsoid#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Pkgupta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FRAYK Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jbhunley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rushi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20141118-m2 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141118-m2#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141118-m2#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20141118-m2#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141118-m2#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20141122-m2 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20141122-m2#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20141122-m2#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20141122-m2#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20140919-s1 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20140919-s1#Summary Observations and questions:https://wikitech.wikimedia.org/wiki/Incidents/20140919-s1#Observations_and_questions: Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20140919-s1#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150106-Zuul == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150106-Zuul#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150106-Zuul#Timeline Diagnostichttps://wikitech.wikimedia.org/wiki/Incidents/20150106-Zuul#Diagnostic Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150106-Zuul#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150106-Zuul#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Xitec75 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andiazamuddin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darioklaric Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vodnokon4e Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaiprout1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carvey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raheel102 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raheel1021 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tr4nt0r Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fnnamadim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fmsistemas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ntplstg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Misza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Malek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fcaneto Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150107-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150107-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150107-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150107-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150107-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Sridhar.kdb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jam90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VIGNERON Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juanmi108 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dhnetwork22 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bushra_khan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Balan3000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eacrcrogn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Datefemale Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lockerkao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kuebi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CAMPUS21_Middleware Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ms7821 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srlakhe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery Refinery is the software infrastructure that is used on the Analytics Cluster. The source code is in the [repository]. How to deployhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery#How_to_deploy Deploying to clouddumps* hostshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery#Deploying_to_clouddumps*_hosts Deploying to Hadoop testhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery#Deploying_to_Hadoop_test https://wikitech.wikimedia.org/wiki/Shell_Request/MageJohn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DennisRoczek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qubit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harryo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Heeraj123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Afandian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ak792 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhathihan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Becky_Sayles Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adatechat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AnuradhaW Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nmura Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Webrequest_partitions_monitorin == Monitoring == Monitoringhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webrequest_partitions_monitorin#Monitoring Icinga monitoringhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webrequest_partitions_monitorin#Icinga_monitoring Manual monitoringhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webrequest_partitions_monitorin#Manual_monitoring Dealing with faulty partitionshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Webrequest_partitions_monitorin#Dealing_with_faulty_partitions https://wikitech.wikimedia.org/wiki/Shell_Request/Rmikeovc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Celizqnh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cmariatma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Martin_Siddall Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fauzan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bgerstle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/01 === Week of Jan 5th === Week of Jan 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/01#Week_of_Jan_5th Week of Jan 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/01#Week_of_Jan_12th Week of 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/01#Week_of_19th Week of 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/01#Week_of_27th https://wikitech.wikimedia.org/wiki/Shell_Request/Fjalapeno Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Twoolvqx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lpumixff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gantoniowbo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eacrfrosx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Revent Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eacryrocy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robertkeizer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DiscantX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ayushimrigen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fredflintstone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rishabhc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Byrappa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ihsanushshabri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pavkata88 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aakankshap Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eacrbropa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bsdking Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anishvisa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arihant Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johnnieblows Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Baffo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankitdarji Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maths22 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuvipanda-test1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaldari2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NoahM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gaebel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/XmlRcs XmlRcs is a transforming proxy for Event Platform/EventStreams (Wikimedia's recent changes feed) that exposes data as XML instead of JSON, using a lightweight TCP connection with a few simple commands. It runs as a volunteer maintained service in the Wm-bot Cloud VPS project. Rationalehttps://wikitech.wikimedia.org/wiki/XmlRcs#Rationale How it workshttps://wikitech.wikimedia.org/wiki/XmlRcs#How_it_works Commandshttps://wikitech.wikimedia.org/wiki/XmlRcs#Commands Shttps://wikitech.wikimedia.org/wiki/XmlRcs#S Dhttps://wikitech.wikimedia.org/wiki/XmlRcs#D clearhttps://wikitech.wikimedia.org/wiki/XmlRcs#clear stathttps://wikitech.wikimedia.org/wiki/XmlRcs#stat pinghttps://wikitech.wikimedia.org/wiki/XmlRcs#ping exithttps://wikitech.wikimedia.org/wiki/XmlRcs#exit Outputhttps://wikitech.wikimedia.org/wiki/XmlRcs#Output errorhttps://wikitech.wikimedia.org/wiki/XmlRcs#error fatalhttps://wikitech.wikimedia.org/wiki/XmlRcs#fatal warninghttps://wikitech.wikimedia.org/wiki/XmlRcs#warning okhttps://wikitech.wikimedia.org/wiki/XmlRcs#ok edithttps://wikitech.wikimedia.org/wiki/XmlRcs#edit Maintainer infohttps://wikitech.wikimedia.org/wiki/XmlRcs#Maintainer_info C# Libraryhttps://wikitech.wikimedia.org/wiki/XmlRcs#C#_Library Launching an instancehttps://wikitech.wikimedia.org/wiki/XmlRcs#Launching_an_instance https://wikitech.wikimedia.org/wiki/Shell_Request/%D0%98%D1%81%D1%82%D0%B5%D0%BD%D0%BD%D1%8B%D0%B9 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Djacksnn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kpumibou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/578985s Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geotheory Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/.avgas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Giorgi_Balakhadze Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Samneet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Warshy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Etonkovidova Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Running_tests This page could be deleted... once you have installed CiviCRM from docker .. https://wikitech.wikimedia.org/wiki/Shell_Request/Tianshijian Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Debugging_in_production == Debugging a web request == Debugging a web requesthttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debugging_a_web_request Externallyhttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Externally Directlyhttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Directly Pushing code to a debug serverhttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Pushing_code_to_a_debug_server Debug via Gerrit and Scaphttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debug_via_Gerrit_and_Scap Debug directly on the serverhttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debug_directly_on_the_server Conditional codehttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Conditional_code Testing ithttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Testing_it Debugging databaseshttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debugging_databases Debugging a maintenance scripthttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debugging_a_maintenance_script Debugging logshttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debugging_logs Debugging in shellhttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Debugging_in_shell Ad-hoc log messageshttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Ad-hoc_log_messages Ad-hoc command line logginghttps://wikitech.wikimedia.org/wiki/Debugging_in_production#Ad-hoc_command_line_logging https://wikitech.wikimedia.org/wiki/Shell_Request/Vnichuwn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lwoolpob Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hbushhqn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zelizxar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cmikexwb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ijackgmm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Npumitnz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DukeAnt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pratikbsp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/How_jackson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zankan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wiki_user_1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eacrsrovc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Minsukang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carloshwa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gwoolpyt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xobamakisqj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmariarmf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ejackmly Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umikenev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Imariapzx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zantonioybx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shanepaulsen1st Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qnichttl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yantoniofyc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pmikerab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zelizija Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kmikeczs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iobamakibuu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Enichmkv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xbushbxg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wwikirqj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zeliztdx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pwoolgkv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pantoniobiq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%E6%9C%9D%E5%BD%A6 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umikesqy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Emariafph Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Upuminnj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sobamakiftt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Selizqmu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Straz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qpumiqcn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smikecmh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/UrvashiS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Upumiurs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amishas157 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Strazpdj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankita-ks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xnichqlo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gnouan007 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wayko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prasoon2211 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ant%C3%B3nio_Jos%C3%A9_de_Magalh%C3%A3es Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vaibhav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siddhism Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cheatiiit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chethana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Douglashowe50 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dating96 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wbushena Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rits Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NehalDaveND Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dmikegws Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mcapdevila Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Napoleoni Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Snichaeo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Upumiaac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moritz_Hartig Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bmariancd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mnwjbkoerhko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Codewizard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Datingon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fantoniowby Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shalinshal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qioixiy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mahesh.rao78 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dwoolxwj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vmikenrs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ojackzgi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Delanohelio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fmariaakn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xhauma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wowpanda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Delizrtl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/A.bottamedi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iofirag Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rwikivlu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maxinvestigator Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Agooddate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yobamakicee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mjackcpk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Levente.balogh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nantoniolef Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dobamakioqy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xobamakidrx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jjackvus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umariahvp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Allenlipeng47 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahulkonda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joeygreen1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jacksonisaac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chris.welhoelter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johns Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jmariakbp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fpumipkk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ajacktqp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madhawi_De_Mel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fiquiero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madhuvishy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hajalesbos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dominus_Arbitrationis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Angel1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ceyockey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dr.Abdullah_Al_Noman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Therude1$un Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lcossin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Teo8976 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Specter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swapnil978 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sen.jve Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oobamakifqn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zwikizqf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lelizxsp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rafael.triani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jotpe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Inkey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Senen.j.v.estuista Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hayderimran7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Onichtjq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Umikexxr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rpumikxm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ikdokov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gitgerrit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jpumigdj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pwooljjg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Felizhup Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattfordham Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Virt1009_casualties These are the instances currently trapped on a catatonic virt1009. Note that the 'Status' field is not accurate -- they are /all/ SHUTOFF. https://wikitech.wikimedia.org/wiki/Shell_Request/Bentogoa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GermanJoe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adre Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhilash_Mhaisne Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The_Photographer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alireza Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Celia12 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Multimedia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akovacs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ybura Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bekannt6 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stefano.desabbata Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uwolfer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PatrickS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lmikeapm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nirzar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/S%C3%B8ren1997 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattrobenolt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dateonce Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Renessaince Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AndySky21 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xobamakiywk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Unichnyx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hobamakixpz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lahwaacz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankit_ks15 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zdzislaw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ch1902 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jfeik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qpumipgq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Felizsjb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Borys_Kozielski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AYUSH_GARG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cosydate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neha526 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ayusharma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Matthiaspalmer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pureiris Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/African_Hope Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shelly Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elevatorman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bacondrinker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Khaled Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alawfirm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reubot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amunozhernan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Azam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tharindakasun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/G0013y Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ILEX.Lin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tejdeepg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bertcenino Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JeanBono Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Evvy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MnemonicFlow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lotka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jbcrail Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cenarium Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Misaochaaan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Redaf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Mysql/Utility_Datasets The analytics MySQL server on analytics-store.eqiad. country_infohttps://wikitech.wikimedia.org/wiki/Data_Platform/Mysql/Utility_Datasets#country_info https://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests Here you can request help from the SRE team ([Site Reliability Engineering|Wikimedia Site Reliability Engineering]), or one of its sub teams. Urgent issueshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Urgent_issues Phabricatorhttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Phabricator Access requestshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Access_requests Domain requestshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Domain_requests Hardware requestshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Hardware_requests Virtual machine requests (Production)https://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Virtual_machine_requests_(Production) Kubernetes Service Requests (Production)https://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Kubernetes_Service_Requests_(Production) Other Purchases: SSL Certificates, Support Contractshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Other_Purchases:_SSL_Certificates,_Support_Contracts Mail aliaseshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Mail_aliases Mailing listshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Mailing_lists Creation requestshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Creation_requests Administrationhttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Administration Patch reviewhttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Patch_review Network configurationhttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Network_configuration Schema changeshttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#Schema_changes IRChttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#IRC SRE mailing listhttps://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests#SRE_mailing_list https://wikitech.wikimedia.org/wiki/Shell_Request/Magalabastro Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150205-SiteOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150205-SiteOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150205-SiteOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150205-SiteOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150205-SiteOutage#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Morsik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jabloki_indun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GridKiller Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WsgWiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Waggers Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gamer496 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sdc248 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150205-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150205-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150205-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150205-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150205-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Canaar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Foxsch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tullis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution ==Objective== Objectivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Objective Outcomehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Outcome Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Caveats Botshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Bots Redirectshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Redirects Privacyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Privacy Technicalitieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Technicalities How we are counting: Plain Englishhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#How_we_are_counting:_Plain_English How we are counting: Technical explanationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#How_we_are_counting:_Technical_explanation Using the value of the WMF-Last-Access cookiehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Using_the_value_of_the_WMF-Last-Access_cookie Nocookie Offsethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Nocookie_Offset How big of a percentage does the offset represent from the total?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#How_big_of_a_percentage_does_the_offset_represent_from_the_total? The redirect issue on unique device counts for project familieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#The_redirect_issue_on_unique_device_counts_for_project_families Data Quality Analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Data_Quality_Analysis Unique devices per-domainhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Unique_devices_per-domain How did we determined this 1000 number for the per-domain uniqueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#How_did_we_determined_this_1000_number_for_the_per-domain_uniques Unique devices per project-familyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Unique_devices_per_project-family Numbershttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#Numbers More docshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution#More_docs https://wikitech.wikimedia.org/wiki/Shell_Request/Bennatjose Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wayneguindon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DrLulzMD Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gizmoabhinav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mpalacios81 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bbrabbit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaikaiyunle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kyle0692 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jarrettmunton Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Valcapri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daniel_Musto Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Smthomas1704 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flirtweb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CAS222222221 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tootis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iltever Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cxyshine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ameenkhan07 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/02 === Week of February 2nd === Week of February 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/02#Week_of_February_2nd Week of February 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/02#Week_of_February_9th Week of February 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/02#Week_of_February_16th Week of February 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/02#Week_of_February_23rd https://wikitech.wikimedia.org/wiki/Shell_Request/QEDK Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Evanontario Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thcipriani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Logkiwikitech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vaishalivvdn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iwan_Novirion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Istarodu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Denace Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anujmenta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NLW.LLGC Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zacchaeus_ajayi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kiana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kianaforeversweetie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SebastianSchaffert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Wikitech-static-canary This page is used to track synchronization issues with wikitech-static. Its content is largely arbitrary. https://wikitech.wikimedia.org/wiki/Shell_Request/Backflirts Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Logkinwikitech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cblair91 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Techm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bugreporter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/EChastain Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maxine Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Corrigan.blanchfield Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tormate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Borradopedia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Romit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ebekebe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gauravgupta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mikaelstaldal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gabrielshell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VcamX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mbuechner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yangtong Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nealmcb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neechalkaran Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jsalsman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dchen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TakahashiNZ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdhollo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mayeenul_Islam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eyeflirter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taintedsnowqueen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Whaterss Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rampan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rohanjaswal2507 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mmo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26 == December 31 == December 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_31 December 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_30 December 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_29 December 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_27 December 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_25 December 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_24 December 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_23 December 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_22 December 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_21 December 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_20 December 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_19 December 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_18 December 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_17 December 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_16 December 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_15 December 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_14 December 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_13 December 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_12 December 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_11 December 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_10 December 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_9 December 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_8 December 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_7 December 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_6 December 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_5 December 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_4 December 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_3 December 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_2 December 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#December_1 November 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_30 November 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_29 November 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_28 November 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_27 November 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_26 November 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_25 November 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_24 November 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_23 November 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_22 November 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_21 November 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_20 November 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_19 November 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_18 November 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_17 November 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_16 November 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_15 November 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_14 November 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_13 November 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_12 November 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_11 November 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_10 November 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_9 November 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_8 November 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_7 November 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_6 November 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_5 November 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_4 November 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_3 November 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_2 November 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#November_1 October 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_31 October 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_30 October 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_29 October 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_28 October 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_27 October 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_26 October 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_25 October 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_24 October 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_23 October 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_22 October 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_21 October 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_20 October 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_19 October 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_18 October 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_17 October 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_16 October 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_15 October 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_14 October 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_13 October 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_12 October 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_11 October 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_10 October 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_9 October 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_8 October 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_7 October 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_6 October 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_5 October 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_4 October 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_3 October 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_2 October 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_26#October_1 https://wikitech.wikimedia.org/wiki/Shell_Request/GameOn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rommen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nangel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Akki007 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Imaculate Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mrtnj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AndrewBelt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dragan_Espenschied Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Josue_leiva_477 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Das_Beta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TrickLin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mavaddat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling = Backfilling a kafka eventlogging_<Schema> topic = Backfilling a kafka eventlogging_<Schema> topichttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Backfilling_a_kafka_eventlogging_topic Get all events from kafka topics for a given timeframehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Get_all_events_from_kafka_topics_for_a_given_timeframe Backfilling refinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Backfilling_refine Backfilling sanitizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Backfilling_sanitization Prerequirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Prerequirements First step (data preparation)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#First_step_(data_preparation) Raw Eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Raw_Events Second step (data injection)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Second_step_(data_injection) Checkout a separate clone of EventLogginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Checkout_a_separate_clone_of_EventLogging Start a Backfilling Consumerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Start_a_Backfilling_Consumer Monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Backfilling#Monitoring https://wikitech.wikimedia.org/wiki/Shell_Request/Kbrijender Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Petteraas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MMakarand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bharatsamar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bodrak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oetterer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/R0bin_G00dfell0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kartheek3011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bluyello Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Donald22 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wubwubwub Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150217-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150217-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150217-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150217-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150217-LabsOutage#Actionables Affected Instanceshttps://wikitech.wikimedia.org/wiki/Incidents/20150217-LabsOutage#Affected_Instances https://wikitech.wikimedia.org/wiki/Shell_Request/Chamal_N Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PavelFedorov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mouni1995 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Austin5600 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Baggio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alpha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vsheppil Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Meghadureja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neksos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexeygrigorev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhaktipriya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Serenalsx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aniketgupta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rs00344192 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mssola Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tulsi_Bhagat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jasonllgc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tiberiu.b Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Glyndwr.1400 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rlakoud Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NoiseDoll Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abigor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheMetalHead1999 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pann06 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sayeed.sprd.bd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ramdesh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Javad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lklundin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Esquivalience Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venkykrishnan77 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Luke081515 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kovl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zack90 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Netuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shackra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ldap_hosts == Labs ldap host entries are now a thing of the past. == Labs ldap host entries are now a thing of the past.https://wikitech.wikimedia.org/wiki/Ldap_hosts#Labs_ldap_host_entries_are_now_a_thing_of_the_past. Welcome to the futurehttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Welcome_to_the_future How things worked before we started making changeshttps://wikitech.wikimedia.org/wiki/Ldap_hosts#How_things_worked_before_we_started_making_changes Standard host recordhttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Standard_host_record Public IP recordhttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Public_IP_record Potential replacementshttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Potential_replacements Private IP recordshttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Private_IP_records Nova DNShttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Nova_DNS Designatehttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Designate Something elsehttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Something_else Public IP recordshttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Public_IP_records Puppet configurationhttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Puppet_configuration NFS Scriptshttps://wikitech.wikimedia.org/wiki/Ldap_hosts#NFS_Scripts Host records, remnantshttps://wikitech.wikimedia.org/wiki/Ldap_hosts#Host_records,_remnants https://wikitech.wikimedia.org/wiki/Shell_Request/Arunavkonwar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Khushbuparakh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arindam1991 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/MailingList The public Analytics mailing list is the main place where researchers, WMF analytics team members, data enthusiasts, other WMF staff, etc., talk about a variety of Analytics topics. https://wikitech.wikimedia.org/wiki/Shell_Request/Harshvardhan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shivam_Vats Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johniculusus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/EchoLynx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jaykishanss23 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dinsrajpurohit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LNDDYL Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darkdragon09 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150224-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150224-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150224-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150224-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150224-LabsOutage#Actionables Affected Instanceshttps://wikitech.wikimedia.org/wiki/Incidents/20150224-LabsOutage#Affected_Instances https://wikitech.wikimedia.org/wiki/Shell_Request/Akankshaav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abdulsidahmed Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ms96 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gustronico Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sinitski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Suveer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest The webrequest stream contains data on all the hits to Wikimedia's servers. This includes requests for page HTML, images, CSS, and Javascript, as well as requests to the API. Pipelinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Pipeline Processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Process Varnishhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Varnish Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Kafka Gobblinhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Gobblin Refine Webrequesthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Refine_Webrequest Pipeline Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Pipeline_Administration Corrupted Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Corrupted_Data wmf.webrequesthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#wmf.webrequest Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Current_Schema Usage noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Usage_notes Sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Sample_queries Distinct IPshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Distinct_IPs Top raw referrals for an articlehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Top_raw_referrals_for_an_article Top internal referrals for an articlehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Top_internal_referrals_for_an_article Top outbound clicks from an articlehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Top_outbound_clicks_from_an_article Changes and known problems since 2015-03-04https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Changes_and_known_problems_since_2015-03-04 wmf_raw.webrequesthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#wmf_raw.webrequest Data statisticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Data_statistics Querying the statisticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Querying_the_statistics API requestshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#API_requests RAW IP usage for IP Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#RAW_IP_usage_for_IP_Data Derived streamshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Derived_streams See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#See_also Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Notes https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic Traffic refers to pageviews to the pages of a wiki project. This page links to detailed information about traffic datasets in the Data Lake. Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic#Datasets Hive tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic#Hive_tables Dumpshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic#Dumps Deprecated or Obsolete Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic#Deprecated_or_Obsolete_Datasets Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic#Access Historyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic#History https://wikitech.wikimedia.org/wiki/Shell_Request/Mobilessbiz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flixtey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150206-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150206-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150206-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150206-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150206-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Sergio_ECURED Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goodtimefamilyband Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mthakkar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tom_ando01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Georg123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Commander_hellboy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pantel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vipdura Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Noon22c Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nilmadhab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bartvb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SPIKE_SPIKE_BAD Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts The mediacounts stream holds counts of how often an image, video, or audio file from upload.wikimedia. Contained datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Contained_data Selected requestshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Selected_requests Corner caseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Corner_cases Fieldshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Fields Availabilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Availability dumps.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#dumps.wikimedia.org stat machineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#stat_machines Analytics clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Analytics_cluster Clientshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Clients Events and known problems since 2015-01-01https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#Events_and_known_problems_since_2015-01-01 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Mediacounts#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Siarhei.netuk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Railyards Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin Documentation of backend components and admin procedures for Toolforge. See Help:Toolforge for user facing documentation about actually using Toolforge to run your bots and webservices. Admin permissionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Admin_permissions Failoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Failover WebProxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#WebProxy Static webserverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Static_webserver Checker servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Checker_service Redishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Redis Prometheushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Prometheus Serviceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Services Command orchestrationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Command_orchestration Administrative taskshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Administrative_tasks Logging in as roothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Logging_in_as_root Disabling all ssh logins except roothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Disabling_all_ssh_logins_except_root Complaints of bastion being slowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Complaints_of_bastion_being_slow Local package managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Local_package_management Local package policyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Local_package_policy Building packageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Building_packages Deploy new misctools packagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Deploy_new_misctools_package Testing/QA for a new tools-webservice packagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Testing/QA_for_a_new_tools-webservice_package Deploy new tools-webservice packagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Deploy_new_tools-webservice_package Webserver statisticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Webserver_statistics Banning an IP from tool labshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Banning_an_IP_from_tool_labs Deploying the main web pagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Deploying_the_main_web_page Regenerate replica.my.cnfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Regenerate_replica.my.cnf Debugging bad MariaDB credentialshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Debugging_bad_MariaDB_credentials Regenerate kubernetes credentials for tools (.kube/config)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Regenerate_kubernetes_credentials_for_tools_(.kube/config) Adding K8S Componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Adding_K8S_Components Deleting a toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Deleting_a_tool SSL certificateshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#SSL_certificates Granting a tool write access to Elasticsearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Granting_a_tool_write_access_to_Elasticsearch Package upgradeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Package_upgrades Creating a new Docker image (e.g. for new versions of Node.js)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Creating_a_new_Docker_image_(e.g._for_new_versions_of_Node.js) Kuberneteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Kubernetes Build servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Build_service Tools-mail / Eximhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Tools-mail_/_Exim Users and communityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Users_and_community Project membership request approvalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Project_membership_request_approval Quota managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Quota_management Otherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Other How do Toolforge web services actually work?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#How_do_Toolforge_web_services_actually_work? What makes a root/Giving root accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#What_makes_a_root/Giving_root_access Servicegroup loghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Servicegroup_log Useful administrative toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Useful_administrative_tools Brainstorminghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Brainstorming Sub pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Sub_pages https://wikitech.wikimedia.org/wiki/Shell_Request/Ethanlu121 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sakshi123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150227-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150227-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150227-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150227-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150227-LabsOutage#Actionables Vulnerable Instanceshttps://wikitech.wikimedia.org/wiki/Incidents/20150227-LabsOutage#Vulnerable_Instances https://wikitech.wikimedia.org/wiki/Shell_Request/Eevans Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cgt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thparkth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anupriya-i Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Parvjain1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jahandaniyal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gaidesignit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhar19 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Makarand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mdsrbot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Proxibot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thibaut120094 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sofamaniac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fanshu.jiang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Milahaa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xujing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Addonflirt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Johnmageee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lvwyngaa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juanb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Graham_Phillips_110 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geojoyce Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brackenheim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jadriankohls Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clump Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vpisabeywardana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xujing1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Priyadarshini Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sureshmurugesan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhavyashree Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AdiPetrescu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cioroianu.denis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wightler Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xujing2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dumindux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Termininja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Onflirt2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/T106ao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flanzoni1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ellery Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hellboycommander Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sortelli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prakhash Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guy_Macon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mestikon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%E8%8C%83 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pope Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ofus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Foudfou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mosvpd Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bartolomeu.gusella Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Acone Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/03 === Week of March 2nd === Week of March 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/03#Week_of_March_2nd Week of March 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/03#Week_of_March_9th Week of March 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/03#Week_of_March_16th Week of March 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/03#Week_of_March_23rd Week of March 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/03#Week_of_March_30th https://wikitech.wikimedia.org/wiki/Shell_Request/Rvxap6 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Hadoop/Load This page shows how to check the load on the Analytics Cluster without being root and detect if it is getting stalled. Detecting a stalling cluster using only a terminalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Hadoop/Load#Detecting_a_stalling_cluster_using_only_a_terminal Detecting a stalling cluster using only a browserhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Hadoop/Load#Detecting_a_stalling_cluster_using_only_a_browser Further ways to detect a stalling clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Hadoop/Load#Further_ways_to_detect_a_stalling_cluster What to do if the cluster is stalling?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Hadoop/Load#What_to_do_if_the_cluster_is_stalling? https://wikitech.wikimedia.org/wiki/Shell_Request/Locksmithny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eitheror Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dsheahan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Grey-Fox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Scoopfinder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sriteja95 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Niedzielski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chris_Stacey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sweetsugar09 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prime Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Phiju Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Taher2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Klumb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Einyx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Walez Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Talamoig Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aimthesun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Faltur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anders_Feder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kevinlegrand Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AdSvS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Schnark Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lalit_bhakuni Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Green_Zero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/Currency_conversion_sample { https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater reportupdater is a Python program that periodically executes given SQL queries (or scripts with SQL-like output) and appends their results into timeline TSV report files. If you have crons on any of the analytics data machines harvesting data you can likely benefit from using reportupdater. Downloadhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Download Dependencieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Dependencies Queries and scriptshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Queries_and_scripts SQL Query conventionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#SQL_Query_conventions Script conventionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Script_conventions Where to put these files?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Where_to_put_these_files? Sample queries executed by other teamshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Sample_queries_executed_by_other_teams Config filehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Config_file The databases sectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#The_databases_section The graphite sectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#The_graphite_section The reports sectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#The_reports_section The defaults sectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#The_defaults_section How to execute?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#How_to_execute? Re-runshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Re-runs WMF-specifichttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#WMF-specific How to test?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#How_to_test? How to productionize?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#How_to_productionize? Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Troubleshooting Where are logs ?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Where_are_logs_? Where is puppet code?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Where_is_puppet_code? Supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Support Next featureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Reportupdater#Next_features https://wikitech.wikimedia.org/wiki/Shell_Request/Misssblettt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jilguero Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bobdinsf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Surlycyborg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amisha_singla Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OwenMooney Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Cowbuilder Documentation available in: https://gerrit.wikimedia. Introductionhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Introduction Setting it uphttps://wikitech.wikimedia.org/wiki/Cowbuilder#Setting_it_up Building packageshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Building_packages Architectureshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Architectures Debugginghttps://wikitech.wikimedia.org/wiki/Cowbuilder#Debugging Additional Reposhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Additional_Repos Wikimedia reposhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Wikimedia_repos Wikimedia Experimental reposhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Wikimedia_Experimental_repos Backports reposhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Backports_repos Archived suiteshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Archived_suites Combining Wikimedia and Backports reposhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Combining_Wikimedia_and_Backports_repos Additional Componentshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Additional_Components Spicerackhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Spicerack Cergenhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Cergen Java 8https://wikitech.wikimedia.org/wiki/Cowbuilder#Java_8 Opensearch 1.0https://wikitech.wikimedia.org/wiki/Cowbuilder#Opensearch_1.0 PHP 7.2https://wikitech.wikimedia.org/wiki/Cowbuilder#PHP_7.2 PHP 7.4https://wikitech.wikimedia.org/wiki/Cowbuilder#PHP_7.4 VP 9https://wikitech.wikimedia.org/wiki/Cowbuilder#VP_9 Using built packages as dependencieshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Using_built_packages_as_dependencies Adding packages from a local directoryhttps://wikitech.wikimedia.org/wiki/Cowbuilder#Adding_packages_from_a_local_directory git-buildpackagehttps://wikitech.wikimedia.org/wiki/Cowbuilder#git-buildpackage Resultshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Results Noteshttps://wikitech.wikimedia.org/wiki/Cowbuilder#Notes Networkinghttps://wikitech.wikimedia.org/wiki/Cowbuilder#Networking Cloud VPShttps://wikitech.wikimedia.org/wiki/Cowbuilder#Cloud_VPS https://wikitech.wikimedia.org/wiki/Shell_Request/Goldengide1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brakefield Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/OS2Warp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ujjwalwahi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%E3%81%A8%E3%81%82%E3%82%8B%E7%99%BD%E3%81%84%E7%8C%AB Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Devwebtel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/IStorry Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FABIO_DUARTE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ngemzinou Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Funttt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chaitanyavarmap Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Satheeshraja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mallareddy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dhananjay92 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mcmoraes963 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sharmaans Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BrandonCsSanders Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MindyGillow Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gskmessi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manhnct Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rbykador Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FrankieRayRobertson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Trey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Biblikonn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Reaper35 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Westonnh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KCCkamaljitchakraborty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pascalraszyk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/$traight-$hoota Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mluczak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nv1620 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jinlong_yang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Twp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Stu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ngertrudiz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eliotbao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sergej.Privalov Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sushrutsg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Harjotsingh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Higagan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mindspillage Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jusblazm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mhughes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RandomDSdevel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freenuxx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pndpo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ferdbold Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pattons Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rberchie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aswathkk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Symmachus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hostmaster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Postmaster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Webmaster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/RobBertholf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chmarkine_test Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chmarkine_test2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kaspar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DSCrowned Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kenta_Kozuka Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bhar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Addi49 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sanderp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PhantomTech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adorazhang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tim_Landscheidt_(Test_for_root) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venesa_Talor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sampadmedda Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sunwicked Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomandcattin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hacimurat.karaman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abiyoyo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150320-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150320-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150320-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150320-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150320-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Salehabdo75 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Huqing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Njethani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Einsbor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150324-Eqiad-Rack-C4 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150324-Eqiad-Rack-C4#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150324-Eqiad-Rack-C4#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150324-Eqiad-Rack-C4#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150324-Eqiad-Rack-C4#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Reezan.mi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark Spark is a powerful engine for processing data on the Analytics Cluster. You can drive it using SQL, Python, R, Java, or Scala. Command-line interfaceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Command-line_interfaces Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Configuration Application Masterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Application_Master Other working exampleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Other_working_examples Hive table Spark writer configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Hive_table_Spark_writer_configuration How do I ...https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#How_do_I_... Use PySpark to run SQL on Hive tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Use_PySpark_to_run_SQL_on_Hive_tables Start a spark shell in yarnhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Start_a_spark_shell_in_yarn Set the python version pyspark should usehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Set_the_python_version_pyspark_should_use See spark logs on my local machine when using spark submithttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#See_spark_logs_on_my_local_machine_when_using_spark_submit Monitor Spark shell job Resourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Monitor_Spark_shell_job_Resources Use Hive UDF with Spark SQLhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Use_Hive_UDF_with_Spark_SQL pyspark and external packageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#pyspark_and_external_packages SparkR in production (stat100* machines) exampleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#SparkR_in_production_(stat100*_machines)_examples SparkR: Basic examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#SparkR:_Basic_example SparkR: Large(er) file from HDFShttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#SparkR:_Large(er)_file_from_HDFS Spark Resource Settingshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Spark_Resource_Settings Regular jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Regular_jobs Large jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Large_jobs Extra large jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Extra_large_jobs Scaling the driverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Scaling_the_driver Executorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#Executors External shuffle servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark#External_shuffle_service https://wikitech.wikimedia.org/wiki/Shell_Request/Zziccardi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gglnx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Snhkicker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Likaihere Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abbes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Salma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Koekiemonster Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hua_Zhenyu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MKGO Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Airwaves-pl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qq170750 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Enocks2010 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aakashrana1995 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vickyjim5 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Violet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madhavilatha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cchiribau Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LorentzFactor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hharchani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ning328 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ning28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Weipengyu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xandi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mattho69 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Luom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ANabeel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vihari Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Castelao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mholloway Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gnouman007 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gnouman786 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abhishekgupta5 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Micgro42 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Laviniaa123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ricken Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Muzikwer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wangfengatustc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jannat.f Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hein56didden Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tikiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/YuzhenWANG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dsw_fajferg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Leocavalcanti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sachin.rajput Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/W2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wolverine21 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Swdickey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Filesystem-Switch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Filesystem-Switch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Filesystem-Switch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Filesystem-Switch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Filesystem-Switch#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Overload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Overload#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Overload#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Overload#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150331-LabsNFS-Overload#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Vipinthomaskc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srcjunior Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moritz_M%C3%BChlenhoff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DZ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GamesDiscussion Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Drr3d Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Zuleger Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Flaxe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150401-LabsNFS-Overload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150401-LabsNFS-Overload#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150401-LabsNFS-Overload#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150401-LabsNFS-Overload#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150401-LabsNFS-Overload#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Ostaski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fiona Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150403-API ==== Summary ==== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150403-API#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150403-API#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150403-API#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150403-API#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Juanman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sethkontny Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gsb-eng Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Siviab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GoldenRing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madhav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Boavoibbondom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/BounceHandler The BounceHandler extension is currently installed 'everywhere' in the production and beta cluster. Here are few notes on where the knobs are, where to look for whats happening. How it workshttps://wikitech.wikimedia.org/wiki/BounceHandler#How_it_works Productionhttps://wikitech.wikimedia.org/wiki/BounceHandler#Production Beta Clusterhttps://wikitech.wikimedia.org/wiki/BounceHandler#Beta_Cluster Main Configuration'shttps://wikitech.wikimedia.org/wiki/BounceHandler#Main_Configuration's Deployment informationhttps://wikitech.wikimedia.org/wiki/BounceHandler#Deployment_information View logs/recordshttps://wikitech.wikimedia.org/wiki/BounceHandler#View_logs/records See alsohttps://wikitech.wikimedia.org/wiki/BounceHandler#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Sbisson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vuh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ecdsa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alexey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Milind7705 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Malfoniusz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Muehlenhoff Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eeprom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Provenance In order to evaluate the effectiveness of social sharing and other similar efforts for Wikimedia projects, a parameter "wprov" can be appended to URLs on a case-by-case basis. This page exists to keep track of reserved values. Description of wprov parameterhttps://wikitech.wikimedia.org/wiki/Provenance#Description_of_wprov_parameter Currently reserved valueshttps://wikitech.wikimedia.org/wiki/Provenance#Currently_reserved_values See alsohttps://wikitech.wikimedia.org/wiki/Provenance#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Malo95 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150408-s2-SiteStatsInit == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150408-s2-SiteStatsInit#Summary Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150408-s2-SiteStatsInit#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150408-s2-SiteStatsInit#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/S7a Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging#Timeline Mon Apr 6 11:15:10 UTC 2015https://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging#Mon_Apr_6_11:15:10_UTC_2015 Mon Apr 6 18:32 UTC 2015https://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging#Mon_Apr_6_18:32_UTC_2015 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150406-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Syyrius Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mustafasevgi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eugen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mwsse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Anandhak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jsmith Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration ==Overview== Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Overview Important noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Important_notes Dependent systemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Dependent_systems Alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Alarms Consumption Lag "Alarms": Burrowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Consumption_Lag_"Alarms":_Burrow Reseting burrow consumer group monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Reseting_burrow_consumer_group_monitoring Dumping data via sqoop from eventlogging to hdfshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Dumping_data_via_sqoop_from_eventlogging_to_hdfs Sqoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Sqoop EventLogging Routine Maintenance for the oncallhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#EventLogging_Routine_Maintenance_for_the_oncall How Toshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#How_Tos Restart all EventLogging processeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Restart_all_EventLogging_processes Start/Stop/Restart individual EventLogging processeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Start/Stop/Restart_individual_EventLogging_processes Backfillinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Backfilling Check logs and errorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Check_logs_and_errors Troubleshoot events coming in in real timehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Troubleshoot_events_coming_in_in_real_time Troubleshoot insufficient permissionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Troubleshoot_insufficient_permission Deploy EventLogginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Deploy_EventLogging Blacklist a schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Blacklist_a_schema Resolve lagging replication between MySQL Master and Slaveshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Resolve_lagging_replication_between_MySQL_Master_and_Slaves Raise log verbosity to debughttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Administration#Raise_log_verbosity_to_debug https://wikitech.wikimedia.org/wiki/Shell_Request/Wiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chjwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Romeirao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BGizzleDesign Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Huben Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/A Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hekaas Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lt910001 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Timeline Thursday Apr 9, 2015https://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Thursday_Apr_9,_2015 Friday Apr 10 - Friday Apr 17, 2015https://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Friday_Apr_10_-_Friday_Apr_17,_2015 Monday Apr 20, 2015https://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Monday_Apr_20,_2015 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150409-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Catchpoint-monitor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kevinkreiser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ancheta_Wis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mwarycha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Clkao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hb20 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jokes_Free4Me Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nighteagle2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Physicaladdress Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brijeshks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kanzat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GRMule Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vicnham Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ekaitz.iriarte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Die Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nerdbert Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xcelfix Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lodaviz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jcook Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Ganeti Ganeti is a clustered virtual machine management software tool built on top of existing virtualization technologies such as Xen or KVM and other open source software. It supports both KVM and Xen. Architecture Overviewhttps://wikitech.wikimedia.org/wiki/Ganeti#Architecture_Overview Ganeti Clustershttps://wikitech.wikimedia.org/wiki/Ganeti#Ganeti_Clusters Hardware Conventionshttps://wikitech.wikimedia.org/wiki/Ganeti#Hardware_Conventions Connect to an existing clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Connect_to_an_existing_cluster Building a new clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Building_a_new_cluster Host Preparationhttps://wikitech.wikimedia.org/wiki/Ganeti#Host_Preparation Node should be in the insetup rolehttps://wikitech.wikimedia.org/wiki/Ganeti#Node_should_be_in_the_insetup_role Ensure hardware virtualization is enabled in BIOShttps://wikitech.wikimedia.org/wiki/Ganeti#Ensure_hardware_virtualization_is_enabled_in_BIOS Ensure 'ganeti' Volume Group is presenthttps://wikitech.wikimedia.org/wiki/Ganeti#Ensure_'ganeti'_Volume_Group_is_present Ensure network bridge(s) are presenthttps://wikitech.wikimedia.org/wiki/Ganeti#Ensure_network_bridge(s)_are_present Generate an RAPI certificate for the clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Generate_an_RAPI_certificate_for_the_cluster Create a SVC record for new clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Create_a_SVC_record_for_new_cluster Assign the Ganeti Puppet rolehttps://wikitech.wikimedia.org/wiki/Ganeti#Assign_the_Ganeti_Puppet_role Routed Ganetihttps://wikitech.wikimedia.org/wiki/Ganeti#Routed_Ganeti Ensure intra-cluster SSH is permitted by the iptables/ferm firewallhttps://wikitech.wikimedia.org/wiki/Ganeti#Ensure_intra-cluster_SSH_is_permitted_by_the_iptables/ferm_firewall Initialize the new clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Initialize_the_new_cluster For routed modehttps://wikitech.wikimedia.org/wiki/Ganeti#For_routed_mode Add the Ganeti group in Netboxhttps://wikitech.wikimedia.org/wiki/Ganeti#Add_the_Ganeti_group_in_Netbox Add nodes to new cluster (or extend an existing one)https://wikitech.wikimedia.org/wiki/Ganeti#Add_nodes_to_new_cluster_(or_extend_an_existing_one) Verify cluster healthhttps://wikitech.wikimedia.org/wiki/Ganeti#Verify_cluster_health Rename the Ganeti grouphttps://wikitech.wikimedia.org/wiki/Ganeti#Rename_the_Ganeti_group Ensure microcode flags are passed down to VM instanceshttps://wikitech.wikimedia.org/wiki/Ganeti#Ensure_microcode_flags_are_passed_down_to_VM_instances Configure a static KVM machine typehttps://wikitech.wikimedia.org/wiki/Ganeti#Configure_a_static_KVM_machine_type Create a test VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Create_a_test_VM Modify an existing clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Modify_an_existing_cluster Destroy the clusterhttps://wikitech.wikimedia.org/wiki/Ganeti#Destroy_the_cluster Listing cluster nodeshttps://wikitech.wikimedia.org/wiki/Ganeti#Listing_cluster_nodes Detecting the master nodehttps://wikitech.wikimedia.org/wiki/Ganeti#Detecting_the_master_node View the job queuehttps://wikitech.wikimedia.org/wiki/Ganeti#View_the_job_queue Cluster upgradeshttps://wikitech.wikimedia.org/wiki/Ganeti#Cluster_upgrades Do the software upgrade (if needed)https://wikitech.wikimedia.org/wiki/Ganeti#Do_the_software_upgrade_(if_needed) Rolling reboothttps://wikitech.wikimedia.org/wiki/Ganeti#Rolling_reboot Failover the masterhttps://wikitech.wikimedia.org/wiki/Ganeti#Failover_the_master Cluster rebalancinghttps://wikitech.wikimedia.org/wiki/Ganeti#Cluster_rebalancing Cluster certificateshttps://wikitech.wikimedia.org/wiki/Ganeti#Cluster_certificates Renew cluster certificateshttps://wikitech.wikimedia.org/wiki/Ganeti#Renew_cluster_certificates Expired cluster certificateshttps://wikitech.wikimedia.org/wiki/Ganeti#Expired_cluster_certificates VM Operationshttps://wikitech.wikimedia.org/wiki/Ganeti#VM_Operations Cluster operationshttps://wikitech.wikimedia.org/wiki/Ganeti#Cluster_operations Differences with the regular VM provisioninghttps://wikitech.wikimedia.org/wiki/Ganeti#Differences_with_the_regular_VM_provisioning Limitationshttps://wikitech.wikimedia.org/wiki/Ganeti#Limitations Noteshttps://wikitech.wikimedia.org/wiki/Ganeti#Notes Future/possible improvementshttps://wikitech.wikimedia.org/wiki/Ganeti#Future/possible_improvements Node operationshttps://wikitech.wikimedia.org/wiki/Ganeti#Node_operations Reboot/Shutdown for maintenance a nodehttps://wikitech.wikimedia.org/wiki/Ganeti#Reboot/Shutdown_for_maintenance_a_node VMs without DRBD disk templatehttps://wikitech.wikimedia.org/wiki/Ganeti#VMs_without_DRBD_disk_template Shutdown a node for a prolonged period of timehttps://wikitech.wikimedia.org/wiki/Ganeti#Shutdown_a_node_for_a_prolonged_period_of_time Failed hardware nodehttps://wikitech.wikimedia.org/wiki/Ganeti#Failed_hardware_node VM operationshttps://wikitech.wikimedia.org/wiki/Ganeti#VM_operations Listing VMshttps://wikitech.wikimedia.org/wiki/Ganeti#Listing_VMs Create a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Create_a_VM Verify cluster resource availabilityhttps://wikitech.wikimedia.org/wiki/Ganeti#Verify_cluster_resource_availability Assign a hostnamehttps://wikitech.wikimedia.org/wiki/Ganeti#Assign_a_hostname Create partman confighttps://wikitech.wikimedia.org/wiki/Ganeti#Create_partman_config Create the VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Create_the_VM Install the operating systemhttps://wikitech.wikimedia.org/wiki/Ganeti#Install_the_operating_system Sync Hiera from Netboxhttps://wikitech.wikimedia.org/wiki/Ganeti#Sync_Hiera_from_Netbox Assign role to the VM in puppethttps://wikitech.wikimedia.org/wiki/Ganeti#Assign_role_to_the_VM_in_puppet Delete a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Delete_a_VM Shutdown/startup a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Shutdown/startup_a_VM Get a console for a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Get_a_console_for_a_VM SPICEhttps://wikitech.wikimedia.org/wiki/Ganeti#SPICE Resize a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Resize_a_VM Increase/Decrease CPU/RAMhttps://wikitech.wikimedia.org/wiki/Ganeti#Increase/Decrease_CPU/RAM Adding disk spacehttps://wikitech.wikimedia.org/wiki/Ganeti#Adding_disk_space Adding a diskhttps://wikitech.wikimedia.org/wiki/Ganeti#Adding_a_disk Removing a diskhttps://wikitech.wikimedia.org/wiki/Ganeti#Removing_a_disk Reinstall / Reimage a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Reinstall_/_Reimage_a_VM Renumber (aka change network) a VMhttps://wikitech.wikimedia.org/wiki/Ganeti#Renumber_(aka_change_network)_a_VM Set boot orderhttps://wikitech.wikimedia.org/wiki/Ganeti#Set_boot_order Change disk template for a VM (aka drop DBRD)https://wikitech.wikimedia.org/wiki/Ganeti#Change_disk_template_for_a_VM_(aka_drop_DBRD) Automated stepshttps://wikitech.wikimedia.org/wiki/Ganeti#Automated_steps Manual stepshttps://wikitech.wikimedia.org/wiki/Ganeti#Manual_steps Memory pressurehttps://wikitech.wikimedia.org/wiki/Ganeti#Memory_pressure Accessing the APIhttps://wikitech.wikimedia.org/wiki/Ganeti#Accessing_the_API Manual recovery from partial installhttps://wikitech.wikimedia.org/wiki/Ganeti#Manual_recovery_from_partial_install Netbox naming disambiguationhttps://wikitech.wikimedia.org/wiki/Ganeti#Netbox_naming_disambiguation https://wikitech.wikimedia.org/wiki/Shell_Request/Angkorbet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150413-LabsNFS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150413-LabsNFS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150413-LabsNFS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150413-LabsNFS#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150413-LabsNFS#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding =Background= Backgroundhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Background First Stepshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#First_Steps Wikimedia tech employee orientationhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Wikimedia_tech_employee_orientation Wikimedia accounthttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Wikimedia_account E-mail listshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#E-mail_lists IRChttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#IRC Office wikihttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Office_wiki Headsethttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Headset Culturehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Culture Getting permitshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Getting_permits Wikitech/Cloud VPShttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Wikitech/Cloud_VPS Phabricatorhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Phabricator LDAPhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#LDAP Mediawikihttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Mediawiki Accessing production infrastructurehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Accessing_production_infrastructure Shell access to Wikimedia cluster and production infrastructurehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Shell_access_to_Wikimedia_cluster_and_production_infrastructure Sample ssh confighttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Sample_ssh_config Logging inhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Logging_in Gerrithttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Gerrit Processhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Process Google Calendarhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Google_Calendar Optional accountshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Optional_accounts Operating Systemhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Operating_System Mischttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Misc Design Documentshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Design_Documents Sync toolshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Sync_tools IDEs and editorshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#IDEs_and_editors Searchinghttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Searching Environment simulationhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Environment_simulation Further Reading and Reference Materialhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Onboarding#Further_Reading_and_Reference_Material https://wikitech.wikimedia.org/wiki/Shell_Request/Hprmedina Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nodepoolmanager Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Aezana Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150406-Flow == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150406-Flow#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150406-Flow#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150406-Flow#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150406-Flow#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Owenks Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mkengudelu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/04 === Week of April 6th === Week of April 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/04#Week_of_April_6th Week of April 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/04#Week_of_April_13th Week of April 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/04#Week_of_April_20th Week of April 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/04#Week_of_April_27th https://wikitech.wikimedia.org/wiki/Shell_Request/Jannvck Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neil_P._Quinn-WMF Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tpalo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hammertkh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Embertrails Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/D33tah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tclaret Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/I.yeckehzaare Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Arturo.Martin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sumithitachi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davepetty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Misscrazyrarity Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Genium Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danielhochman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/B Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sheiss Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/PHPASPCJQ Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dgdiego Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Onlinebetku Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wangguan1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tampio Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Raja Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Feifeiwang7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews === Summary === Summaryhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews#Summary Detailshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews#Details Comparing current and legacy pageviewshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews#Comparing_current_and_legacy_pageviews https://wikitech.wikimedia.org/wiki/Shell_Request/Dlink Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rainbowint Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asheshmishra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/PGP_Keys This article provides a brief summary/introduction on use of PGP encryption in the wikimedia.org infrastructure. Installationhttps://wikitech.wikimedia.org/wiki/PGP_Keys#Installation Key creationhttps://wikitech.wikimedia.org/wiki/PGP_Keys#Key_creation Publishing your keyhttps://wikitech.wikimedia.org/wiki/PGP_Keys#Publishing_your_key Signing keyshttps://wikitech.wikimedia.org/wiki/PGP_Keys#Signing_keys Renewing keyshttps://wikitech.wikimedia.org/wiki/PGP_Keys#Renewing_keys Revoking Keyshttps://wikitech.wikimedia.org/wiki/PGP_Keys#Revoking_Keys Using PGP in your mail clienthttps://wikitech.wikimedia.org/wiki/PGP_Keys#Using_PGP_in_your_mail_client https://wikitech.wikimedia.org/wiki/Shell_Request/Joel_Glenn_Wright Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barthie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Blacklisttest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Atotallyinoffensivename Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thomas_d_stewart Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cbluth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DannyH_(WMF) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NO5Jay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/FNDE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cipher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jd9511 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jackelynoh85 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mma Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ibrar_wali Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oknadweri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Guitarman0831 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xami Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rafael.chiafarelli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline === Value Proposition === Value Propositionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Value_Proposition Objectivehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Objective Key Resulthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Key_Result Requirementshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Requirements Designhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Design Phase 1https://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Phase_1 Phase 2https://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Phase_2 Phase 3https://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Phase_3 Roadmap & Timelinehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/EventLogging_pipeline#Roadmap_&_Timeline https://wikitech.wikimedia.org/wiki/Incidents/20150423-Commons == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150423-Commons#Summary Graphshttps://wikitech.wikimedia.org/wiki/Incidents/20150423-Commons#Graphs Taskshttps://wikitech.wikimedia.org/wiki/Incidents/20150423-Commons#Tasks Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150423-Commons#Conclusions https://wikitech.wikimedia.org/wiki/Incidents/20150422-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150422-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150422-LabsOutage#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150422-LabsOutage#Actionables Affected Instanceshttps://wikitech.wikimedia.org/wiki/Incidents/20150422-LabsOutage#Affected_Instances https://wikitech.wikimedia.org/wiki/Shell_Request/Sealnk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Performance.wikimedia.org performance.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org#Service perfsitehttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org#perfsite Arc Lamphttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org#Arc_Lamp XHGuihttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org#XHGui See alsohttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org#See_also External linkhttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Graphite1001 == Connecting == Connectinghttps://wikitech.wikimedia.org/wiki/Graphite1001#Connecting https://wikitech.wikimedia.org/wiki/Shell_Request/Rider_ranger47 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid#Timeline How many edits were affected?https://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid#How_many_edits_were_affected? Could this have been detected earlier?https://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid#Could_this_have_been_detected_earlier? Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150424-Parsoid#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Triviallab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ilario Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Potatocat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrewrhunt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tsca Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Klokan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yashmehrotra Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Add_a_New_Gateway ==Adding a New Payment Gateway== Adding a New Payment Gatewayhttps://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Add_a_New_Gateway#Adding_a_New_Payment_Gateway https://wikitech.wikimedia.org/wiki/Shell_Request/Coyewpp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jonnybot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mehdi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lordappsec Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dhanvi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Purple Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/As37221 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wikitech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iain.apreotesei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thompsonbry.systap.wikitech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TheMesquito Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Martyn_cutcher Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yafit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging#Timeline Tuesday, April 28, 20:52https://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging#Tuesday,_April_28,_20:52 Tuesday, April 28, 22:44https://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging#Tuesday,_April_28,_22:44 Tuesday, April 28, 23:03https://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging#Tuesday,_April_28,_23:03 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150428-EventLogging#Conclusions https://wikitech.wikimedia.org/wiki/Incidents/20150429-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150429-Parsoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150429-Parsoid#Timeline Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20150429-Parsoid#Analysis Action itemshttps://wikitech.wikimedia.org/wiki/Incidents/20150429-Parsoid#Action_items https://wikitech.wikimedia.org/wiki/Shell_Request/JM28 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pavlo_Chemist Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Darrenevans Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sweetchuck74 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D0%A8%D1%83%D1%85%D1%80%D0%B0%D1%82_%D0%A1%D0%B0%D1%8A%D0%B4%D0%B8%D0%B5%D0%B2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MerimaKlico Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sniedzielski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/tech/crm/Quirks Potential frustrations when setting up a dev instance of our CiviCRM setup: https://wikitech.wikimedia.org/wiki/Shell_Request/Vikima Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abbas_dhothar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lampuiho Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AS Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hanyou23 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Dickson == Usage == Usagehttps://wikitech.wikimedia.org/wiki/Dickson#Usage Historyhttps://wikitech.wikimedia.org/wiki/Dickson#History https://wikitech.wikimedia.org/wiki/Shell_Request/Connorshea Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wikimech Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fooshard Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KevalPandya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hotpie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vgenapl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Confd Confd is a configuration management system that can actively watch a consistent kv store like etcd or zookeeper and change config files based on templates whenever those key change; it can also tell the service depending on said configs to reload its own configuration. It is ideal to coordinate changes across a cluster almost atomically whenever your application doesn't support the kv store as a config source. How to add a configuration/service to confdhttps://wikitech.wikimedia.org/wiki/Confd#How_to_add_a_configuration/service_to_confd How do you write a template?https://wikitech.wikimedia.org/wiki/Confd#How_do_you_write_a_template? What to expect from confdhttps://wikitech.wikimedia.org/wiki/Confd#What_to_expect_from_confd What should I configure via confd, and what should I use puppet for instead?https://wikitech.wikimedia.org/wiki/Confd#What_should_I_configure_via_confd,_and_what_should_I_use_puppet_for_instead? Making puppet and confd work togetherhttps://wikitech.wikimedia.org/wiki/Confd#Making_puppet_and_confd_work_together Monitoringhttps://wikitech.wikimedia.org/wiki/Confd#Monitoring Compilation is brokenhttps://wikitech.wikimedia.org/wiki/Confd#Compilation_is_broken Stale template error files presenthttps://wikitech.wikimedia.org/wiki/Confd#Stale_template_error_files_present https://wikitech.wikimedia.org/wiki/Shell_Request/Garbord Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150503-JobQueueRedis == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150503-JobQueueRedis#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150503-JobQueueRedis#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150503-JobQueueRedis#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150503-JobQueueRedis#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Scottboydai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Syncgithubbot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Software_deployment = Deploying a software update fleet-wide using debdeploy and debmonitor = Deploying a software update fleet-wide using debdeploy and debmonitorhttps://wikitech.wikimedia.org/wiki/Software_deployment#Deploying_a_software_update_fleet-wide_using_debdeploy_and_debmonitor Deploying a library update fleet-wide using debdeployhttps://wikitech.wikimedia.org/wiki/Software_deployment#Deploying_a_library_update_fleet-wide_using_debdeploy https://wikitech.wikimedia.org/wiki/Shell_Request/Tk7 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Cassandra/Hardware == Instance sizing == Instance sizinghttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#Instance_sizing Mapping of instances to hardwarehttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#Mapping_of_instances_to_hardware Hardware characteristicshttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#Hardware_characteristics Chassis and hardwarehttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#Chassis_and_hardware SSDshttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#SSDs CPU and memory, per instancehttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#CPU_and_memory,_per_instance eqiad RESTBase Clusterhttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#eqiad_RESTBase_Cluster Where we are (as of May 2015)https://wikitech.wikimedia.org/wiki/Cassandra/Hardware#Where_we_are_(as_of_May_2015) Where we are going / what we expectRESTBase capacity planning for 2015/16 ===https://wikitech.wikimedia.org/wiki/Cassandra/Hardware#Where_we_are_going_/_what_we_expectRESTBase_capacity_planning_for_2015/16_=== See alsohttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#See_also Referenceshttps://wikitech.wikimedia.org/wiki/Cassandra/Hardware#References https://wikitech.wikimedia.org/wiki/Shell_Request/Timex Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LourdesAlm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ankitaa.bhowmick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dkg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Graphoid Graphoid was a Node.js service to convert a graph definition into a PNG image installed in Wikimedia production until 2020. Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/Shell_Request/Schizoidfish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral/Settings.xml To deploy to Archiva, you'll need to get the password for the archiva-deploy user, then add a couple of server entries to ~/.m2/settings. See alsohttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral/Settings.xml#See_also https://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral/Pom.xml To deploy to Archiva, make sure your project pom.xml includes Archiva's repository entries in the distributionManagement section: See alsohttps://wikitech.wikimedia.org/wiki/ReleasingToMavenCentral/Pom.xml#See_also https://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging =Phabricator= Phabricatorhttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Phabricator Creating a taskhttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Creating_a_task Writing bugshttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Writing_bugs Screenshotshttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Screenshots Task workflowhttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Task_workflow Fundraising projectshttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Fundraising_projects Dashboardshttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Dashboards Prioritizationhttps://wikitech.wikimedia.org/wiki/Fundraising/Bug_Triaging#Prioritization https://wikitech.wikimedia.org/wiki/Shell_Request/Jony2802 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings Meeting notes from Kraken planning. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview * Date: March 1, 2013 (2:30p - 3:30p) Backgroundhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Background Meeting Noteshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Meeting_Notes Minimum Viable Clusterhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Minimum_Viable_Cluster Dataflow Outlinehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Dataflow_Outline Data Analyst Accesshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Data_Analyst_Access Privacy & Anonymizationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Privacy_&_Anonymization Followupshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Followups Kafka Contractorhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Kafka_Contractor Minimal Viable Clusterhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Minimal_Viable_Cluster Initial Base Clusterhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Initial_Base_Cluster Conclusions & Next Stepshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Kraken/Meetings/ArchitectureReview#Conclusions_&_Next_Steps https://wikitech.wikimedia.org/wiki/Wikimetrics/Adding_New_Features This page has moved to https://wikitech.wikimedia. https://wikitech.wikimedia.org/wiki/Shell_Request/XenoRyet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Masssly Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eros.Chen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ssn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hmavachi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%EC%BD%A9%EA%B0%80%EB%A3%A8 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/The_Explorer97 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Seandw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omar_sansi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150506-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150506-EventLogging#Summary Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150506-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150506-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/VROBU Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eromero_81 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SDKmac Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prashantchikhalkar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Quoth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kharkiv07 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kp96 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ARIENGGO_ARIEX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CreativeKings11 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kenhia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davenquinn Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jcrespo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/05 === Week of May 4th === Week of May 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/05#Week_of_May_4th Week of May 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/05#Week_of_May_11th Week of May 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/05#Week_of_May_18th Week of May 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/05#Week_of_May_25th https://wikitech.wikimedia.org/wiki/Shell_Request/Ciapps Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bnikolaus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bartosz.stanczykowski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uttam_h Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TommyL Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bilardi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hrbackpacker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Fundraising/Translation https://wikitech.wikimedia.org/wiki/Shell_Request/Ulysse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Galorefitz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hanaldo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jose.megido Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omerdemir4 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GuZ-MPG Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Baomi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eyal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pike20 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Natel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cdentinger Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elisa.deko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dominics Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vishakha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/GerritSach Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kamranm1200 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ruoyu_Wang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/VolkerE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gorlingor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Holidaysrating Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dgyesbreghs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bee1977 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/RIPE_Atlas The RIPE Atlas is a distributed network monitoring project to measure reachability and latency. There are two device types, Probes and Anchors. Run tests from the command linehttps://wikitech.wikimedia.org/wiki/RIPE_Atlas#Run_tests_from_the_command_line Country latency measurementhttps://wikitech.wikimedia.org/wiki/RIPE_Atlas#Country_latency_measurement Anchor setuphttps://wikitech.wikimedia.org/wiki/RIPE_Atlas#Anchor_setup https://wikitech.wikimedia.org/wiki/Achernar achernar is a Wikimedia Recursive DNS server (role::dns::recursor). Codfw data centerhttps://wikitech.wikimedia.org/wiki/Category:Codfw_data_center Server usage:Mischttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Misc Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Acamar acamar is a Wikimedia Recursive DNS server (role::dns::recursor). Codfw data centerhttps://wikitech.wikimedia.org/wiki/Category:Codfw_data_center Server usage:Mischttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Misc Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Incidents/20150515-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150515-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150515-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150515-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150515-LabsOutage#Actionables Affected Instanceshttps://wikitech.wikimedia.org/wiki/Incidents/20150515-LabsOutage#Affected_Instances https://wikitech.wikimedia.org/wiki/Shell_Request/Chamli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kittensofdoom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/6c1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MichaelEimke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rafael_Gattringer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lokeshzlti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kevstoy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150518-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150518-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150518-LabsOutage#Timeline Affected instanceshttps://wikitech.wikimedia.org/wiki/Incidents/20150518-LabsOutage#Affected_instances https://wikitech.wikimedia.org/wiki/Shell_Request/Abhi488 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vvvaggot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150519-RESTBase == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150519-RESTBase#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150519-RESTBase#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150519-RESTBase#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150519-RESTBase#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Ikingtheking702 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Omarduarte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Razorderpcakes Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dpatrick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150519-Mailman 2015-05-19 Mailman outage Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150519-Mailman#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150519-Mailman#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150519-Mailman#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150519-Mailman#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150519-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150519-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150519-LabsOutage#Timeline Aftermathhttps://wikitech.wikimedia.org/wiki/Incidents/20150519-LabsOutage#Aftermath Action itemshttps://wikitech.wikimedia.org/wiki/Incidents/20150519-LabsOutage#Action_items https://wikitech.wikimedia.org/wiki/Shell_Request/Kevinchung0921 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Steffen.schild Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahul123 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/P_S Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rahulpatel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Annafatsevych Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Qweet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jiangchao Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB/Backups == Backup and recovery methods == Backup and recovery methodshttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Backup_and_recovery_methods Physical servers and services part of, or related to MariaDB backupshttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Physical_servers_and_services_part_of,_or_related_to_MariaDB_backups Software and deployment architecturehttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Software_and_deployment_architecture Logical backupshttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Logical_backups Orchestration and schedulinghttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Orchestration_and_scheduling Adding a new dumphttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Adding_a_new_dump Recovering a logical backuphttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Recovering_a_logical_backup Pre-requisites before recovering the backuphttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Pre-requisites_before_recovering_the_backup Recovering the datahttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Recovering_the_data Recovering the data (Mariadb 10.6)https://wikitech.wikimedia.org/wiki/MariaDB/Backups#Recovering_the_data_(Mariadb_10.6) Enabling replication on the recovered serverhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Enabling_replication_on_the_recovered_server Snapshoting and disaster recoveryhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Snapshoting_and_disaster_recovery On Remote Snapshottinghttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#On_Remote_Snapshotting Orchestration and Schedulinghttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Orchestration_and_Scheduling Adding a new database to Snapshothttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Adding_a_new_database_to_Snapshot Recovering a Snapshothttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Recovering_a_Snapshot Binary log backups and point in time recoveryhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Binary_log_backups_and_point_in_time_recovery Incremental backups and external storage disaster recoveryhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Incremental_backups_and_external_storage_disaster_recovery Monitoring and metadata gatheringhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Monitoring_and_metadata_gathering Metadatahttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Metadata Alertinghttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Alerting Dashboardhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Dashboard Backup testinghttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Backup_testing Backups quick cheatsheethttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Backups_quick_cheatsheet Provision a precompressed and prepared snapshot (preferred)https://wikitech.wikimedia.org/wiki/MariaDB/Backups#Provision_a_precompressed_and_prepared_snapshot_(preferred) Copy data from a backup source to a hosthttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Copy_data_from_a_backup_source_to_a_host Rerun a failed backuphttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Rerun_a_failed_backup Rerunning a failed snapshothttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Rerunning_a_failed_snapshot Rerunning a failed dumphttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#Rerunning_a_failed_dump See alsohttps://wikitech.wikimedia.org/wiki/MariaDB/Backups#See_also https://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances Sanitarium is the name used for the MySQL/MariaDB instances and configuration that redact private information from the production wiki databases before replicating to the Wiki Replicas instances (clouddbXXXX) which are accessible from the Cloud Services network. Sanitariumhttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Sanitarium role::mariadb::sanitarium_multiinstancehttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#role::mariadb::sanitarium_multiinstance Why separate instanceshttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Why_separate_instances Triggershttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Triggers Private data checkshttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Private_data_checks Wiki Replica viewshttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Wiki_Replica_views Sanitarium's primary failoverhttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Sanitarium's_primary_failover Otherhttps://wikitech.wikimedia.org/wiki/MariaDB/Sanitarium_and_clouddb_instances#Other https://wikitech.wikimedia.org/wiki/Shell_Request/Chewbacca2205 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Edeneco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asupugad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gjhenrique Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews/Aggregation == Value Proposition == Value Propositionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews/Aggregation#Value_Proposition Deliverablehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews/Aggregation#Deliverable Privacyhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews/Aggregation#Privacy Implementationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Pageviews/Aggregation#Implementation https://wikitech.wikimedia.org/wiki/Shell_Request/Bimal2015 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Robert_Schnell Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bsalter Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kjschiroo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jailla_t Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SpartanPlume Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Geekuillaume Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Quentin01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kallen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Saveman71 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ptitnem Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Erget Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Farina_t Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cchardeau Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SachaCarle Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lightblack Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/S5pik3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rare_Sky Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tyldar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Besnar_b Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nokito Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Info-Screen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mehdi314 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Moushira Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jericho25 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prithviravi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Riverbees Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Freaf87 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eaglecode Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Baham baham is a Wikimedia Authoritative DNS server (authdns). (ns1. Codfw data centerhttps://wikitech.wikimedia.org/wiki/Category:Codfw_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Shell_Request/Lizraeli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Golden_Bosnian_Lily Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sarvesh.onlyme Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Iltc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rakeshmick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gedejaya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/parsercache == What does run on pc10[123] hosts and how fast? == What does run on pc10[123] hosts and how fast?https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/parsercache#What_does_run_on_pc10[123]_hosts_and_how_fast? on 5.5.34-MariaDB-1~precise-loghttps://wikitech.wikimedia.org/wiki/MariaDB/query_performance/parsercache#on_5.5.34-MariaDB-1~precise-log on 10.0.16-MariaDB-loghttps://wikitech.wikimedia.org/wiki/MariaDB/query_performance/parsercache#on_10.0.16-MariaDB-log https://wikitech.wikimedia.org/wiki/Shell_Request/Cbewernitz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Haajee1934 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kimmkatt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Barkinet2015 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Z.akhlaghi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vadim Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mahmoud-nasser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Imekki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sercomli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prymshbmg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Venkid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JAufrecht Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Eduardogobi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Prabhakar_Sarma_Neog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Naganaveen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dineshkumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mschmidt00 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Abshir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ewbankj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daisuke.tsukahara Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150527-Cookie 2015-05-27 Cookie incident Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150527-Cookie#Summary Timeline (UTC)https://wikitech.wikimedia.org/wiki/Incidents/20150527-Cookie#Timeline_(UTC) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150527-Cookie#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150527-Cookie#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Ivorah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thamaraiselvam Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jasper88 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine#Timeline 27th May 2015https://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine#27th_May_2015 28th May 2015https://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine#28th_May_2015 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150527-GridEngine#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Emir_Mujadzic Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dalip Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dalipkumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Etcd etcd is a distributed key/value store. Use at WMFhttps://wikitech.wikimedia.org/wiki/Etcd#Use_at_WMF Example "hello world" query listing keyshttps://wikitech.wikimedia.org/wiki/Etcd#Example_"hello_world"_query_listing_keys Operationshttps://wikitech.wikimedia.org/wiki/Etcd#Operations Bootstrapping an etcd clusterhttps://wikitech.wikimedia.org/wiki/Etcd#Bootstrapping_an_etcd_cluster Adding a new member to the clusterhttps://wikitech.wikimedia.org/wiki/Etcd#Adding_a_new_member_to_the_cluster Removing a member from the clusterhttps://wikitech.wikimedia.org/wiki/Etcd#Removing_a_member_from_the_cluster Recover a cluster after a disasterhttps://wikitech.wikimedia.org/wiki/Etcd#Recover_a_cluster_after_a_disaster Reimage nodes a clusterhttps://wikitech.wikimedia.org/wiki/Etcd#Reimage_nodes_a_cluster See alsohttps://wikitech.wikimedia.org/wiki/Etcd#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Leylines-ch Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vieira Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vinay Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tomhill Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/ClementHUBER Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Psneog Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yipincxx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Goodbeebo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Safety_cap Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AkshitKumar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elizabeth_Al-Zallat Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rmarshasatx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Missvain Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Diyiy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nem2s Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Oskar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jouad Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Janak_Bhatta Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dositejx Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nobatp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB/query_performance Here it is a recipe on how to measure query performance in order to compare 2 different servers, or the same server at two different periods of time or with two different mysql versions: Gathering datahttps://wikitech.wikimedia.org/wiki/MariaDB/query_performance#Gathering_data Analysing datahttps://wikitech.wikimedia.org/wiki/MariaDB/query_performance#Analysing_data Reports generatedhttps://wikitech.wikimedia.org/wiki/MariaDB/query_performance#Reports_generated https://wikitech.wikimedia.org/wiki/Shell_Request/Spawn8666 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump This was activated automatically on T101009 on configuration. If you reboot a server that has not been rebooted since then, you can force the dump at shutdown by doing: Pros/conshttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#Pros/cons How to monitor the progresshttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#How_to_monitor_the_progress On the error loghttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#On_the_error_log On the status variableshttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#On_the_status_variables How to abort the loadhttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#How_to_abort_the_load Referenceshttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#References External linkshttps://wikitech.wikimedia.org/wiki/MariaDB/buffer_pool_dump#External_links https://wikitech.wikimedia.org/wiki/Shell_Request/EoRdE6 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sweet200 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WMDE-leszek Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150602-gridengine-dns-failure == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150602-gridengine-dns-failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150602-gridengine-dns-failure#Timeline Conclusionhttps://wikitech.wikimedia.org/wiki/Incidents/20150602-gridengine-dns-failure#Conclusion Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150602-gridengine-dns-failure#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Tkmab3h Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tun-Chieh.Huang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Joyce Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ace Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rajagy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/externalstorage == 5.5. 5.5.30-MariaDB-mariadb1~precise-log (master)https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/externalstorage#5.5.30-MariaDB-mariadb1~precise-log_(master) 10.0.16-MariaDB-log (slave)https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/externalstorage#10.0.16-MariaDB-log_(slave) https://wikitech.wikimedia.org/wiki/Shell_Request/Dagi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Perssonh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hagiani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/People.wikimedia.org people.wikimedia. Connectinghttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Connecting Servicehttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Service How to upload fileshttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#How_to_upload_files How To add SSO Authenticationhttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#How_To_add_SSO_Authentication allow any authenticated usershttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#allow_any_authenticated_users Allow all members of the NDA grouphttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Allow_all_members_of_the_NDA_group Allow only a specific userhttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Allow_only_a_specific_user Allow only users who have authenticated with u2fhttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Allow_only_users_who_have_authenticated_with_u2f Who has accesshttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Who_has_access Redirectshttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#Redirects How to test changeshttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#How_to_test_changes How to perform a switch-over between data centershttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#How_to_perform_a_switch-over_between_data_centers Historyhttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#History Backend switch-over June 2023https://wikitech.wikimedia.org/wiki/People.wikimedia.org#Backend_switch-over_June_2023 Backend switch-over February 2023https://wikitech.wikimedia.org/wiki/People.wikimedia.org#Backend_switch-over_February_2023 Backend upgrade May 2021https://wikitech.wikimedia.org/wiki/People.wikimedia.org#Backend_upgrade_May_2021 Backend upgrade May 2020https://wikitech.wikimedia.org/wiki/People.wikimedia.org#Backend_upgrade_May_2020 Backend upgrade November 2018https://wikitech.wikimedia.org/wiki/People.wikimedia.org#Backend_upgrade_November_2018 External linkshttps://wikitech.wikimedia.org/wiki/People.wikimedia.org#External_links https://wikitech.wikimedia.org/wiki/Shell_Request/Timchan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gobin_Empire Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wuli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/CFCF Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manasser Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ameur_dhawadi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrovvs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150605-redis == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150605-redis#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150605-redis#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150605-redis#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150605-redis#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherest Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jesse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rgaudin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150607-LabsNFS-Outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150607-LabsNFS-Outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150607-LabsNFS-Outage#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150607-LabsNFS-Outage#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Satwik Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepikabhaiya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Athira_s Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Andrea09falco Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ezimon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherwvq Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gauravsaki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jnanaranjan_Sahu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchertqg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shiyan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Danieljohnholmes01 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nova_Tools_Bot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WoW1 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jaffathecake Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hector Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Farriorw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/06 === Week of June 1st === Week of June 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/06#Week_of_June_1st Week of June 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/06#Week_of_June_8th Week of June 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/06#Week_of_June_15th Week of June 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/06#Week_of_June_22nd Week of June 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/06#Week_of_June_29th https://wikitech.wikimedia.org/wiki/Shell_Request/Shittybiasandbox Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Waasay_uddin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chouaibi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DCausse Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/NoBiasedWiki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JackDanielsLP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shami Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150529-Tagging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150529-Tagging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150529-Tagging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150529-Tagging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150529-Tagging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Smileykrish Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ravishankar.ramswamy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Maumela_T Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/LomonosovM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Gertie_the_dinosaur https://wikitech.wikimedia.org/wiki/Shell_Request/RytoEX Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Neofactor.is3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lkidson Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Conftool Conftool is a set of tools we use to sync and manage the dynamic state configuration for services (as of February 2018, varnish backend, the PyBal pools, the DNS discovery entries, and some variables in MediaWiki configuration). This configuration is stored in the distributed key/value store: Etcd. Overviewhttps://wikitech.wikimedia.org/wiki/Conftool#Overview Schemahttps://wikitech.wikimedia.org/wiki/Conftool#Schema The base data fileshttps://wikitech.wikimedia.org/wiki/Conftool#The_base_data_files The toolshttps://wikitech.wikimedia.org/wiki/Conftool#The_tools In puppethttps://wikitech.wikimedia.org/wiki/Conftool#In_puppet Operatinghttps://wikitech.wikimedia.org/wiki/Conftool#Operating Add a server node to a servicehttps://wikitech.wikimedia.org/wiki/Conftool#Add_a_server_node_to_a_service Modify the state of a server in a poolhttps://wikitech.wikimedia.org/wiki/Conftool#Modify_the_state_of_a_server_in_a_pool Pooling/depooling a server from all the related serviceshttps://wikitech.wikimedia.org/wiki/Conftool#Pooling/depooling_a_server_from_all_the_related_services Depool all nodes in a specific datacenterhttps://wikitech.wikimedia.org/wiki/Conftool#Depool_all_nodes_in_a_specific_datacenter Decommission a serverhttps://wikitech.wikimedia.org/wiki/Conftool#Decommission_a_server Show pool statushttps://wikitech.wikimedia.org/wiki/Conftool#Show_pool_status Server changing IP addresshttps://wikitech.wikimedia.org/wiki/Conftool#Server_changing_IP_address Troubleshootinghttps://wikitech.wikimedia.org/wiki/Conftool#Troubleshooting Insufficient credentialshttps://wikitech.wikimedia.org/wiki/Conftool#Insufficient_credentials Maintenancehttps://wikitech.wikimedia.org/wiki/Conftool#Maintenance Releasing conftoolhttps://wikitech.wikimedia.org/wiki/Conftool#Releasing_conftool Deploying conftoolhttps://wikitech.wikimedia.org/wiki/Conftool#Deploying_conftool See alsohttps://wikitech.wikimedia.org/wiki/Conftool#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Alpha_Duck Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Riventree Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/RESTBase [is an API proxy serving the REST API at /api/rest_v1/. It uses Cassandra as a storage backend. Deployment and config changeshttps://wikitech.wikimedia.org/wiki/RESTBase#Deployment_and_config_changes What to check after a deployhttps://wikitech.wikimedia.org/wiki/RESTBase#What_to_check_after_a_deploy Other considerationshttps://wikitech.wikimedia.org/wiki/RESTBase#Other_considerations Administrationhttps://wikitech.wikimedia.org/wiki/RESTBase#Administration Adding a new RESTBase hosthttps://wikitech.wikimedia.org/wiki/RESTBase#Adding_a_new_RESTBase_host Renewing expired certificateshttps://wikitech.wikimedia.org/wiki/RESTBase#Renewing_expired_certificates Monitoringhttps://wikitech.wikimedia.org/wiki/RESTBase#Monitoring instance-datahttps://wikitech.wikimedia.org/wiki/RESTBase#instance-data Debugginghttps://wikitech.wikimedia.org/wiki/RESTBase#Debugging Analytics and metricshttps://wikitech.wikimedia.org/wiki/RESTBase#Analytics_and_metrics Notes on purginghttps://wikitech.wikimedia.org/wiki/RESTBase#Notes_on_purging Scripthttps://wikitech.wikimedia.org/wiki/RESTBase#Script https://wikitech.wikimedia.org/wiki/Shell_Request/Virgili Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Estuempfig Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Grafana grafana.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Grafana#Service Editing dashboardshttps://wikitech.wikimedia.org/wiki/Grafana#Editing_dashboards Private dashboardshttps://wikitech.wikimedia.org/wiki/Grafana#Private_dashboards Viewinghttps://wikitech.wikimedia.org/wiki/Grafana#Viewing Dashboards as codehttps://wikitech.wikimedia.org/wiki/Grafana#Dashboards_as_code Grizzlyhttps://wikitech.wikimedia.org/wiki/Grafana#Grizzly Use-caseshttps://wikitech.wikimedia.org/wiki/Grafana#Use-cases Workflowshttps://wikitech.wikimedia.org/wiki/Grafana#Workflows Creating or updating a dashboard using Grizzlyhttps://wikitech.wikimedia.org/wiki/Grafana#Creating_or_updating_a_dashboard_using_Grizzly Preparing the Patchhttps://wikitech.wikimedia.org/wiki/Grafana#Preparing_the_Patch Updating a dashboard that already exists in Grafana using grizzlyhttps://wikitech.wikimedia.org/wiki/Grafana#Updating_a_dashboard_that_already_exists_in_Grafana_using_grizzly Onboarding a dashboard with Grizzlyhttps://wikitech.wikimedia.org/wiki/Grafana#Onboarding_a_dashboard_with_Grizzly Code Reviewhttps://wikitech.wikimedia.org/wiki/Grafana#Code_Review Finding reviewershttps://wikitech.wikimedia.org/wiki/Grafana#Finding_reviewers Previewing the Change ('grr preview')https://wikitech.wikimedia.org/wiki/Grafana#Previewing_the_Change_('grr_preview') Diffing the change ('grr diff')https://wikitech.wikimedia.org/wiki/Grafana#Diffing_the_change_('grr_diff') Deploying the changehttps://wikitech.wikimedia.org/wiki/Grafana#Deploying_the_change Usage Exampleshttps://wikitech.wikimedia.org/wiki/Grafana#Usage_Examples Style Guidehttps://wikitech.wikimedia.org/wiki/Grafana#Style_Guide Conventionshttps://wikitech.wikimedia.org/wiki/Grafana#Conventions Noteshttps://wikitech.wikimedia.org/wiki/Grafana#Notes Featureshttps://wikitech.wikimedia.org/wiki/Grafana#Features Shared crosshairhttps://wikitech.wikimedia.org/wiki/Grafana#Shared_crosshair Shared tooltiphttps://wikitech.wikimedia.org/wiki/Grafana#Shared_tooltip Show deploymentshttps://wikitech.wikimedia.org/wiki/Grafana#Show_deployments Input variableshttps://wikitech.wikimedia.org/wiki/Grafana#Input_variables Time correctionhttps://wikitech.wikimedia.org/wiki/Grafana#Time_correction Negative axishttps://wikitech.wikimedia.org/wiki/Grafana#Negative_axis Alerts (with notifications via Alertmanager)https://wikitech.wikimedia.org/wiki/Grafana#Alerts_(with_notifications_via_Alertmanager) Annotations based on Prometheus datahttps://wikitech.wikimedia.org/wiki/Grafana#Annotations_based_on_Prometheus_data Search/audit metrics usage across dashboardshttps://wikitech.wikimedia.org/wiki/Grafana#Search/audit_metrics_usage_across_dashboards Best practiceshttps://wikitech.wikimedia.org/wiki/Grafana#Best_practices Common pitfallshttps://wikitech.wikimedia.org/wiki/Grafana#Common_pitfalls Alerts fire but the threshold was not reachedhttps://wikitech.wikimedia.org/wiki/Grafana#Alerts_fire_but_the_threshold_was_not_reached Alerts for values derived from multiple metrics fire unexpectedlyhttps://wikitech.wikimedia.org/wiki/Grafana#Alerts_for_values_derived_from_multiple_metrics_fire_unexpectedly Recover after making the dashboard not editablehttps://wikitech.wikimedia.org/wiki/Grafana#Recover_after_making_the_dashboard_not_editable Known issueshttps://wikitech.wikimedia.org/wiki/Grafana#Known_issues Alerts with asPercent() not workinghttps://wikitech.wikimedia.org/wiki/Grafana#Alerts_with_asPercent()_not_working movingAverage templatehttps://wikitech.wikimedia.org/wiki/Grafana#movingAverage_template Color inspector brokenhttps://wikitech.wikimedia.org/wiki/Grafana#Color_inspector_broken DatasourceError notification spamhttps://wikitech.wikimedia.org/wiki/Grafana#DatasourceError_notification_spam Wikimedia Cloud Serviceshttps://wikitech.wikimedia.org/wiki/Grafana#Wikimedia_Cloud_Services Pipelinehttps://wikitech.wikimedia.org/wiki/Grafana#Pipeline Usage for product analytics purposeshttps://wikitech.wikimedia.org/wiki/Grafana#Usage_for_product_analytics_purposes Operationshttps://wikitech.wikimedia.org/wiki/Grafana#Operations Retiring a Dashboardhttps://wikitech.wikimedia.org/wiki/Grafana#Retiring_a_Dashboard Version upgradehttps://wikitech.wikimedia.org/wiki/Grafana#Version_upgrade Recovering a deleted dashboardhttps://wikitech.wikimedia.org/wiki/Grafana#Recovering_a_deleted_dashboard Failing over from the active to the passive hosthttps://wikitech.wikimedia.org/wiki/Grafana#Failing_over_from_the_active_to_the_passive_host Stopping services on the passive hosthttps://wikitech.wikimedia.org/wiki/Grafana#Stopping_services_on_the_passive_host Pulling data from the active hosthttps://wikitech.wikimedia.org/wiki/Grafana#Pulling_data_from_the_active_host Starting serviceshttps://wikitech.wikimedia.org/wiki/Grafana#Starting_services Making the necessary Puppet changes for the failoverhttps://wikitech.wikimedia.org/wiki/Grafana#Making_the_necessary_Puppet_changes_for_the_failover Running Puppet on the Grafana and Traffic hostshttps://wikitech.wikimedia.org/wiki/Grafana#Running_Puppet_on_the_Grafana_and_Traffic_hosts Ensuring services are working as expectedhttps://wikitech.wikimedia.org/wiki/Grafana#Ensuring_services_are_working_as_expected External linkshttps://wikitech.wikimedia.org/wiki/Grafana#External_links https://wikitech.wikimedia.org/wiki/Statsd statsd is a metrics aggregation server. We use it to aggregate metrics for Graphite. Servicehttps://wikitech.wikimedia.org/wiki/Statsd#Service Historyhttps://wikitech.wikimedia.org/wiki/Statsd#History See alsohttps://wikitech.wikimedia.org/wiki/Statsd#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Andrewying Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Lukyth Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Achway Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Deepan.rf001 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gowebbaby Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Resident_Mario Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Timnolte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nachoace Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kr.prastut Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Alex94 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xiaomei Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Walliski Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/JosefinaJosepha Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherqfe Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyroxyv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Riggan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyroedl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherzzb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150613-Esams-Text-80 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150613-Esams-Text-80#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150613-Esams-Text-80#Timeline Cause Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20150613-Esams-Text-80#Cause_Analysis Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150613-Esams-Text-80#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Sfschouten Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Dyiop Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Tanner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bianjiang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrojgo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gnom Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Waidren Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Betty Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150615-Elasticsearch Elasticsearch outage: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150615-Elasticsearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150615-Elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150615-Elasticsearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150615-Elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Chadm-gresev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Koroleveugene Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chgresev Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrovyz Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrohey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brentrharmon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Brainey Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Mylittlefrogs Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherihc Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchereux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150616-Elasticsearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150616-Elasticsearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150616-Elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150616-Elasticsearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150616-Elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Alex00728 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Fractalfederation Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Davidcannon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vologa Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherlqk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly The wmf.pageview_hourly table (available on Hive) contains 'pre-aggregated' webrequest data, filtered to keep only pageviews, and aggregated over a predefined set of dimensions. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly#Current_Schema Sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly#Sample_queries Changes and known problems since 2015-06-16https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly#Changes_and_known_problems_since_2015-06-16 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly#See_also Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly#Notes https://wikitech.wikimedia.org/wiki/Shell_Request/Whizz2000 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/AkashShah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/DB111 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BarryTheBrowserTestBot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrouht Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manishkumar-tt Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elee Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Vadivazhagan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sheijne Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Isspol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sue Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yuhzhu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hromoslav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Chezsal Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherjdu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/WangRui Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Recover_instance_from_NFS == Disable per-instance == Disable per-instancehttps://wikitech.wikimedia.org/wiki/Recover_instance_from_NFS#Disable_per-instance Enable per-instancehttps://wikitech.wikimedia.org/wiki/Recover_instance_from_NFS#Enable_per-instance https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchermjp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyropby Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Funkruf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MGChecker Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Peter_Bowman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcheriyj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jwang Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Rajeshrjsh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yanwon Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Norbert.sziraczki Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Frettie Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherono Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sulhan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Srijankedia Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyroquj Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyroqoi Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Uwe_Pommerening Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D0%A1%D0%B5%D1%80%D0%B1%D0%B8%D1%98%D0%B0%D0%BD%D0%B0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kahvel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/M11paths Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyroyke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Wangxiyuan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Elyashiv Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kalaripayattukid Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchersvu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/KlixxOne Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/%D9%85%D8%AD%D9%85%D8%AF_%D8%A7%D9%84%D9%81%D9%84%D8%B3%D8%B7%D9%8A%D9%86%D9%8A Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Manishksah Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Adithyakhamithkar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Projectview_hourly The wmf.projectview_hourly table (available on Hive) is 'pre-aggregated' webrequest data, filtered to keep only [and aggregated over a predefined set of dimension. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Projectview_hourly#Current_Schema Changes and known problems since 2015-06-22https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Projectview_hourly#Changes_and_known_problems_since_2015-06-22 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Projectview_hourly#See_also Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Projectview_hourly#Notes https://wikitech.wikimedia.org/wiki/Shell_Request/Andrew-WMDE Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Timeline 2015-06-18https://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#2015-06-18 2015-06-19https://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#2015-06-19 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Actionables Updateshttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Updates Labs (including tool labs) is down, and it's not clear when it will be back up againhttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Labs_(including_tool_labs)_is_down,_and_it's_not_clear_when_it_will_be_back_up_again If you are an editor on one of our projectshttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#If_you_are_an_editor_on_one_of_our_projects If you are a tool developerhttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#If_you_are_a_tool_developer If you manage your own project on Labshttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#If_you_manage_your_own_project_on_Labs Detailshttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#Details wikibugs and grrrit-wmhttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#wikibugs_and_grrrit-wm tool labs web serverhttps://wikitech.wikimedia.org/wiki/Incidents/20150617-LabsNFSOutage#tool_labs_web_server https://wikitech.wikimedia.org/wiki/Shell_Request/TempleM Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/SpyTec13 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cyhu0007 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Madspy0 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Yonatan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ramprasvm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Shyamp Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Amitk144 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Daliagrink Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bflagg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jypathways Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150622-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150622-EventLogging#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150622-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Leapol Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Sivchick Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jberkel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jonas_Kress_(WMDE) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/TestingAccount2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Whyameri Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Slashsbin Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cindy-the-browser-test-bot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrojgk Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Ppchelko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrohfl Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Kychot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150625-LabsNFSOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150625-LabsNFSOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150625-LabsNFSOutage#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150625-LabsNFSOutage#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Pletchersbw Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nikkimaria Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Smokeping.wikimedia.org smokeping.wikimedia. External linkshttps://wikitech.wikimedia.org/wiki/Smokeping.wikimedia.org#External_links https://wikitech.wikimedia.org/wiki/Netmon1001 Category:Eqiad data center Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Shell_Request/Varinder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Puppet_CA_replacement = Goal = Goalhttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#Goal Current statehttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#Current_state Procedurehttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#Procedure Caveatshttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#Caveats Q&Ahttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#Q&A Referenceshttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#References Citationshttps://wikitech.wikimedia.org/wiki/Puppet_CA_replacement#Citations https://wikitech.wikimedia.org/wiki/Shell_Request/Inetryconydot Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/BienvenuMyriel Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/MarysiaP Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Juszczak Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Pletcherela Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Giso6150 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Carpinteyrovir Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Hans_Haase Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Morten_Haan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nobldm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Weedoit Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Thai Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Performance Put any performance related Event Logging information on this page. Event Logging load testhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Performance#Event_Logging_load_test Benchmarking DB insertshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Performance#Benchmarking_DB_inserts https://wikitech.wikimedia.org/wiki/Shell_Request/TestAccount3 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nobhxb Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Xephyr Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Divya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Asuganya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Cgardner Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Nmeuschke Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Bharatamsamar Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Coppy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150702-RESTBase == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150702-RESTBase#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150702-RESTBase#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150702-RESTBase#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150702-RESTBase#Actionables https://wikitech.wikimedia.org/wiki/Torrus.wikimedia.org torrus.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Torrus.wikimedia.org#Service External linkhttps://wikitech.wikimedia.org/wiki/Torrus.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/emergency_guides/single_tool_webservice During the june 2015 NFS outage, we did an emergency deployment of the demw wiki loves earth jury tool on toolsbeta. This is a step-for-step guide what we did at that point, although some intermediate steps might be missing. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/emergency_guides/irc_bot_deployment emergency deployment of grrrit-wm and wikibugs on tools-webproxy-01 during nfs outage Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/emergency_guides Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/emergency_guides/toolforge_down_notification How to deploy the emergency Toolforge error page (503). Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Bromine bromine is a virtual machine that runs in Ganeti. It can be controlled from ganeti1003 and runs on ganeti01. Serviceshttps://wikitech.wikimedia.org/wiki/Bromine#Services VM Infohttps://wikitech.wikimedia.org/wiki/Bromine#VM_Info https://wikitech.wikimedia.org/wiki/Cassandra/Tuning == Compaction == Compactionhttps://wikitech.wikimedia.org/wiki/Cassandra/Tuning#Compaction Concurrencyhttps://wikitech.wikimedia.org/wiki/Cassandra/Tuning#Concurrency Throughputhttps://wikitech.wikimedia.org/wiki/Cassandra/Tuning#Throughput Read and write concurrencyhttps://wikitech.wikimedia.org/wiki/Cassandra/Tuning#Read_and_write_concurrency SSTable indexing intervalhttps://wikitech.wikimedia.org/wiki/Cassandra/Tuning#SSTable_indexing_interval https://wikitech.wikimedia.org/wiki/HTTPS/WMF_CA = Introduction = Introductionhttps://wikitech.wikimedia.org/wiki/HTTPS/WMF_CA#Introduction wmf_cahttps://wikitech.wikimedia.org/wiki/HTTPS/WMF_CA#wmf_ca wmf_ca_2014_2017https://wikitech.wikimedia.org/wiki/HTTPS/WMF_CA#wmf_ca_2014_2017 Howtohttps://wikitech.wikimedia.org/wiki/HTTPS/WMF_CA#Howto Noteshttps://wikitech.wikimedia.org/wiki/HTTPS/WMF_CA#Notes https://wikitech.wikimedia.org/wiki/Incidents/20150709-poolcounter == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150709-poolcounter#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150709-poolcounter#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150709-poolcounter#Actionables https://wikitech.wikimedia.org/wiki/How_to_deploy_current_master_branch_of_an_extension The following instructions are for deploying the current master branch of an extension to production. Normally, you would not do this. Test current master against deployment branches of corehttps://wikitech.wikimedia.org/wiki/How_to_deploy_current_master_branch_of_an_extension#Test_current_master_against_deployment_branches_of_core Create a back-up of the extension deployment branchhttps://wikitech.wikimedia.org/wiki/How_to_deploy_current_master_branch_of_an_extension#Create_a_back-up_of_the_extension_deployment_branch Create a new extension deployment branch based on masterhttps://wikitech.wikimedia.org/wiki/How_to_deploy_current_master_branch_of_an_extension#Create_a_new_extension_deployment_branch_based_on_master Deploy the new deployment branchhttps://wikitech.wikimedia.org/wiki/How_to_deploy_current_master_branch_of_an_extension#Deploy_the_new_deployment_branch https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/07 === Week of July 6th === Week of July 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/07#Week_of_July_6th Week of July 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/07#Week_of_July_13th Week of July 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/07#Week_of_July_20th Week of July 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/07#Week_of_July_27th https://wikitech.wikimedia.org/wiki/Shell_Request/Linktranlator Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Linktranslator Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sanitization_vs_Aggregation This page explains two strategies in sanitizing/aggregating EventLogging (EL) schema tables, so that they comply with the [Retention Guidelines]. Specifically it will describe the sanitization/aggregation of the field editCount, which is a numerical field that many EL schemas share. 1) Sanitization of editCount fieldhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sanitization_vs_Aggregation#1)_Sanitization_of_editCount_field Work neededhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sanitization_vs_Aggregation#Work_needed Issues related to mobile deployment flowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sanitization_vs_Aggregation#Issues_related_to_mobile_deployment_flow 2) Aggregation upon editCount fieldhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sanitization_vs_Aggregation#2)_Aggregation_upon_editCount_field https://wikitech.wikimedia.org/wiki/How_to_deploy_code/Core_submodule_update While Gerrit performs automatic MW core submodule updates for most extensions when you merge a commit to a wmf/ branch in them, it's confused by VisualEditor core's repo (VisualEditor/VisualEditor) and doesn't do it for the VE extension. Deploymenthttps://wikitech.wikimedia.org/wiki/Category:Deployment https://wikitech.wikimedia.org/wiki/Incidents/20150729-HttpsRedirects == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150729-HttpsRedirects#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150729-HttpsRedirects#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150729-HttpsRedirects#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150729-HttpsRedirects#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150803-Kafka == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150803-Kafka#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150803-Kafka#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150803-Kafka#Actionables https://wikitech.wikimedia.org/wiki/Building_OpenJDK_8_backports * Fetch openjdk-8 source package from testing (check https://packages.qa. https://wikitech.wikimedia.org/wiki/Grafana.wikimedia.org/resourceloader.json { https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/08 === Week of August 3rd === Week of August 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/08#Week_of_August_3rd Week of August 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/08#Week_of_August_10th Week of August 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/08#Week_of_August_17th Week of August 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/08#Week_of_August_24th Week of August 31sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/08#Week_of_August_31st https://wikitech.wikimedia.org/wiki/Incidents/20150806-poolcounter 20150806-poolcounter Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150806-poolcounter#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150806-poolcounter#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150806-poolcounter#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150806-poolcounter#Actionables https://wikitech.wikimedia.org/wiki/Krypton krypton was a virtual machine in Ganeti. ([ran miscellaneous PHP apps/services. Serviceshttps://wikitech.wikimedia.org/wiki/Krypton#Services VM Infohttps://wikitech.wikimedia.org/wiki/Krypton#VM_Info https://wikitech.wikimedia.org/wiki/Incidents/20150810-Kafka == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150810-Kafka#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150810-Kafka#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150810-Kafka#Conclusions https://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard The Discovery team has adopted RStudio's shiny framework for developing dashboards to visualize data. An example of this is the Metrics & KPIs dashboard originally developed by Oliver Keyes and currently maintained by Mikhail Popov. Installation and setuphttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Installation_and_setup Basicshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Basics Inputs and Outputshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Inputs_and_Outputs Templatehttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Template ui.Rhttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#ui.R server.Rhttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#server.R utils.Rhttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#utils.R www/custom.csshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#www/custom.css www/custom.jshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#www/custom.js Componentshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Components Moduleshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Modules Widgetshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Widgets Clickable Widgetshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Clickable_Widgets Example Utility Functionshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Example_Utility_Functions Downloading aggregated datasetshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Downloading_aggregated_datasets Dynamic colors and arrows for widgetshttps://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard#Dynamic_colors_and_arrows_for_widgets https://wikitech.wikimedia.org/wiki/Incidents/20150812-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150812-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150812-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150812-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150812-LabsOutage#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150814-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150814-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150814-MediaWiki#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150814-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sensitive_Fields === Scenario 1: Entering personal information by mistake === Scenario 1: Entering personal information by mistakehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sensitive_Fields#Scenario_1:_Entering_personal_information_by_mistake Scenario 2: Editing as anonymous by mistakehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Sensitive_Fields#Scenario_2:_Editing_as_anonymous_by_mistake https://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore == Alpha (?) Version == Alpha (?) Versionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Alpha_(?)_Version Load Testhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Load_Test TL:DRhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#TL:DR Next stepshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Next_steps Cassandrahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Cassandra Resultshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Results Queryinghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Querying Druid and Elastic Searchhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Druid_and_Elastic_Search Druidhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Druid Other Noteshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Other_Notes Elasticsearchhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-_DataStore#Elasticsearch https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Geotagging Geotagging functions in Hadoop are provided by jars available at hdfs:///wmf/refinery/current/artifacts Librarieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Geotagging#Libraries refinery-core.jarhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Geotagging#refinery-core.jar refinery-hive.jarhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Geotagging#refinery-hive.jar Updateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Geotagging#Updates https://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage#Timeline 2015-08-17https://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage#2015-08-17 2015-08-18https://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage#2015-08-18 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150817-ToolLabs-WebgridOutage#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150820-OCSP == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150820-OCSP#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150820-OCSP#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150820-OCSP#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150820-OCSP#Actionables https://wikitech.wikimedia.org/wiki/Grafana.wikimedia.org/mw-js-deprecate.json { https://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards OpenSearch Dashboards (previously known as Kibana) is the frontend for Logstash, available at https://logstash.wikimedia. Quick introhttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Quick_intro Where do logs come from?https://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Where_do_logs_come_from? Navigating dashboardshttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Navigating_dashboards Team dashboard and triage process talkhttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Team_dashboard_and_triage_process_talk Beta Cluster Logstashhttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Beta_Cluster_Logstash Tipshttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Tips Discovery pagehttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Discovery_page Homepagehttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Homepage Copy results out of a searchhttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Copy_results_out_of_a_search Gotchashttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Gotchas Link sharinghttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Link_sharing No resultshttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#No_results Visualisation panelshttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#Visualisation_panels External linkhttps://wikitech.wikimedia.org/wiki/OpenSearch_Dashboards#External_link https://wikitech.wikimedia.org/wiki/WebPageTest We stopped using WebPageTest in 2022 since the open source version hasn't been updated/kept up to date in years. Check out [See also == See alsohttps://wikitech.wikimedia.org/wiki/WebPageTest#See_also https://wikitech.wikimedia.org/wiki/Puppet_request_window == What is it? == What is it?https://wikitech.wikimedia.org/wiki/Puppet_request_window#What_is_it? How to get a patch in a Puppet request windowhttps://wikitech.wikimedia.org/wiki/Puppet_request_window#How_to_get_a_patch_in_a_Puppet_request_window What kind of patches can go through Puppet request windows?https://wikitech.wikimedia.org/wiki/Puppet_request_window#What_kind_of_patches_can_go_through_Puppet_request_windows? Examples (from Giuseppe):https://wikitech.wikimedia.org/wiki/Puppet_request_window#Examples_(from_Giuseppe): The ideal Puppet request window patch has...https://wikitech.wikimedia.org/wiki/Puppet_request_window#The_ideal_Puppet_request_window_patch_has... The ideal Puppet request window patch does *not* have...https://wikitech.wikimedia.org/wiki/Puppet_request_window#The_ideal_Puppet_request_window_patch_does_*not*_have... Who is going to do it?https://wikitech.wikimedia.org/wiki/Puppet_request_window#Who_is_going_to_do_it? https://wikitech.wikimedia.org/wiki/Incidents/20150825-Redis == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150825-Redis#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150825-Redis#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150825-Redis#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150825-Redis#Actionables Long term goalshttps://wikitech.wikimedia.org/wiki/Incidents/20150825-Redis#Long_term_goals https://wikitech.wikimedia.org/wiki/Aptly Aptly is a simple debian repository management tool. It can be used for maintaining a simple, per-project debian repository. Setting uphttps://wikitech.wikimedia.org/wiki/Aptly#Setting_up Serverhttps://wikitech.wikimedia.org/wiki/Aptly#Server Clienthttps://wikitech.wikimedia.org/wiki/Aptly#Client Inspecting the content of the repohttps://wikitech.wikimedia.org/wiki/Aptly#Inspecting_the_content_of_the_repo Adding Packageshttps://wikitech.wikimedia.org/wiki/Aptly#Adding_Packages Adding a new repohttps://wikitech.wikimedia.org/wiki/Aptly#Adding_a_new_repo FAQhttps://wikitech.wikimedia.org/wiki/Aptly#FAQ What happens when the instance hosting the package dies?https://wikitech.wikimedia.org/wiki/Aptly#What_happens_when_the_instance_hosting_the_package_dies? Oops, I added two different builds of a universal packagehttps://wikitech.wikimedia.org/wiki/Aptly#Oops,_I_added_two_different_builds_of_a_universal_package Oops, I rm'd a file in the poolhttps://wikitech.wikimedia.org/wiki/Aptly#Oops,_I_rm'd_a_file_in_the_pool "unable to find control.tar.gz part in package "https://wikitech.wikimedia.org/wiki/Aptly#"unable_to_find_control.tar.gz_part_in_package_" https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/coreproduction == db1018, Performance_Schema=Off == db1018, Performance_SchemaOff ==https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/coreproduction#db1018,_Performance_SchemaOff_== https://wikitech.wikimedia.org/wiki/Exim == Troubleshooting "exim queue warning" alerts == Troubleshooting "exim queue warning" alertshttps://wikitech.wikimedia.org/wiki/Exim#Troubleshooting_"exim_queue_warning"_alerts show mail queuehttps://wikitech.wikimedia.org/wiki/Exim#show_mail_queue flush mail queuehttps://wikitech.wikimedia.org/wiki/Exim#flush_mail_queue force delivery attempthttps://wikitech.wikimedia.org/wiki/Exim#force_delivery_attempt deliver just one specific mail from queuehttps://wikitech.wikimedia.org/wiki/Exim#deliver_just_one_specific_mail_from_queue search for specific mails in the queuehttps://wikitech.wikimedia.org/wiki/Exim#search_for_specific_mails_in_the_queue count number of mails to a specific recipienthttps://wikitech.wikimedia.org/wiki/Exim#count_number_of_mails_to_a_specific_recipient remove emails to a specific recipienthttps://wikitech.wikimedia.org/wiki/Exim#remove_emails_to_a_specific_recipient test address routinghttps://wikitech.wikimedia.org/wiki/Exim#test_address_routing cheat sheethttps://wikitech.wikimedia.org/wiki/Exim#cheat_sheet https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting This page is for troubleshooting urgent issues. Routine maintenance tasks are documented on the VPS_Maintenance page. Networking failureshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Networking_failures neutron agents alive/deadhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#neutron_agents_alive/dead duplicated packets in the networkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#duplicated_packets_in_the_network network down for VMs in a cloudvirt (the agents case)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#network_down_for_VMs_in_a_cloudvirt_(the_agents_case) network down for VMs in a cloudvirt (the VLAN case)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#network_down_for_VMs_in_a_cloudvirt_(the_VLAN_case) VM cannot communicate with other VMs in different cloudvirt (the ARP table case)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#VM_cannot_communicate_with_other_VMs_in_different_cloudvirt_(the_ARP_table_case) nf_conntrack table full in cloudnet nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#nf_conntrack_table_full_in_cloudnet_nodes Galerahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Galera Galera won't start uphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Galera_won't_start_up NODE GROUPhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#NODE_GROUP Galera backup recoveryhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Galera_backup_recovery Nova-fullstackhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Nova-fullstack nova instance creation testhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#nova_instance_creation_test keyfile cannot be readhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#keyfile_cannot_be_read Supporting component failureshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Supporting_component_failures instance DNS failurehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#instance_DNS_failure Fail-overhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Fail-over User workflow issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#User_workflow_issues incorrect quota violationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#incorrect_quota_violations Disable VM schedulinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Disable_VM_scheduling Instance Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Instance_Troubleshooting Reset state of an instancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Reset_state_of_an_instance Block Migrationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Block_Migration Recompress a live-migrated instancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Recompress_a_live-migrated_instance Fixing an instance that won't reboothttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Fixing_an_instance_that_won't_reboot Root console accesshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Root_console_access Mounting an instance diskhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Mounting_an_instance_disk guestfishhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#guestfish guestfish alternativeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#guestfish_alternatives Mounting a flat file disk with qemu-nbd and accessing a relevant partitionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Mounting_a_flat_file_disk_with_qemu-nbd_and_accessing_a_relevant_partition Other file mounting scenarioshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Other_file_mounting_scenarios guestmount methodhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#guestmount_method (Re)Setting root password on a mounted diskhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#(Re)Setting_root_password_on_a_mounted_disk Fix VM disk corruption (fsck)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Fix_VM_disk_corruption_(fsck) method 1: guestfishhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#method_1:_guestfish method 2: qemu-nbdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#method_2:_qemu-nbd Trace a vnet device to an instancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Trace_a_vnet_device_to_an_instance Get the live virsh config for an instancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Get_the_live_virsh_config_for_an_instance Get a screenshot of the instance's "screen"https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Get_a_screenshot_of_the_instance's_"screen" Send a keypress to the instance's "keyboard"https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Send_a_keypress_to_the_instance's_"keyboard" Deleting an orphaned build request/VM stuck in BUILD statushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Deleting_an_orphaned_build_request/VM_stuck_in_BUILD_status Stuck migration/drain: generic casehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Stuck_migration/drain:_generic_case Stuck migration/drain: certificate issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Stuck_migration/drain:_certificate_issues Stuck migration/drain: 'Networking client is experiencing an unauthorized exception.' / VM qemu process started on many/different host than openstack reportshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#Stuck_migration/drain:_'Networking_client_is_experiencing_an_unauthorized_exception.'_/_VM_qemu_process_started_on_many/different_host_than_openstack_reports No valid host was found. There are not enough hosts available.https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#No_valid_host_was_found._There_are_not_enough_hosts_available. There's a server group that prevents the VM from moving (ex. strong affinity):https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting#There's_a_server_group_that_prevents_the_VM_from_moving_(ex._strong_affinity): https://wikitech.wikimedia.org/wiki/Keyholder Keyholder is a set of scripts that allow a group of users to use an SSH key without sharing the private key with the members of the group. This is accomplished by running a locked-down instance of ssh-agent, and running ssh-agent-proxy in front of it. Overviewhttps://wikitech.wikimedia.org/wiki/Keyholder#Overview Arming keyshttps://wikitech.wikimedia.org/wiki/Keyholder#Arming_keys Production passphraseshttps://wikitech.wikimedia.org/wiki/Keyholder#Production_passphrases WMCS projects passphraseshttps://wikitech.wikimedia.org/wiki/Keyholder#WMCS_projects_passphrases Hintshttps://wikitech.wikimedia.org/wiki/Keyholder#Hints Generating a key for a new identity or update an existing onehttps://wikitech.wikimedia.org/wiki/Keyholder#Generating_a_key_for_a_new_identity_or_update_an_existing_one See alsohttps://wikitech.wikimedia.org/wiki/Keyholder#See_also https://wikitech.wikimedia.org/wiki/Incidents/20150830-labs-nfs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150830-labs-nfs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150830-labs-nfs#Timeline Action Itemshttps://wikitech.wikimedia.org/wiki/Incidents/20150830-labs-nfs#Action_Items https://wikitech.wikimedia.org/wiki/Schema_changes Schema changes on a live database are hard, and they should not be done lightly. That doesn't mean that schema changes should be avoided, not at all, a good database design is essential for security and performance. What is not a schema changehttps://wikitech.wikimedia.org/wiki/Schema_changes#What_is_not_a_schema_change Workflow of a schema changehttps://wikitech.wikimedia.org/wiki/Schema_changes#Workflow_of_a_schema_change Additional notes on scheduling (a.k.a. How much will my schema change will take to be deployed?)https://wikitech.wikimedia.org/wiki/Schema_changes#Additional_notes_on_scheduling_(a.k.a._How_much_will_my_schema_change_will_take_to_be_deployed?) Related tagshttps://wikitech.wikimedia.org/wiki/Schema_changes#Related_tags Wikimedia projectshttps://wikitech.wikimedia.org/wiki/Schema_changes#Wikimedia_projects MediaWiki projectshttps://wikitech.wikimedia.org/wiki/Schema_changes#MediaWiki_projects Advice on schema changeshttps://wikitech.wikimedia.org/wiki/Schema_changes#Advice_on_schema_changes Dangers of schema changeshttps://wikitech.wikimedia.org/wiki/Schema_changes#Dangers_of_schema_changes See alsohttps://wikitech.wikimedia.org/wiki/Schema_changes#See_also https://wikitech.wikimedia.org/wiki/Third_party_standards == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Third_party_standards#Overview Evolution and Coordinationhttps://wikitech.wikimedia.org/wiki/Third_party_standards#Evolution_and_Coordination Standardshttps://wikitech.wikimedia.org/wiki/Third_party_standards#Standards Namespacinghttps://wikitech.wikimedia.org/wiki/Third_party_standards#Namespacing HTTP(S) Requirementshttps://wikitech.wikimedia.org/wiki/Third_party_standards#HTTP(S)_Requirements Email Requirementshttps://wikitech.wikimedia.org/wiki/Third_party_standards#Email_Requirements https://wikitech.wikimedia.org/wiki/Incidents/20150820-PageCategorization_(Privacy) == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150820-PageCategorization_(Privacy)#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150820-PageCategorization_(Privacy)#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150820-PageCategorization_(Privacy)#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150820-PageCategorization_(Privacy)#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20150901-Elasticsearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150901-Elasticsearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150901-Elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150901-Elasticsearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150901-Elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Bast3001 bast3001 was the main bastion for the Esams cluster until March 2017. (Role previously held by hooft. Serviceshttps://wikitech.wikimedia.org/wiki/Bast3001#Services https://wikitech.wikimedia.org/wiki/APT_repository/Key -----BEGIN PGP PUBLIC KEY BLOCK----- https://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incident_response/Full_report_template#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/20150908-ores Between 1350 UTC and 1550 UTC, ORES was down during an upgrade. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150908-ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150908-ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150908-ores#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150908-ores#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation This article describes all the work done in validating the numbers generated using the last access cookie. In this article, users = devices. Why validate?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Why_validate? Termshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Terms Other Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Other_Caveats SQL to count uniqueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#SQL_to_count_uniques Daily overcounts and repeats grouped by uri_host, for June 10 2015https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Daily_overcounts_and_repeats_grouped_by_uri_host,_for_June_10_2015 Monthly overcounts and repeats grouped by uri_host, for June 2015https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Monthly_overcounts_and_repeats_grouped_by_uri_host,_for_June_2015 Sample numbers for en.wikipedia.org from May - September 2015https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Sample_numbers_for_en.wikipedia.org_from_May_-_September_2015 Overcounts and repeat trend from May - September 2015 (en.wikipedia.org)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Overcounts_and_repeat_trend_from_May_-_September_2015_(en.wikipedia.org) Monthly numbers from May-August 2015 for en.wikipedia.orghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Monthly_numbers_from_May-August_2015_for_en.wikipedia.org Validation approacheshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Validation_approaches Fingerprinting for a short timehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Fingerprinting_for_a_short_time Compare numbers from mobile UUID based uniqueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Compare_numbers_from_mobile_UUID_based_uniques Bot filteringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Bot_filtering Regex based user-agent bot filteringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Regex_based_user-agent_bot_filtering How many requests makes a bothttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#How_many_requests_makes_a_bot Conclusionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Last_access_solution/Validation#Conclusion https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/09 === Week of September 7th === Week of September 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/09#Week_of_September_7th Week of September 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/09#Week_of_September_14th Week of September 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/09#Week_of_September_21st Week of September 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/09#Week_of_September_28th https://wikitech.wikimedia.org/wiki/Maps This page describes the technical aspects of deploying [Maps|Maps service] on Wikimedia Foundation infrastructure. Introhttps://wikitech.wikimedia.org/wiki/Maps#Intro The infrastructurehttps://wikitech.wikimedia.org/wiki/Maps#The_infrastructure Miscellaneoushttps://wikitech.wikimedia.org/wiki/Maps#Miscellaneous Development processeshttps://wikitech.wikimedia.org/wiki/Maps#Development_processes Puppetization and Automationhttps://wikitech.wikimedia.org/wiki/Maps#Puppetization_and_Automation Prerequisiteshttps://wikitech.wikimedia.org/wiki/Maps#Prerequisites Monitoringhttps://wikitech.wikimedia.org/wiki/Maps#Monitoring Subpageshttps://wikitech.wikimedia.org/wiki/Maps#Subpages https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Architecture This page explains WMF's EventLogging system topology and how its parts interact. Using the following diagram as a reference: Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki Dashiki is a dashboarding tool built by the Wikimedia Analytics team. It lets users declare dashboards using configuration pages on a wiki. Quickstarthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Quickstart Tutorialhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Tutorial Introhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Intro FAQhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#FAQ Where is the code?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Where_is_the_code? Where is code deployed?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Where_is_code_deployed? How do I put dashiki out of service?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#How_do_I_put_dashiki_out_of_service? Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Deployment How to get your data available via httphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#How_to_get_your_data_available_via_http Can I implement a new layout?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Can_I_implement_a_new_layout? What about limn?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#What_about_limn? Technical Documentation: Understanding Dashiki - First Stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Technical_Documentation:_Understanding_Dashiki_-_First_Steps Prefacehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Preface Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Overview /src/layoutshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#/src/layouts /src/componenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#/src/component /src/apphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#/src/app /src/libhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#/src/lib Test your dashboard config locallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Test_your_dashboard_config_locally Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Setup On-wiki configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#On-wiki_configuration Configuring the metrics-by-project layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Configuring_the_metrics-by-project_layout With AQS APIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#With_AQS_API With datasets APIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#With_datasets_API The dashboard's own config pagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#The_dashboard's_own_config_page Configuring the tabs layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Configuring_the_tabs_layout Configuring annotationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Configuring_annotations Backgroundhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki#Background https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Data_representations This page gives an overview over the various representations of EventLogging data available on the WMF production cluster, and expectations around those representations. Hadoop & Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Data_representations#Hadoop_&_Hive 'all-events' JSON log fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Data_representations#'all-events'_JSON_log_files Raw 'client' side log fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Data_representations#Raw_'client'_side_log_files Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Data_representations#Kafka Varnish pipelinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Data_representations#Varnish_pipeline https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Monitoring == Grafana == Grafanahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Monitoring#Grafana Graphitehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Monitoring#Graphite https://wikitech.wikimedia.org/wiki/Shell_Request/Mirabilos Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention To comply with WMF's [Policy] and [Retention Guidelines], event data goes through an automatic sanitization process. In a nutshell, this process deletes all sensitive information contained in the Hive event database older than 90 days. Definitionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#Definitions Rationale for purginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#Rationale_for_purging Data semantics revealing factshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#Data_semantics_revealing_facts Exceptionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#Exceptions What do the data retention guidelines recommend?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#What_do_the_data_retention_guidelines_recommend? Purging Strategieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#Purging_Strategies Best privacy practices when creating or modifying event schemashttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention#Best_privacy_practices_when_creating_or_modifying_event_schemas https://wikitech.wikimedia.org/wiki/Mira mira WAS the deployment host for Codfw. In April 2017, it was replaced by naos. Connectinghttps://wikitech.wikimedia.org/wiki/Mira#Connecting Serviceshttps://wikitech.wikimedia.org/wiki/Mira#Services See alsohttps://wikitech.wikimedia.org/wiki/Mira#See_also https://wikitech.wikimedia.org/wiki/EventLogging/Testing/BetaLabs%E2%80%8B%E2%80%8B%E2%80%8B%E2%80%8B%E2%80%8BTest test https://wikitech.wikimedia.org/wiki/Shell_Request/Greeshmab Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150914-extension1 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150914-extension1#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150914-extension1#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150914-extension1#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150914-extension1#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Hgzh Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Miguelg Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Publishing WMF's EventLogging database is private, because it may hold sensitive information during a certain time window. To access it, one must be an employee of the Wikimedia Foundation or have signed an NDA. Publishing reportshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Publishing#Publishing_reports Publishing data setshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Publishing#Publishing_data_sets Potentially sensitive datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Publishing#Potentially_sensitive_data https://wikitech.wikimedia.org/wiki/Shell_Request/Altostratus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS The Analytics Query Service (AQS) is a set of services that provide public-facing APIs that serve analytics data from both a Cassandra and a Druid backend. It is how Wikistats (stats. Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Services Monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Monitoring Project overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Project_overview Communicating user-facing changeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Communicating_user-facing_changes Running a servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Running_a_service Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Setup Start a servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Start_a_service Tips and troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Tips_and_troubleshooting Local Testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Local_Testing Quick start (for QA engineers)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Quick_start_(for_QA_engineers) Full guide (in case you want to customize these environments)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Full_guide_(in_case_you_want_to_customize_these_environments) Service config changeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Service_config_changes Create the service imagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Create_the_service_image Build the QA test environment (for cassandra-based services)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Build_the_QA_test_environment_(for_cassandra-based_services) Build and run the QA test environment (for druid-based services)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Build_and_run_the_QA_test_environment_(for_druid-based_services) Demoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Demos Notes for developershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Notes_for_developers To keep in mindhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#To_keep_in_mind Adding a Wikihttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Adding_a_Wiki Developing a New Endpointhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Developing_a_New_Endpoint Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Deployment Prerequisiteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Prerequisites Quick guidehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Quick_guide Step-by-step instructionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Step-by-step_instructions 1. Prepare a deployment patchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#1._Prepare_a_deployment_patch 2. Access the deployment serverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#2._Access_the_deployment_server 3. Deploy to staginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#3._Deploy_to_staging 4. Verify the service on staginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#4._Verify_the_service_on_staging 5. Deploy to productionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#5._Deploy_to_production 6. Verify the service in productionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#6._Verify_the_service_in_production Troubleshooting deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Troubleshooting_deployment Check podshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Check_pods Check logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Check_logs Data filter before Cassandra loadhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Data_filter_before_Cassandra_load API documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#API_documentation Documentation monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Documentation_monitoring Updating the docshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Updating_the_docs Reading the specificationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Reading_the_specification Setting up docs for a new servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Setting_up_docs_for_a_new_service API reference templatehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#API_reference_template Spec validationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Spec_validation Decision recordshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Decision_records Historicalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Historical Scaling for AQS 1.0https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS#Scaling_for_AQS_1.0 https://wikitech.wikimedia.org/wiki/Depooling_servers Contains various ways to depool different servers. In a glorious future, we'd just need to do conftool depool but we aren't there yet! cp*** machineshttps://wikitech.wikimedia.org/wiki/Depooling_servers#cp***_machines mw* machines (and others)https://wikitech.wikimedia.org/wiki/Depooling_servers#mw*_machines_(and_others) Re-poolinghttps://wikitech.wikimedia.org/wiki/Depooling_servers#Re-pooling https://wikitech.wikimedia.org/wiki/Shell_Request/Asherman Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Summary Pageview_hourly datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Pageview_hourly_dataset Goalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Goal Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Results Next Stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Next_Steps Detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Details Methodologyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Methodology Plain Englishhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Plain_English Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Caveats Exampleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Examples Example 1, same set of pages visited. iOS Apphttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Example_1,_same_set_of_pages_visited._iOS_App Example 2, similar set of pages. Blackberry devicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Example_2,_similar_set_of_pages._Blackberry_device SQLhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#SQL Checks And Balanceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Checks_And_Balances Other exploitshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Identity_reconstruction_analysis#Other_exploits https://wikitech.wikimedia.org/wiki/Mailman/Migration This page documents comments made about past migrations. This is here to centralise specific notes and also to allow comments/experiences to expand into more detail in future. Migration from lily to sodiumhttps://wikitech.wikimedia.org/wiki/Mailman/Migration#Migration_from_lily_to_sodium Migration from sodium to fermiumhttps://wikitech.wikimedia.org/wiki/Mailman/Migration#Migration_from_sodium_to_fermium https://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage#Actionables Kernelhttps://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage#Kernel Paginghttps://wikitech.wikimedia.org/wiki/Incidents/20150925-LabsOutage#Paging https://wikitech.wikimedia.org/wiki/Shell_Request/Pawans-optimus Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance If you did not measure it (well), it did not happen Introhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#Intro Averages versus Medianshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#Averages_versus_Medians Latency is bimodalhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#Latency_is_bimodal Bonushttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#Bonus t-test is not meaningfulhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#t-test_is_not_meaningful Be wary of normalizing the distributionhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#Be_wary_of_normalizing_the_distribution Benchmark quality: Do you have enough data?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#Benchmark_quality:_Do_you_have_enough_data? How do we get enough data so our sample is statistically significant?https://wikitech.wikimedia.org/wiki/Analytics/Archive/Performance#How_do_we_get_enough_data_so_our_sample_is_statistically_significant? https://wikitech.wikimedia.org/wiki/Shell_Request/BengaliHindu Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20150930-enwiki-readonly == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20150930-enwiki-readonly#Summary Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20150930-enwiki-readonly#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20150930-enwiki-readonly#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots == TL;DR == TL;DRhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots#TL;DR Action Itemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots#Action_Items Meeting Notes 2015-09-30https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots#Meeting_Notes_2015-09-30 What about uniques? Don't they suffer from this bot problem when we are to implement them?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots#What_about_uniques?_Don't_they_suffer_from_this_bot_problem_when_we_are_to_implement_them? https://wikitech.wikimedia.org/wiki/Shell_Request/Technophant Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20151005-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151005-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151005-MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151005-MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151005-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151003-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151003-Parsoid#Summary Relevant chatter from #wikimedia-operationshttps://wikitech.wikimedia.org/wiki/Incidents/20151003-Parsoid#Relevant_chatter_from_#wikimedia-operations Relevant graphshttps://wikitech.wikimedia.org/wiki/Incidents/20151003-Parsoid#Relevant_graphs Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20151003-Parsoid#Analysis Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151003-Parsoid#Actionables https://wikitech.wikimedia.org/wiki/Analytics/Archive/DataRequests The job of the Analytics team is to provide infrastructure and services so you can put/get your statistics into a system via a fairly simple code snippet. We are an infrastructure team that provides analytics infrastructure. https://wikitech.wikimedia.org/wiki/Shell_Request/Dead_man_commander Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27 == 2015-07-31 == 2015-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-31 2015-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-30 2015-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-29 2015-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-28 2015-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-27 2015-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-26 2015-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-25 2015-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-24 2015-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-23 2015-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-22 2015-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-21 2015-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-20 2015-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-19 2015-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-18 2015-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-17 2015-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-16 2015-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-15 2015-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-14 2015-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-13 2015-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-12 2015-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-11 2015-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#2015-07-10 July 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_9 July 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_8 July 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_7 July 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_6 July 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_5 July 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_4 July 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_3 July 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_2 July 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#July_1 June 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_30 June 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_29 June 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_28 June 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_27 June 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_26 June 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_25 June 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_24 June 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_23 June 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_22 June 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_21 June 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_20 June 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_19 June 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_18 June 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_17 June 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_16 June 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_15 June 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_14 June 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_13 June 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_12 June 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_11 June 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_10 June 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_9 June 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_8 June 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_7 June 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_6 June 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_5 June 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_4 June 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_3 June 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_2 June 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#June_1 May 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_31 May 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_30 May 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_29 May 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_28 May 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_27 May 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_26 May 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_25 May 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_24 May 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_23 May 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_22 May 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_21 May 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_20 May 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_19 May 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_18 May 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_17 May 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_16 May 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_15 May 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_14 May 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_13 May 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_12 May 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_11 May 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_10 May 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_9 May 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_8 May 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_7 May 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_6 May 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_5 May 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_4 May 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_3 May 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_2 May 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#May_1 April 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_30 April 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_29 April 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_28 April 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_27 April 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_26 April 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_25 April 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_24 April 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_23 April 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_22 April 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_21 April 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_20 April 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_19 April 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_18 April 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_17 April 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_16 April 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_15 April 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_14 April 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_13 April 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_12 April 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_11 April 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_10 April 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_9 April 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_8 April 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_7 April 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_6 April 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_5 April 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_4 April 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_3 April 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_2 April 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#April_1 March 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_31 March 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_30 March 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_29 March 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_28 March 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_27 March 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_26 March 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_25 March 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_24 March 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_23 March 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_22 March 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_21 March 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_20 March 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_19 March 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_18 March 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_17 March 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_16 March 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_15 March 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_14 March 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_13 March 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_12 March 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_11 March 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_10 March 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_9 March 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_8 March 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_7 March 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_6 March 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_5 March 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_4 March 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_3 March 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_2 March 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#March_1 February 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_28 February 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_27 February 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_26 February 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_25 February 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_24 February 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_23 February 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_22 February 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_21 February 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_20 February 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_19 February 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_18 February 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_17 February 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_16 February 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_15 February 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_14 February 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_13 February 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_12 February 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_11 February 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_10 February 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_9 February 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_8 February 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_7 February 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_6 February 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_5 February 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_4 February 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_3 February 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_2 February 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#February_1 January 31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_31 January 30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_30 January 29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_29 January 28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_28 January 27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_27 January 26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_26 January 25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_25 January 24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_24 January 23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_23 January 22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_22 January 21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_21 January 20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_20 January 19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_19 January 18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_18 January 17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_17 January 16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_16 January 15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_15 January 14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_14 January 13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_13 January 12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_12 January 11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_11 January 10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_10 January 9https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_9 January 8https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_8 January 7https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_7 January 6https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_6 January 5https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_5 January 4https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_4 January 3https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_3 January 2https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_2 January 1https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_27#January_1 https://wikitech.wikimedia.org/wiki/Shell_Request/Toma.luca95 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries/Wikidata == 2018 - Wikidata editors that have also edited a Wikipedia == 2018 - Wikidata editors that have also edited a Wikipediahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries/Wikidata#2018_-_Wikidata_editors_that_have_also_edited_a_Wikipedia 2015 - Special:EntityData calls per user agent in a given hourhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Queries/Wikidata#2015_-_Special:EntityData_calls_per_user_agent_in_a_given_hour https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/10 === Week of October 5th === Week of October 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/10#Week_of_October_5th Week of October 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/10#Week_of_October_12th Week of October 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/10#Week_of_October_19th Week of October 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/10#Week_of_October_26th https://wikitech.wikimedia.org/wiki/Incidents/20151014-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151014-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151014-MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151014-MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151014-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151015-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151015-EventLogging#Summary Investigation and Recoveryhttps://wikitech.wikimedia.org/wiki/Incidents/20151015-EventLogging#Investigation_and_Recovery Data Loss Reporthttps://wikitech.wikimedia.org/wiki/Incidents/20151015-EventLogging#Data_Loss_Report Code Changeshttps://wikitech.wikimedia.org/wiki/Incidents/20151015-EventLogging#Code_Changes Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151015-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting This guide is a work in progress. See also MariaDB/monitoring and MariaDB/Backups#Recovering_a_Snapshot Depooling a replicahttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica Depooling a parsercache hosthttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_parsercache_host x2 special topologyhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#x2_special_topology Master comes back in read onlyhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Master_comes_back_in_read_only Impacthttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Impact What to dohttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#What_to_do Depooling a master (a.k.a. promoting a new replica to master)https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_master_(a.k.a._promoting_a_new_replica_to_master) Planned switchoverhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Planned_switchover Emergency failoverhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Emergency_failover Replication laghttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Replication_lag Caused by hardwarehttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Caused_by_hardware Disks about to failhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Disks_about_to_fail Bad or defective BBUhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Bad_or_defective_BBU Overload due to long running querieshttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Overload_due_to_long_running_queries Memory issueshttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Memory_issues Wikireplicas memory issues (clouddb*)https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Wikireplicas_memory_issues_(clouddb*) Data losshttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Data_loss Normal reprovisioninghttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Normal_reprovisioning Long term backupshttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Long_term_backups Cloninghttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Cloning Binlogshttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Binlogs Data inconsistency between nodes "drift" / replication brokenhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Data_inconsistency_between_nodes_"drift"_/_replication_broken Split brainhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Split_brain Depooling a Labs dbproxyhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_Labs_dbproxy Using mysqlbinloghttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Using_mysqlbinlog Check replication health quicklyhttps://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Check_replication_health_quickly https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/coreproduction-20151020 == db1072 == db1072https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/coreproduction-20151020#db1072 https://wikitech.wikimedia.org/wiki/Incidents/20151024-LabsNFS-Lag == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151024-LabsNFS-Lag#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151024-LabsNFS-Lag#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151024-LabsNFS-Lag#Conclusions https://wikitech.wikimedia.org/wiki/Grafana.wikimedia.org/labs-project-board.json { https://wikitech.wikimedia.org/wiki/Incidents/20151022-EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151022-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151022-EventLogging#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151022-EventLogging#Actionables Schemas with Missing datahttps://wikitech.wikimedia.org/wiki/Incidents/20151022-EventLogging#Schemas_with_Missing_data https://wikitech.wikimedia.org/wiki/Incidents/20151026-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151026-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151026-MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151026-MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151026-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151023-graphite-grafana == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151023-graphite-grafana#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151023-graphite-grafana#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151023-graphite-grafana#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151023-graphite-grafana#Actionables https://wikitech.wikimedia.org/wiki/Analytics/Archive/AQS_-RESTBase To serve Pageview data via an API, we need to store the data somewhere after it's processed in Hadoop. This page details our options for data stores and our decision. https://wikitech.wikimedia.org/wiki/Fermium fermium is the mailing lists server (lists.wikimedia. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Shell_Request/Hortanis Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups After you have created a [account|Wikimedia Developer account], you may need to join a group in our LDAP server for specific access. Primary groupshttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#Primary_groups Specific groupshttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#Specific_groups wmf grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#wmf_group ops grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#ops_group ops-limited grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#ops-limited_group NDA grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#NDA_group wmde grouphttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#wmde_group See alsohttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Groups#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Urbanecm Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats == Legacy Version, Wikistats 1 == Legacy Version, Wikistats 1https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats#Legacy_Version,_Wikistats_1 New Version, Wikistats 2https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats#New_Version,_Wikistats_2 Metrics FAQhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats#Metrics_FAQ https://wikitech.wikimedia.org/wiki/Research See https://research.wikimedia. https://wikitech.wikimedia.org/wiki/Shell_Request/MisterSynergy Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Service_restarts This page collects procedures to restart services (or reboot the underlying server) in the WMF production cluster. acmechief hostshttps://wikitech.wikimedia.org/wiki/Service_restarts#acmechief_hosts Application servers (also image/video scalers and job runners and parsoid)https://wikitech.wikimedia.org/wiki/Service_restarts#Application_servers_(also_image/video_scalers_and_job_runners_and_parsoid) php-fpm restarthttps://wikitech.wikimedia.org/wiki/Service_restarts#php-fpm_restart Other services restarthttps://wikitech.wikimedia.org/wiki/Service_restarts#Other_services_restart Server Reboothttps://wikitech.wikimedia.org/wiki/Service_restarts#Server_Reboot aqshttps://wikitech.wikimedia.org/wiki/Service_restarts#aqs From the one of the AQS servershttps://wikitech.wikimedia.org/wiki/Service_restarts#From_the_one_of_the_AQS_servers From the Cumin serverhttps://wikitech.wikimedia.org/wiki/Service_restarts#From_the_Cumin_server From the Cumin server (cookbook)https://wikitech.wikimedia.org/wiki/Service_restarts#From_the_Cumin_server_(cookbook) ATShttps://wikitech.wikimedia.org/wiki/Service_restarts#ATS Baculahttps://wikitech.wikimedia.org/wiki/Service_restarts#Bacula Bastionshttps://wikitech.wikimedia.org/wiki/Service_restarts#Bastions Cache proxies (varnish) (cp)https://wikitech.wikimedia.org/wiki/Service_restarts#Cache_proxies_(varnish)_(cp) Cassandra (as used in aqs, sessionstore and restbase)https://wikitech.wikimedia.org/wiki/Service_restarts#Cassandra_(as_used_in_aqs,_sessionstore_and_restbase) Ceph (WMCS CloudVPS)https://wikitech.wikimedia.org/wiki/Service_restarts#Ceph_(WMCS_CloudVPS) ChartMuseumhttps://wikitech.wikimedia.org/wiki/Service_restarts#ChartMuseum cloudcontrolhttps://wikitech.wikimedia.org/wiki/Service_restarts#cloudcontrol clouddb (Wikireplicas)https://wikitech.wikimedia.org/wiki/Service_restarts#clouddb_(Wikireplicas) Charonhttps://wikitech.wikimedia.org/wiki/Service_restarts#Charon Cuminhttps://wikitech.wikimedia.org/wiki/Service_restarts#Cumin Druidhttps://wikitech.wikimedia.org/wiki/Service_restarts#Druid Authoritative DNShttps://wikitech.wikimedia.org/wiki/Service_restarts#Authoritative_DNS DNS recursorshttps://wikitech.wikimedia.org/wiki/Service_restarts#DNS_recursors Docker-registryhttps://wikitech.wikimedia.org/wiki/Service_restarts#Docker-registry Elasticsearchhttps://wikitech.wikimedia.org/wiki/Service_restarts#Elasticsearch Disgusting script to view Elasticsearch cluster healthhttps://wikitech.wikimedia.org/wiki/Service_restarts#Disgusting_script_to_view_Elasticsearch_cluster_health Restart Procedurehttps://wikitech.wikimedia.org/wiki/Service_restarts#Restart_Procedure Node ban procedure (for DC maintenances)https://wikitech.wikimedia.org/wiki/Service_restarts#Node_ban_procedure_(for_DC_maintenances) etcdhttps://wikitech.wikimedia.org/wiki/Service_restarts#etcd Eximhttps://wikitech.wikimedia.org/wiki/Service_restarts#Exim EventLogginghttps://wikitech.wikimedia.org/wiki/Service_restarts#EventLogging Event Schema Servicehttps://wikitech.wikimedia.org/wiki/Service_restarts#Event_Schema_Service failoidhttps://wikitech.wikimedia.org/wiki/Service_restarts#failoid Ganetihttps://wikitech.wikimedia.org/wiki/Service_restarts#Ganeti Gerrithttps://wikitech.wikimedia.org/wiki/Service_restarts#Gerrit GitLabhttps://wikitech.wikimedia.org/wiki/Service_restarts#GitLab GitLab runnershttps://wikitech.wikimedia.org/wiki/Service_restarts#GitLab_runners Hadoop workershttps://wikitech.wikimedia.org/wiki/Service_restarts#Hadoop_workers HAProxyhttps://wikitech.wikimedia.org/wiki/Service_restarts#HAProxy Hivehttps://wikitech.wikimedia.org/wiki/Service_restarts#Hive Icingahttps://wikitech.wikimedia.org/wiki/Service_restarts#Icinga IDPhttps://wikitech.wikimedia.org/wiki/Service_restarts#IDP Kafka brokers (analytics)https://wikitech.wikimedia.org/wiki/Service_restarts#Kafka_brokers_(analytics) Kafka brokers (main clusters)https://wikitech.wikimedia.org/wiki/Service_restarts#Kafka_brokers_(main_clusters) Kubernetes mastershttps://wikitech.wikimedia.org/wiki/Service_restarts#Kubernetes_masters Kubernetes workershttps://wikitech.wikimedia.org/wiki/Service_restarts#Kubernetes_workers Logstashhttps://wikitech.wikimedia.org/wiki/Service_restarts#Logstash LVShttps://wikitech.wikimedia.org/wiki/Service_restarts#LVS mapshttps://wikitech.wikimedia.org/wiki/Service_restarts#maps Mcrouterhttps://wikitech.wikimedia.org/wiki/Service_restarts#Mcrouter MySQL/MariaDBhttps://wikitech.wikimedia.org/wiki/Service_restarts#MySQL/MariaDB Memcachedhttps://wikitech.wikimedia.org/wiki/Service_restarts#Memcached memcached on other serviceshttps://wikitech.wikimedia.org/wiki/Service_restarts#memcached_on_other_services ncredirhttps://wikitech.wikimedia.org/wiki/Service_restarts#ncredir netflowhttps://wikitech.wikimedia.org/wiki/Service_restarts#netflow Netmonhttps://wikitech.wikimedia.org/wiki/Service_restarts#Netmon ntpdhttps://wikitech.wikimedia.org/wiki/Service_restarts#ntpd Ooziehttps://wikitech.wikimedia.org/wiki/Service_restarts#Oozie Oreshttps://wikitech.wikimedia.org/wiki/Service_restarts#Ores openldaphttps://wikitech.wikimedia.org/wiki/Service_restarts#openldap Parsoidhttps://wikitech.wikimedia.org/wiki/Service_restarts#Parsoid pinghttps://wikitech.wikimedia.org/wiki/Service_restarts#ping Pivothttps://wikitech.wikimedia.org/wiki/Service_restarts#Pivot Pool countershttps://wikitech.wikimedia.org/wiki/Service_restarts#Pool_counters PKIhttps://wikitech.wikimedia.org/wiki/Service_restarts#PKI Postgreshttps://wikitech.wikimedia.org/wiki/Service_restarts#Postgres puppetdbhttps://wikitech.wikimedia.org/wiki/Service_restarts#puppetdb Prometheushttps://wikitech.wikimedia.org/wiki/Service_restarts#Prometheus Puppet mastershttps://wikitech.wikimedia.org/wiki/Service_restarts#Puppet_masters Puppetboardhttps://wikitech.wikimedia.org/wiki/Service_restarts#Puppetboard Redishttps://wikitech.wikimedia.org/wiki/Service_restarts#Redis rdb* servers hosting the job queue for redis.https://wikitech.wikimedia.org/wiki/Service_restarts#rdb*_servers_hosting_the_job_queue_for_redis. oresrdb* servershttps://wikitech.wikimedia.org/wiki/Service_restarts#oresrdb*_servers mwlog* servershttps://wikitech.wikimedia.org/wiki/Service_restarts#mwlog*_servers relforgehttps://wikitech.wikimedia.org/wiki/Service_restarts#relforge restbasehttps://wikitech.wikimedia.org/wiki/Service_restarts#restbase RPKIhttps://wikitech.wikimedia.org/wiki/Service_restarts#RPKI sca servershttps://wikitech.wikimedia.org/wiki/Service_restarts#sca_servers scb servershttps://wikitech.wikimedia.org/wiki/Service_restarts#scb_servers stat* servershttps://wikitech.wikimedia.org/wiki/Service_restarts#stat*_servers sessionstorehttps://wikitech.wikimedia.org/wiki/Service_restarts#sessionstore Swifthttps://wikitech.wikimedia.org/wiki/Service_restarts#Swift Thanoshttps://wikitech.wikimedia.org/wiki/Service_restarts#Thanos Thumborhttps://wikitech.wikimedia.org/wiki/Service_restarts#Thumbor Volunteer Response Team (VRTS/OTRS)https://wikitech.wikimedia.org/wiki/Service_restarts#Volunteer_Response_Team_(VRTS/OTRS) Service Restarthttps://wikitech.wikimedia.org/wiki/Service_restarts#Service_Restart Wikidata Query Service (WDQS)https://wikitech.wikimedia.org/wiki/Service_restarts#Wikidata_Query_Service_(WDQS) Wikidough DoH/DoT Servicehttps://wikitech.wikimedia.org/wiki/Service_restarts#Wikidough_DoH/DoT_Service Yubico authentication servershttps://wikitech.wikimedia.org/wiki/Service_restarts#Yubico_authentication_servers Zookeeperhttps://wikitech.wikimedia.org/wiki/Service_restarts#Zookeeper Zuulhttps://wikitech.wikimedia.org/wiki/Service_restarts#Zuul One-off hostshttps://wikitech.wikimedia.org/wiki/Service_restarts#One-off_hosts sodiumhttps://wikitech.wikimedia.org/wiki/Service_restarts#sodium https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/11 === Week of November 2nd === Week of November 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/11#Week_of_November_2nd Week of November 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/11#Week_of_November_9th Week of November 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/11#Week_of_November_16th Week of November 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/11#Week_of_November_23rd Week of November 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/11#Week_of_November_30th https://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Actionables Buy more virt nodes, with bigger hard driveshttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Buy_more_virt_nodes,_with_bigger_hard_drives If we have the space, reduce the overcommit ratiohttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#If_we_have_the_space,_reduce_the_overcommit_ratio Address the fuzziness of overcommitting in some way to ensure that we don't schedule on full driveshttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Address_the_fuzziness_of_overcommitting_in_some_way_to_ensure_that_we_don't_schedule_on_full_drives Page when a virt node is running out of disk spacehttps://wikitech.wikimedia.org/wiki/Incidents/20151105-LabsOutage#Page_when_a_virt_node_is_running_out_of_disk_space https://wikitech.wikimedia.org/wiki/Rutherfordium rutherfordium was a virtual machine running on Ganeti. It used to host the service People. Connectinghttps://wikitech.wikimedia.org/wiki/Rutherfordium#Connecting https://wikitech.wikimedia.org/wiki/Shell_Request/Youtux Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews https://wikitech.wikimedia.org/wiki/Yubikey-SSH This procedure describes how to store your production SSH credentials on a Yubikey physical 2FA device. Doing so provides an additional layer of protection against having your key compromised via your laptop. Prerequisiteshttps://wikitech.wikimedia.org/wiki/Yubikey-SSH#Prerequisites Instructionshttps://wikitech.wikimedia.org/wiki/Yubikey-SSH#Instructions Resetting your Yubikeyhttps://wikitech.wikimedia.org/wiki/Yubikey-SSH#Resetting_your_Yubikey More informationhttps://wikitech.wikimedia.org/wiki/Yubikey-SSH#More_information https://wikitech.wikimedia.org/wiki/Shell_Request/Valsdav Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Thumbor The Wikimedia media thumbnailing infrastructure is based on Thumbor. Rationalehttps://wikitech.wikimedia.org/wiki/Thumbor#Rationale Supported file typeshttps://wikitech.wikimedia.org/wiki/Thumbor#Supported_file_types Broader ecosystemhttps://wikitech.wikimedia.org/wiki/Thumbor#Broader_ecosystem Public wikishttps://wikitech.wikimedia.org/wiki/Thumbor#Public_wikis Private wikishttps://wikitech.wikimedia.org/wiki/Thumbor#Private_wikis Hitting Thumbor (common)https://wikitech.wikimedia.org/wiki/Thumbor#Hitting_Thumbor_(common) Ways our use of Thumbor deviates from its original intenthttps://wikitech.wikimedia.org/wiki/Thumbor#Ways_our_use_of_Thumbor_deviates_from_its_original_intent Disk accesshttps://wikitech.wikimedia.org/wiki/Thumbor#Disk_access Filtershttps://wikitech.wikimedia.org/wiki/Thumbor#Filters Image processing orderinghttps://wikitech.wikimedia.org/wiki/Thumbor#Image_processing_ordering Subprocesseshttps://wikitech.wikimedia.org/wiki/Thumbor#Subprocesses Multi-engine setuphttps://wikitech.wikimedia.org/wiki/Thumbor#Multi-engine_setup Throttlinghttps://wikitech.wikimedia.org/wiki/Thumbor#Throttling Memcached-basedhttps://wikitech.wikimedia.org/wiki/Thumbor#Memcached-based Failurehttps://wikitech.wikimedia.org/wiki/Thumbor#Failure Poolcounter-basedhttps://wikitech.wikimedia.org/wiki/Thumbor#Poolcounter-based Per-IPhttps://wikitech.wikimedia.org/wiki/Thumbor#Per-IP Per-originalhttps://wikitech.wikimedia.org/wiki/Thumbor#Per-original Expensivehttps://wikitech.wikimedia.org/wiki/Thumbor#Expensive Logginghttps://wikitech.wikimedia.org/wiki/Thumbor#Logging Configurationhttps://wikitech.wikimedia.org/wiki/Thumbor#Configuration Scalinghttps://wikitech.wikimedia.org/wiki/Thumbor#Scaling Updating custom pluginshttps://wikitech.wikimedia.org/wiki/Thumbor#Updating_custom_plugins Testing the changeshttps://wikitech.wikimedia.org/wiki/Thumbor#Testing_the_changes Deploymenthttps://wikitech.wikimedia.org/wiki/Thumbor#Deployment Restartinghttps://wikitech.wikimedia.org/wiki/Thumbor#Restarting Dashboards and logshttps://wikitech.wikimedia.org/wiki/Thumbor#Dashboards_and_logs Manholehttps://wikitech.wikimedia.org/wiki/Thumbor#Manhole Local developmenthttps://wikitech.wikimedia.org/wiki/Thumbor#Local_development See alsohttps://wikitech.wikimedia.org/wiki/Thumbor#See_also https://wikitech.wikimedia.org/wiki/Incidents/20151118-LVS-PyBal == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151118-LVS-PyBal#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151118-LVS-PyBal#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151118-LVS-PyBal#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151118-LVS-PyBal#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Avro This describes how to do evolution of avro schemas in hive. Introhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Avro#Intro Create tables with avro schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Avro#Create_tables_with_avro_schema Update schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Avro#Update_schema External Tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Avro#External_Tables Mediawiki and Avrohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Avro#Mediawiki_and_Avro https://wikitech.wikimedia.org/wiki/Incidents/20151123-LabsOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151123-LabsOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151123-LabsOutage#Timeline https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research == Goal: Estimating undetected Bot traffic and users without cookies/incognito mode in pageview data == Goal: Estimating undetected Bot traffic and users without cookies/incognito mode in pageview datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Goal:_Estimating_undetected_Bot_traffic_and_users_without_cookies/incognito_mode_in_pageview_data Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Results Botshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Bots Requests with no cookieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Requests_with_no_cookies .. and the rest?...https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#.._and_the_rest?... Methodologyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Methodology Detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Details Codehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Code Daily numbershttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Daily_numbers Workloghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Bots_Research#Worklog https://wikitech.wikimedia.org/wiki/Incidents/20151126-graphite-grafana == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151126-graphite-grafana#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151126-graphite-grafana#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151126-graphite-grafana#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151126-graphite-grafana#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151127-EventLogging == Timeline == Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151127-EventLogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151127-EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151127-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Timeline Timeline of actionshttps://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Timeline_of_actions Timeline of ulsfo routing loop (primary failure)https://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Timeline_of_ulsfo_routing_loop_(primary_failure) Timeline of eqiad cr1/cr2 and row D connectivity failures (secondary failure)https://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Timeline_of_eqiad_cr1/cr2_and_row_D_connectivity_failures_(secondary_failure) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151127-PartialNetworkOutage#Actionables https://wikitech.wikimedia.org/wiki/Selling_to_Wikimedia_Foundation === A note to Information Technology Vendors === A note to Information Technology Vendorshttps://wikitech.wikimedia.org/wiki/Selling_to_Wikimedia_Foundation#A_note_to_Information_Technology_Vendors Advice for Wikimedia Foundation employeeshttps://wikitech.wikimedia.org/wiki/Selling_to_Wikimedia_Foundation#Advice_for_Wikimedia_Foundation_employees https://wikitech.wikimedia.org/wiki/Nutcracker Nutcracker (also known as twemproxy) is a lightweight proxy for memcached and Redis. It was primarily built to reduce the connection count between web servers and backend hosts. Servicehttps://wikitech.wikimedia.org/wiki/Nutcracker#Service Usagehttps://wikitech.wikimedia.org/wiki/Nutcracker#Usage See alsohttps://wikitech.wikimedia.org/wiki/Nutcracker#See_also External linkshttps://wikitech.wikimedia.org/wiki/Nutcracker#External_links https://wikitech.wikimedia.org/wiki/Incidents/20151203-SiliconOutage On December 3 2015 at about 14:00 UTC Silicon (the fundraising ActiveMQ server) stopped accepting connections. FR tech then received a flood of email alerts from Barium, the queue consumer. Sequence of Eventshttps://wikitech.wikimedia.org/wiki/Incidents/20151203-SiliconOutage#Sequence_of_Events Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20151203-SiliconOutage#Impact Root causehttps://wikitech.wikimedia.org/wiki/Incidents/20151203-SiliconOutage#Root_cause Recommendationshttps://wikitech.wikimedia.org/wiki/Incidents/20151203-SiliconOutage#Recommendations https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization In an effort toward privacy with regards to reader pageview data, we aim to sanitize the aggregate logs that we store long-term. There are two reasons for sanitizing the dataset. Problems: Reconstruction of browsing patterns & safe data publicationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Problems:_Reconstruction_of_browsing_patterns_&_safe_data_publication Browsing patterns reconstructionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Browsing_patterns_reconstruction Safe pageview data publicationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Safe_pageview_data_publication Solution: Sanitizing using K-Anonymity over multiple fieldshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Solution:_Sanitizing_using_K-Anonymity_over_multiple_fields Strategieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Strategies The good Kshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#The_good_Ks We found that:https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#We_found_that: It means that:https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#It_means_that: Choosing hourly or longer term data to establish the "uniqueness" of values in sensitive fieldshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Choosing_hourly_or_longer_term_data_to_establish_the_"uniqueness"_of_values_in_sensitive_fields Information loss analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Information_loss_analysis Entropy analysis - Definitionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Entropy_analysis_-_Definition Per dimensionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Per_dimension Globalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Global Entropy analysis - Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Entropy_analysis_-_Results Circadian Rhythmhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Circadian_Rhythm Continentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Continents Countrieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization#Countries https://wikitech.wikimedia.org/wiki/Selling_to_Wikimedia_Foundation/Pointer __NOEDITSECTION__ Copyhttps://wikitech.wikimedia.org/wiki/Selling_to_Wikimedia_Foundation/Pointer#Copy https://wikitech.wikimedia.org/wiki/Regenerate_cached_special_pages Some special pages (like Special:AncientPages) are cached in the database and only get updated periodically. If you need to manually regenerate a cached special page (which should rarely be necessary), you can do so by sshing to mwmaint1002 and running the following command: How-Tohttps://wikitech.wikimedia.org/wiki/Category:How-To https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization_algorithm_proposal In a plan to protect our user's data privacy, the pageview_hourly dataset needs to be sanitized in such a way that it does not allow to track user path. Algorithm using COUNT(DISTINCT ip) OR COUNT(DISTINCT page_title) as triggerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization_algorithm_proposal#Algorithm_using_COUNT(DISTINCT_ip)_OR_COUNT(DISTINCT_page_title)_as_trigger Plain Englishhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization_algorithm_proposal#Plain_English Pseudo-codehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization_algorithm_proposal#Pseudo-code Previous Idea - Using SUM(views_count) as triggerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Sanitization_algorithm_proposal#Previous_Idea_-_Using_SUM(views_count)_as_trigger https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/12 === Week of December 7th === Week of December 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/12#Week_of_December_7th Week of December 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/12#Week_of_December_14th Week of December 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/12#Week_of_December_21st Week of December 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/12#Week_of_December_28th https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis In a plan to secure our user data, the pageview_hourly dataset needs to be sanitized in such a way that it does not allow to track user path. Dataset specificationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#Dataset_specification General shape of datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#General_shape_of_data Finger-printing groups, distinct ips, distinct pages and requestshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#Finger-printing_groups,_distinct_ips,_distinct_pages_and_requests Distinct IPshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#Distinct_IPs Distinct pageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#Distinct_pages Example of pages viewed togetherhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#Example_of_pages_viewed_together By number of distinct IPshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#By_number_of_distinct_IPs 2 distinct IPshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#2_distinct_IPs 3 distinct IPshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#3_distinct_IPs By number of distinct pages (with more than only 1 IP)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#By_number_of_distinct_pages_(with_more_than_only_1_IP) 2 distinct pageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#2_distinct_pages 3 distinct pageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#3_distinct_pages 4 distinct pageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#4_distinct_pages 5 distinct pages - Detailed analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/K_Anonymity_Threshold_Analysis#5_distinct_pages_-_Detailed_analysis https://wikitech.wikimedia.org/wiki/Incidents/20151215-swift-syslog == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151215-swift-syslog#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151215-swift-syslog#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151215-swift-syslog#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151215-swift-syslog#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151216-ores == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151216-ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151216-ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151216-ores#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151216-ores#Actionables https://wikitech.wikimedia.org/wiki/Analytics/Archive/BrowserReports Please see https://analytics.wikimedia. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery-source Refinery-source is the JVM software on the Analytics Cluster using spark or hive UDFs. The source code is in the analytics/refinery/source. How to deploy with Jenkins (and related steps)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery-source#How_to_deploy_with_Jenkins_(and_related_steps) If the maven release job failed (step 2)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery-source#If_the_maven_release_job_failed_(step_2) Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery-source#Administration Changing the archiva-ci passwordhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery-source#Changing_the_archiva-ci_password How to deploy from the CLIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine/Deploy_Refinery-source#How_to_deploy_from_the_CLI https://wikitech.wikimedia.org/wiki/Incidents/20151216-Labs-NFS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151216-Labs-NFS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151216-Labs-NFS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151216-Labs-NFS#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151216-Labs-NFS#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151217-cxserver == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151217-cxserver#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151217-cxserver#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151217-cxserver#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151217-cxserver#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20151218-payments_wiki On December 18 2015 at 11:15 UTC icinga started sending alerts about payments Sequence of Eventshttps://wikitech.wikimedia.org/wiki/Incidents/20151218-payments_wiki#Sequence_of_Events Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20151218-payments_wiki#Impact Root causehttps://wikitech.wikimedia.org/wiki/Incidents/20151218-payments_wiki#Root_cause Recommendationshttps://wikitech.wikimedia.org/wiki/Incidents/20151218-payments_wiki#Recommendations https://wikitech.wikimedia.org/wiki/Incidents/20151214-Math-and-Mathoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20151214-Math-and-Mathoid#Summary Descriptionhttps://wikitech.wikimedia.org/wiki/Incidents/20151214-Math-and-Mathoid#Description Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20151214-Math-and-Mathoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20151214-Math-and-Mathoid#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20151214-Math-and-Mathoid#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Devices_Analytics https://wikitech.wikimedia.org/wiki/Incidents/20151229-SiliconOutage On December 29 2015 at about 21:57 UTC Silicon (the fundraising ActiveMQ server) stopped accepting connections. FR tech received a flood of email alerts from Barium, the queue consumer. Sequence of Eventshttps://wikitech.wikimedia.org/wiki/Incidents/20151229-SiliconOutage#Sequence_of_Events Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20151229-SiliconOutage#Impact Root causehttps://wikitech.wikimedia.org/wiki/Incidents/20151229-SiliconOutage#Root_cause Recommendationshttps://wikitech.wikimedia.org/wiki/Incidents/20151229-SiliconOutage#Recommendations https://wikitech.wikimedia.org/wiki/Portal:Wikitech The production part of this wiki, also known as Wikitech, is for technical documentation of internal infrastructure at the Wikimedia Foundation. See alsohttps://wikitech.wikimedia.org/wiki/Portal:Wikitech#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS __NOTOC__ Cloud VPShttps://wikitech.wikimedia.org/wiki/Category:Cloud_VPS Portalshttps://wikitech.wikimedia.org/wiki/Category:Portals https://wikitech.wikimedia.org/wiki/Portal:Toolforge }} Documentationhttps://wikitech.wikimedia.org/wiki/Category:Documentation Portalshttps://wikitech.wikimedia.org/wiki/Category:Portals Toolforgehttps://wikitech.wikimedia.org/wiki/Category:Toolforge https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016#By_month https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/01 === Week of January 4th ===  Week of January 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/01#_Week_of_January_4th Week of January 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/01#Week_of_January_11th Week of January 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/01#Week_of_January_18th Week of January 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/01#Week_of_January_25th https://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Timeline Timeline 1: IRChttps://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Timeline_1:_IRC Timeline 2: grid engine log filehttps://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Timeline_2:_grid_engine_log_file Job 2221233https://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Job_2221233 https://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE# Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160112-20160111-toollabs-SGE#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo Matomo (formerly known as Piwik) is a web analytics platform which we use for microsites (roughly 10,000 requests per day or less). Our production instance can be reached at https://piwik. Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Access How to instrumenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#How_to_instrument Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Administration When team requests a piwik beaconhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#When_team_requests_a_piwik_beacon Rerun reports for all websiteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Rerun_reports_for_all_websites Invalidate old reportshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Invalidate_old_reports Tuninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Tuning Known outageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Known_outages Upgrade Matomohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Upgrade_Matomo Restart Matomohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Matomo#Restart_Matomo https://wikitech.wikimedia.org/wiki/Shell_Request/Nschaaf Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28 == 2015-12-31 == 2015-12-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-31 2015-12-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-30 2015-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-29 2015-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-28 2015-12-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-27 2015-12-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-26 2015-12-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-25 2015-12-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-24 2015-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-23 2015-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-22 2015-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-21 2015-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-20 2015-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-19 2015-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-18 2015-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-17 2015-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-16 2015-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-15 2015-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-14 2015-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-13 2015-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-12 2015-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-11 2015-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-10 2015-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-09 2015-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-08 2015-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-07 2015-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-06 2015-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-05 2015-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-04 2015-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-03 2015-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-02 2015-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-12-01 2015-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-30 2015-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-29 2015-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-28 2015-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-27 2015-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-26 2015-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-25 2015-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-24 2015-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-23 2015-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-22 2015-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-21 2015-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-20 2015-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-19 2015-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-18 2015-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-17 2015-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-16 2015-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-15 2015-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-14 2015-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-13 2015-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-12 2015-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-11 2015-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-10 2015-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-09 2015-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-08 2015-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-07 2015-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-06 2015-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-05 2015-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-04 2015-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-03 2015-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-02 2015-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-11-01 2015-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-31 2015-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-30 2015-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-29 2015-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-28 2015-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-27 2015-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-26 2015-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-25 2015-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-24 2015-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-23 2015-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-22 2015-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-21 2015-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-20 2015-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-19 2015-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-18 2015-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-17 2015-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-16 2015-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-15 2015-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-14 2015-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-13 2015-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-12 2015-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-11 2015-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-10 2015-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-09 2015-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-08 2015-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-07 2015-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-06 2015-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-05 2015-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-04 2015-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-03 2015-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-02 2015-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-10-01 2015-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-30 2015-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-29 2015-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-28 2015-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-27 2015-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-26 2015-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-25 2015-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-24 2015-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-23 2015-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-22 2015-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-21 2015-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-20 2015-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-19 2015-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-18 2015-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-17 2015-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-16 2015-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-15 2015-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-14 2015-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-13 2015-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-12 2015-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-11 2015-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-10 2015-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-09 2015-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-08 2015-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-07 2015-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-06 2015-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-05 2015-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-04 2015-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-03 2015-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-02 2015-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-09-01 2015-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-31 2015-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-30 2015-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-29 2015-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-28 2015-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-27 2015-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-26 2015-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-25 2015-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-24 2015-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-23 2015-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-22 2015-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-21 2015-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-20 2015-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-19 2015-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-18 2015-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-17 2015-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-16 2015-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-15 2015-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-14 2015-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-13 2015-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-12 2015-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-11 2015-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-10 2015-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-09 2015-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-08 2015-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-07 2015-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-06 2015-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-05 2015-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-04 2015-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-03 2015-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-02 2015-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_28#2015-08-01 https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1 == 2015-12-30 == 2015-12-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-30 2015-12-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-29 2015-12-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-26 2015-12-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-23 2015-12-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-22 2015-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-21 2015-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-19 2015-12-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-18 2015-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-17 2015-12-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-16 2015-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-15 2015-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-14 2015-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-13 2015-12-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-11 2015-12-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-10 2015-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-09 2015-12-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-08 2015-12-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-07 2015-12-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-04 2015-12-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-03 2015-12-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-02 2015-12-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-12-01 2015-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-29 2015-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-27 2015-11-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-26 2015-11-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-25 2015-11-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-24 2015-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-23 2015-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-22 2015-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-20 2015-11-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-13 2015-11-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-12 2015-11-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-11 2015-11-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-10 2015-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-09 2015-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-07 2015-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-06 2015-11-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-05 2015-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-04 2015-11-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-03 2015-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-02 2015-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-11-01 2015-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-31 2015-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-30 2015-10-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-29 2015-10-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-28 2015-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-27 2015-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-26 2015-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-24 2015-10-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-23 2015-10-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-22 2015-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-19 2015-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-16 2015-10-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-15 2015-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-14 2015-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-13 2015-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-12 2015-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-11 2015-10-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-09 2015-10-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-07 2015-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-06 2015-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-05 2015-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-04 2015-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-03 2015-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-02 2015-10-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-10-01 2015-09-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-30 2015-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-29 2015-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-28 2015-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-27 2015-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-26 2015-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-25 2015-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-24 2015-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-23 2015-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-22 2015-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-21 2015-09-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-18 2015-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-17 2015-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-16 2015-09-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-15 2015-09-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-14 2015-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-12 2015-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-11 2015-09-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-10 2015-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-09 2015-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-08 2015-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-07 2015-09-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-04 2015-09-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-03 2015-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-02 2015-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-09-01 2015-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-31 2015-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-30 2015-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-29 2015-08-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-28 2015-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-27 2015-08-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-26 2015-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-25 2015-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-24 2015-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-23 2015-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-22 2015-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-21 2015-08-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-19 2015-08-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-18 2015-08-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-17 2015-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-15 2015-08-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-14 2015-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-13 2015-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-12 2015-08-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-11 2015-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-10 2015-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-08 2015-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-07 2015-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-06 2015-08-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-05 2015-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-04 2015-08-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-02 2015-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-08-01 2015-07-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-31 2015-07-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-30 2015-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-29 2015-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-28 2015-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-27 2015-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-24 2015-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-23 2015-07-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-22 2015-07-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-21 2015-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-20 2015-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-17 2015-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-16 2015-07-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-15 2015-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-14 2015-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-13 2015-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#2015-07-11 July 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_10 July 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_9 July 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_8 July 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_7 July 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_6 July 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_3 July 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_2 July 1https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#July_1 June 30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_30 June 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_29 June 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_27 June 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_26 June 25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_25 June 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_24 June 23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_23 June 22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_22 June 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_21 June 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_20 June 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_19 June 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_17 June 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_16 June 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_15 June 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_13 June 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_12 June 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_11 June 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_10 June 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_9 June 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_8 June 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_7 June 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_6 June 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_5 June 4https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_4 June 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_3 June 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_2 June 1https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#June_1 May 31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_31 May 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_29 May 28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_28 May 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_27 May 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_24 May 23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_23 May 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_20 May 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_19 May 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_12 May 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_11 May 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_9 May 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_8 May 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_7 May 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_6 May 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_5 May 4https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_4 May 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#May_2 April 30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_30 April 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_29 April 28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_28 April 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_27 April 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_26 April 25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_25 April 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_24 April 23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_23 April 22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_22 April 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_21 April 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_20 April 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_19 April 18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_18 April 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_17 April 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_16 April 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_15 April 14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_14 April 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_13 April 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_12 April 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_11 April 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_10 April 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_9 April 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_8 April 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_7 April 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_6 April 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_5 April 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_3 April 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_2 April 1https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#April_1 March 31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_31 March 30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_30 March 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_29 March 28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_28 March 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_27 March 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_26 March 25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_25 March 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_24 March 23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_23 March 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_21 March 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_20 March 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_19 March 18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_18 March 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_17 March 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_16 March 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_15 March 14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_14 March 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_13 March 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_12 March 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_11 March 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_10 March 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_9 March 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_8 March 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_7 March 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_6 March 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_5 March 4https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_4 March 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_3 March 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#March_2 February 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_27 February 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_26 February 25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_25 February 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_24 February 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_21 February 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_20 February 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_19 February 18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_18 February 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_17 February 14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_14 February 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_13 February 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_12 February 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_11 February 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_10 February 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_9 February 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_7 February 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_6 February 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_5 February 4https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_4 February 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_3 February 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#February_2 January 31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_31 January 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_29 January 28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_28 January 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_27 January 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_26 January 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_24 January 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_20 January 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_17 January 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_16 January 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_15 January 14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_14 January 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_13 January 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_12 January 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_8 January 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_7 January 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#January_6 December 22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_22 December 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_21 December 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_19 December 18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_18 December 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_17 December 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_16 December 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_15 December 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_13 December 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_12 December 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_11 December 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_10 December 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_9 December 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_8 December 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_5 December 4https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_4 December 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_3 December 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_2 December 1https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#December_1 November 27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_27 November 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_26 November 25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_25 November 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_24 November 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_21 November 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_20 November 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_19 November 18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_18 November 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_17 November 14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_14 November 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_13 November 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_12 November 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_9 November 8https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_8 November 6https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_6 November 5https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#November_5 October 31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_31 October 30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_30 October 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_29 October 28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_28 October 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_24 October 23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_23 October 22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_22 October 21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_21 October 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_20 October 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_17 October 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_16 October 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_15 October 14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_14 October 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_10 October 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_9 October 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_7 October 3https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_3 October 2https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_2 October 1https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#October_1 September 30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_30 September 29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_29 September 26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_26 September 25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_25 September 24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_24 September 23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_23 September 22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_22 September 20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_20 September 19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_19 September 17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_17 September 16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_16 September 15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_15 September 13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_13 September 12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_12 September 11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_11 September 10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_10 September 9https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_9 September 7https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_1#September_7 https://wikitech.wikimedia.org/wiki/PAWS PAWS: A Web Shell (PAWS) is a Jupyter notebook deployment hosted by Wikimedia. https://wikitech.wikimedia.org/wiki/Shell_Request/Dg711 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/J.little Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Discovery/Analytics Discovery uses the Analytics Cluster to support CirrusSearch. The source code is in the wikimedia/discovery/analytics repository. search/airflowhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#search/airflow Updating dependencieshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Updating_dependencies Deployhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Deploy Post-Deployhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Post-Deploy Debugginghttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Debugging wikimedia/discovery/analyticshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#wikimedia/discovery/analytics WMF Dependencieshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#WMF_Dependencies Adding a new DAGhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Adding_a_new_DAG Verifying code changeshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Verifying_code_changes How to prepare a commithttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#How_to_prepare_a_commit Airflow fixtureshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Airflow_fixtures Airflow Variableshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Airflow_Variables How to prepare a deployhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#How_to_prepare_a_deploy Updating python scriptshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Updating_python_scripts Updating python environmentshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Updating_python_environments Updating java jarshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Updating_java_jars Verify artifacts in patch set are fetchablehttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Verify_artifacts_in_patch_set_are_fetchable Updating airflow dagshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Updating_airflow_dags How to deployhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#How_to_deploy Airflow Production Deploymenthttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Airflow_Production_Deployment Airflow Test Deploymenthttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Airflow_Test_Deployment Web Basedhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Web_Based Yarnhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Yarn CLIhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#CLI List running spark jobs in Yarnhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#List_running_spark_jobs_in_Yarn Fetch application logshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Fetch_application_logs Yarn manager logshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Yarn_manager_logs Airflow Alertshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Airflow_Alerts Sensor timeouts and SLAshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#Sensor_timeouts_and_SLAs False positiveshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics#False_positives https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects This page discusses the following question: What happens when a request goes through redirects like Types of redirectshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Types_of_redirects Direct correct requesthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Direct_correct_request URI encodings performed by the browserhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#URI_encodings_performed_by_the_browser Capitalization of the first letterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Capitalization_of_the_first_letter Conversion of spaceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Conversion_of_spaces Other spellings covered by a redirect pagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Other_spellings_covered_by_a_redirect_page Alternate spellings NOT covered by a redirect pagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Alternate_spellings_NOT_covered_by_a_redirect_page Potential problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Potential_problems Per article analyseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Per_article_analyses Possible solutions?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#Possible_solutions? X-Analyticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews/Redirects#X-Analytics https://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#Timeline 2016-01-24 00:09:18 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#2016-01-24_00:09:18_UTC 2016-01-25 07:22 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#2016-01-25_07:22_UTC 2016-01-25 09:30 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#2016-01-25_09:30_UTC 2016-01-25 09:56 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#2016-01-25_09:56_UTC 2016-01-25 10:13 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#2016-01-25_10:13_UTC 2016-01-25 11:00 UTChttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#2016-01-25_11:00_UTC Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160125-EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection wikimedia.org domain redirection outage on 2016-01-26. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection#Timeline Pre-Outagehttps://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection#Pre-Outage Outagehttps://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection#Outage Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160126-WikimediaDomainRedirection#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160123-SessionManagerRolloutFailure MediaWiki 1.27. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160123-SessionManagerRolloutFailure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160123-SessionManagerRolloutFailure#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160123-SessionManagerRolloutFailure#Conclusions Related Phabricator taskshttps://wikitech.wikimedia.org/wiki/Incidents/20160123-SessionManagerRolloutFailure#Related_Phabricator_tasks https://wikitech.wikimedia.org/wiki/Incidents/20160128-MediaWiki-API == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160128-MediaWiki-API#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160128-MediaWiki-API#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160128-MediaWiki-API#Actionables https://wikitech.wikimedia.org/wiki/Switch_Datacenter == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Introduction What?https://wikitech.wikimedia.org/wiki/Switch_Datacenter#What? When?https://wikitech.wikimedia.org/wiki/Switch_Datacenter#When? Impacthttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Impact What does read-only mean?https://wikitech.wikimedia.org/wiki/Switch_Datacenter#What_does_read-only_mean? High Level switchover flowhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#High_Level_switchover_flow Scheduling detailshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Scheduling_details Day 1 - Tuesday: Traffic+Serviceshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_1_-_Tuesday:_Traffic+Services Day 2 - Wednesday: MediaWikihttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_2_-_Wednesday:_MediaWiki Day 3 - Thursday: Deployment Server + Special caseshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_3_-_Thursday:_Deployment_Server_+_Special_cases Day 8 - Wednesday: Pool back inactive DChttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_8_-_Wednesday:_Pool_back_inactive_DC Weeks in advance: communication, testing, and preparationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Weeks_in_advance:_communication,_testing,_and_preparation Communication - 10 weeks beforehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Communication_-_10_weeks_before Testing - 3 weeks beforehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Testing_-_3_weeks_before Live Testhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Live_Test Dry Runhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Dry_Run Preparation - a few days beforehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Preparation_-_a_few_days_before Per-service switchover instructionshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Per-service_switchover_instructions Traffichttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Traffic General procedurehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#General_procedure Day 1: Depool source datacentrehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_1:_Depool_source_datacentre Day 8: Switch to Multi-DC againhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_8:_Switch_to_Multi-DC_again Dashboardshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Dashboards Serviceshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Services Day 1: Depooling source DChttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_1:_Depooling_source_DC MediaWikihttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#MediaWiki Day 2: MediaWiki Switchoverhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Day_2:_MediaWiki_Switchover Phase 0 - preparationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_0_-_preparation Phase 1 - stop maintenancehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_1_-_stop_maintenance Phase 2 - read-only modehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_2_-_read-only_mode Phase 3 - lock down database mastershttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_3_-_lock_down_database_masters Phase 4 - switch active datacenter configurationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_4_-_switch_active_datacenter_configuration Phase 5 - DEPRECATED - Invert Redis replication for MediaWiki sessionshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_5_-_DEPRECATED_-_Invert_Redis_replication_for_MediaWiki_sessions Phase 6 - Set new site's databases to read-writehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_6_-_Set_new_site's_databases_to_read-write Phase 7 - Set MediaWiki to read-writehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_7_-_Set_MediaWiki_to_read-write Phase 8 - Restore rest of MediaWikihttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_8_-_Restore_rest_of_MediaWiki Phase 9 - Post read-onlyhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_9_-_Post_read-only Phase 10 - verification and troubleshootinghttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_10_-_verification_and_troubleshooting ElasticSearchhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#ElasticSearch General context on how to switchoverhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#General_context_on_how_to_switchover Special caseshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Special_cases Exclusionshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Exclusions Single servicehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Single_service apthttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#apt restbase-asynchttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#restbase-async Manual switchhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Manual_switch Databaseshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Databases Other miscellaneoushttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Other_miscellaneous Predictable, Recurring Switchovershttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Predictable,_Recurring_Switchovers Upcoming Switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Upcoming_Switches Past Switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Past_Switches 2024 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2024_switches 2023 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2023_switches 2021 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2021_switches 2020 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2020_switches 2018 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2018_switches 2017 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2017_switches 2016 switcheshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#2016_switches Monitoring Dashboardshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter#Monitoring_Dashboards https://wikitech.wikimedia.org/wiki/Incidents/20160202-deployment-server-loss == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160202-deployment-server-loss#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160202-deployment-server-loss#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160202-deployment-server-loss#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160202-deployment-server-loss#Actionables https://wikitech.wikimedia.org/wiki/Mobileapps_(service) Mobile Content Service is [for service decommissioning in July 2023]. Contact infohttps://wikitech.wikimedia.org/wiki/Mobileapps_(service)#Contact_info Consequences of shutdown/failurehttps://wikitech.wikimedia.org/wiki/Mobileapps_(service)#Consequences_of_shutdown/failure External linkshttps://wikitech.wikimedia.org/wiki/Mobileapps_(service)#External_links https://wikitech.wikimedia.org/wiki/Incidents/20160204-Phabricator == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160204-Phabricator#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160204-Phabricator#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160204-Phabricator#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160204-Phabricator#Actionables https://wikitech.wikimedia.org/wiki/Apache_log_format The WMF Apache access log format is derived from the cache log format. It has tab-separated fields. https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/02 === Week of February 1st === Week of February 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/02#Week_of_February_1st Week of February 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/02#Week_of_February_8th Week of February 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/02#Week_of_February_15th Week of February 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/02#Week_of_February_22nd Week of February 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/02#Week_of_February_29th https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Fingerprinting_Over_Time In a plan to secure our user data, the pageview_hourly dataset needs to be sanitized in such a way that it does not allow to track user path. See this page for a broad view on the pageview_hourly sanitization project. Data Preparationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Fingerprinting_Over_Time#Data_Preparation Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_hourly/Fingerprinting_Over_Time#Results https://wikitech.wikimedia.org/wiki/Incidents/20160209-PlannedMaintenance Between 23:00 and 23:59 UTC, February 9th 2016 there is a scheduled maintenance window that will affect some of the wikis hosted by the Wikimedia Foundation. Wikis affectedhttps://wikitech.wikimedia.org/wiki/Incidents/20160209-PlannedMaintenance#Wikis_affected Post-Maintenance Reporthttps://wikitech.wikimedia.org/wiki/Incidents/20160209-PlannedMaintenance#Post-Maintenance_Report https://wikitech.wikimedia.org/wiki/Yubikey4_and_gpg-agent Using the Yubikey4 for ssh key generation and storage as well as one-time-password generation. There are a ton of guides to a ton of subtly different methods of doing basically this, I mean only to provide a simple explanation of what worked for me. Use gpg-agent instead of ssh-agenthttps://wikitech.wikimedia.org/wiki/Yubikey4_and_gpg-agent#Use_gpg-agent_instead_of_ssh-agent Generate an authentication keyhttps://wikitech.wikimedia.org/wiki/Yubikey4_and_gpg-agent#Generate_an_authentication_key https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices == How is this data computed == How is this data computedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices#How_is_this_data_computed Tables schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices#Tables_schema Sample query to get total uniques for a given host or project_family for a dayhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices#Sample_query_to_get_total_uniques_for_a_given_host_or_project_family_for_a_day Data Qualityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices#Data_Quality Changes and Known Problems with Datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices#Changes_and_Known_Problems_with_Dataset See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices#See_also https://wikitech.wikimedia.org/wiki/Incidents/20160212-AllWikisOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160212-AllWikisOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160212-AllWikisOutage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160212-AllWikisOutage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160212-AllWikisOutage#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160214-labsdb1002 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160214-labsdb1002#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160214-labsdb1002#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160214-labsdb1002#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160214-labsdb1002#Actionables https://wikitech.wikimedia.org/wiki/Switch_Datacenter/DeploymentServer This page describes the procedure to switch over the active deployment server from one host to another. Procedurehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/DeploymentServer#Procedure https://wikitech.wikimedia.org/wiki/WebPageTest/WPTBulkTester WPT Bulk Tester is a Open Source script to bulk test many URLs using WebPageTest and get the result in a Google spreadsheet. It's created by Andy Davies. Starthttps://wikitech.wikimedia.org/wiki/WebPageTest/WPTBulkTester#Start Gotchashttps://wikitech.wikimedia.org/wiki/WebPageTest/WPTBulkTester#Gotchas Connectivityhttps://wikitech.wikimedia.org/wiki/WebPageTest/WPTBulkTester#Connectivity Verifyhttps://wikitech.wikimedia.org/wiki/WebPageTest/WPTBulkTester#Verify Scripted testshttps://wikitech.wikimedia.org/wiki/WebPageTest/WPTBulkTester#Scripted_tests https://wikitech.wikimedia.org/wiki/Shell_Request/Sabya Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/XHGui XHGui is a web application providing a graphical interface for PHP profiling data. It displays the call tree for a profiled web request with aggregations of memory usage, call count, and approximate time duration for all called functions. Runbookhttps://wikitech.wikimedia.org/wiki/XHGui#Runbook External linkhttps://wikitech.wikimedia.org/wiki/XHGui#External_link https://wikitech.wikimedia.org/wiki/WikimediaDebug WikimediaDebug is a set of tools for debugging and profiling MediaWiki web requests in a production environment. Browser usagehttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Browser_usage Command-line usagehttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Command-line_usage Optionshttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Options Available backendshttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Available_backends Request profilinghttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Request_profiling Speedscope viewshttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Speedscope_views XHGui profilinghttps://wikitech.wikimedia.org/wiki/WikimediaDebug#XHGui_profiling Plaintext request profilehttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Plaintext_request_profile Plaintext CLI profilehttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Plaintext_CLI_profile Verbose logginghttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Verbose_logging Debug logging (CLI)https://wikitech.wikimedia.org/wiki/WikimediaDebug#Debug_logging_(CLI) Staging changeshttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Staging_changes Limitationshttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Limitations Code stewardhttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Code_steward See alsohttps://wikitech.wikimedia.org/wiki/WikimediaDebug#See_also Further readinghttps://wikitech.wikimedia.org/wiki/WikimediaDebug#Further_reading External linkshttps://wikitech.wikimedia.org/wiki/WikimediaDebug#External_links https://wikitech.wikimedia.org/wiki/Incidents/20160212-LabsSudoVulnerability == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160212-LabsSudoVulnerability#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160212-LabsSudoVulnerability#Timeline Affected projectshttps://wikitech.wikimedia.org/wiki/Incidents/20160212-LabsSudoVulnerability#Affected_projects Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160212-LabsSudoVulnerability#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160212-LabsSudoVulnerability#Actionables https://wikitech.wikimedia.org/wiki/Cindy_The_Browser_Test_Bot Cindy is the browser test bot which runs browser tests for CirrusSearch extension. It is run on any patch against mediawiki/extensions/CirrusSearch repository and V+1 or V-1 the patch in Gerrit depending on the test results. The testshttps://wikitech.wikimedia.org/wiki/Cindy_The_Browser_Test_Bot#The_tests The runnerhttps://wikitech.wikimedia.org/wiki/Cindy_The_Browser_Test_Bot#The_runner The bothttps://wikitech.wikimedia.org/wiki/Cindy_The_Browser_Test_Bot#The_bot Logshttps://wikitech.wikimedia.org/wiki/Cindy_The_Browser_Test_Bot#Logs Web Accesshttps://wikitech.wikimedia.org/wiki/Cindy_The_Browser_Test_Bot#Web_Access https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org iegreview.wikimedia. How did I access it?https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org#How_did_I_access_it? Where could I report issues?https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org#Where_could_I_report_issues? Where did it run?https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org#Where_did_it_run? Where's the code?https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org#Where's_the_code? How was it deployed?https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org#How_was_it_deployed? Where were the logs?https://wikitech.wikimedia.org/wiki/Iegreview.wikimedia.org#Where_were_the_logs? https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MemcachedRedisSessions This page describes the procedure to switch over safely the redis/memcached cluster in the process of switching mediawiki. https://wikitech.wikimedia.org/wiki/Shell_Request/%D0%98%D0%BB%D1%8C%D1%8F_%D0%94%D1%80%D0%B0%D0%BA%D0%BE%D0%BD%D0%BE%D0%B2 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Global_traffic_routing This page covers our mechanisms for routing user requests through our Traffic infrastructure layers. The routing can be modified through administrative actions to improve performance and/or reliability, and/or respond to network outage conditions. Siteshttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Sites GeoDNS (User-to-Edge Routing)https://wikitech.wikimedia.org/wiki/Global_traffic_routing#GeoDNS_(User-to-Edge_Routing) Edge routinghttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Edge_routing Cache-to-application routinghttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Cache-to-application_routing Frontend routinghttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Frontend_routing Backend routinghttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Backend_routing Managementhttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Management Disabling a Sitehttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Disabling_a_Site Hard enforcement of GeoDNS-disabled siteshttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#Hard_enforcement_of_GeoDNS-disabled_sites External linkshttps://wikitech.wikimedia.org/wiki/Global_traffic_routing#External_links https://wikitech.wikimedia.org/wiki/Hassaleh hassaleh is a virtual machine in Ganeti running debug_proxy for X-Wikimedia-Debug requests. See alsohttps://wikitech.wikimedia.org/wiki/Hassaleh#See_also https://wikitech.wikimedia.org/wiki/Hassium hassium is a virtual machine in Ganeti running debug_proxy for X-Wikimedia-Debug requests. See alsohttps://wikitech.wikimedia.org/wiki/Hassium#See_also https://wikitech.wikimedia.org/wiki/Ganeti01 Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Install2001 == Services == Serviceshttps://wikitech.wikimedia.org/wiki/Install2001#Services See alsohttps://wikitech.wikimedia.org/wiki/Install2001#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/03 === Week of March 7th === Week of March 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/03#Week_of_March_7th Week of March 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/03#Week_of_March_14th Week of March 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/03#Week_of_March_21st Week of March 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/03#Week_of_March_28th https://wikitech.wikimedia.org/wiki/ORES/Deployment This page is a guide on how to deploy new version of ORES into the server. Prepare the source codehttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Prepare_the_source_code PyPIhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#PyPI Update revscoring in PyPIhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Update_revscoring_in_PyPI Update modelshttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Update_models Update wheelshttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Update_wheels Merge the code and prepare to deployhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Merge_the_code_and_prepare_to_deploy Updating model repositorieshttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Updating_model_repositories Updating the ORES deploy repositoryhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Updating_the_ORES_deploy_repository Deploy to the test serverhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Deploy_to_the_test_server Beta (ores-beta.wmflabs.org)https://wikitech.wikimedia.org/wiki/ORES/Deployment#Beta_(ores-beta.wmflabs.org) Deploy to betahttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Deploy_to_beta Monitoringhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Monitoring Configurationhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Configuration Running testshttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Running_tests Deploy to productionhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Deploy_to_production Production cluster (ores.wikimedia.org)https://wikitech.wikimedia.org/wiki/ORES/Deployment#Production_cluster_(ores.wikimedia.org) In case of a production accidenthttps://wikitech.wikimedia.org/wiki/ORES/Deployment#In_case_of_a_production_accident Rollbackhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Rollback Disable the ORES extensionhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Disable_the_ORES_extension Monitorhttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Monitor Incident reporthttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Incident_report Unusual maintenance actionshttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Unusual_maintenance_actions Clear threshold cachehttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Clear_threshold_cache Restarting Redishttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Restarting_Redis Enabling ORES on a new wikihttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Enabling_ORES_on_a_new_wiki Puppet-managed config changeshttps://wikitech.wikimedia.org/wiki/ORES/Deployment#Puppet-managed_config_changes https://wikitech.wikimedia.org/wiki/Incidents/20160319-Ores == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160319-Ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160319-Ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160319-Ores#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160319-Ores#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Browser_general wmf.browser_general is an intermediate table that makes it easier and faster to get pageview statistics broken down by user-agent related dimensions like OS family, OS major, browser family, browser major, etc. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Browser_general#Current_Schema Loading of anonymized datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Browser_general#Loading_of_anonymized_data Example queryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Browser_general#Example_query Changes and known problems since 2016-03-21https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Browser_general#Changes_and_known_problems_since_2016-03-21 https://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF MediaWiki is the collaborative editing software that runs Wikipedia. This page documents its deployment at Wikimedia Foundation. Infrastructurehttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Infrastructure App servershttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#App_servers MediaWiki configurationhttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#MediaWiki_configuration Document roothttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Document_root Multiversionhttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Multiversion MediaWiki internalshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#MediaWiki_internals Static fileshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Static_files Application resourceshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Application_resources WMF resourceshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#WMF_resources Timeoutshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Timeouts Request timeoutshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Request_timeouts Backend timeoutshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Backend_timeouts Involved codebaseshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Involved_codebases Footnoteshttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Footnotes Pages in the MediaWiki production categoryhttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#Pages_in_the_MediaWiki_production_category See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_at_WMF#See_also https://wikitech.wikimedia.org/wiki/PAWS/Tools == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Background Quarryhttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Quarry PAWShttps://wikitech.wikimedia.org/wiki/PAWS/Tools#PAWS Escalationhttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Escalation Use caseshttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Use_cases User personashttps://wikitech.wikimedia.org/wiki/PAWS/Tools#User_personas Interactive bot operatorshttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Interactive_bot_operators Exploratory Researchhttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Exploratory_Research Things that currently run on Tools but don't need tohttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Things_that_currently_run_on_Tools_but_don't_need_to Timelinehttps://wikitech.wikimedia.org/wiki/PAWS/Tools#Timeline Apr - July 2016https://wikitech.wikimedia.org/wiki/PAWS/Tools#Apr_-_July_2016 https://wikitech.wikimedia.org/wiki/Shell_Request/Damiano64 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Services/MW-Vagrant [Vagrant] is a convenient way for developers to rapidly set up a development environment containing a MediaWiki instance and any needed dependencies in a virtualised environment. Your service needs to be present there as well. Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/Services/FirstDeployment This page describes how to deploy your first service. It does not cover how to sign up for an account, write code, engage in ongoing projects, or what to do after you've deployed your service. Repositorieshttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Repositories Source repo configurationhttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Source_repo_configuration Package.jsonhttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Package.json Dependencies propertyhttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Dependencies_property Other propertieshttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Other_properties Local git repositoryhttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Local_git_repository Deploy repo set-uphttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Deploy_repo_set-up Listing nodeshttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Listing_nodes Enabling the checker scripthttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Enabling_the_checker_script Dockerhttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Docker New service requesthttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#New_service_request Example requestshttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Example_requests Role and profile creationhttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Role_and_profile_creation Access rightshttps://wikitech.wikimedia.org/wiki/Services/FirstDeployment#Access_rights https://wikitech.wikimedia.org/wiki/Services/Deployment This page describes the legacy system for deploying services to the Wikimedia infrastructure. Currently, services are deployed to Kubernetes via the deployment pipeline. Regular Deploymenthttps://wikitech.wikimedia.org/wiki/Services/Deployment#Regular_Deployment Preparing the Deploy Repositoryhttps://wikitech.wikimedia.org/wiki/Services/Deployment#Preparing_the_Deploy_Repository BetaCluster Deploymenthttps://wikitech.wikimedia.org/wiki/Services/Deployment#BetaCluster_Deployment Deploying to Productionhttps://wikitech.wikimedia.org/wiki/Services/Deployment#Deploying_to_Production Dealing with Problemshttps://wikitech.wikimedia.org/wiki/Services/Deployment#Dealing_with_Problems Deployment Debugginghttps://wikitech.wikimedia.org/wiki/Services/Deployment#Deployment_Debugging Reverting a Deploymenthttps://wikitech.wikimedia.org/wiki/Services/Deployment#Reverting_a_Deployment Service Status Inspectionhttps://wikitech.wikimedia.org/wiki/Services/Deployment#Service_Status_Inspection https://wikitech.wikimedia.org/wiki/Services/Operation == Starting, Stopping, Restarting == Starting, Stopping, Restartinghttps://wikitech.wikimedia.org/wiki/Services/Operation#Starting,_Stopping,_Restarting Monitoringhttps://wikitech.wikimedia.org/wiki/Services/Operation#Monitoring Logshttps://wikitech.wikimedia.org/wiki/Services/Operation#Logs https://wikitech.wikimedia.org/wiki/Url-downloader url-downloader is a Squid non-caching proxy for HTTP requests. It was originally created for MediaWiki's upload-by-URL functionality, these days it is being used by any service that wants to access resources outside the boundaries of the wikimedia production realm. Servicehttps://wikitech.wikimedia.org/wiki/Url-downloader#Service See alsohttps://wikitech.wikimedia.org/wiki/Url-downloader#See_also https://wikitech.wikimedia.org/wiki/Shell_Request/Rdtf13191994 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/SonarQube SonarQube is an open platform to manage code quality. Why another tool? Isn't PHPLint, puppet-lint, unit test, ... enough?https://wikitech.wikimedia.org/wiki/SonarQube#Why_another_tool?_Isn't_PHPLint,_puppet-lint,_unit_test,_..._enough? Key Featureshttps://wikitech.wikimedia.org/wiki/SonarQube#Key_Features Improving Qualityhttps://wikitech.wikimedia.org/wiki/SonarQube#Improving_Quality Proof of Concepthttps://wikitech.wikimedia.org/wiki/SonarQube#Proof_of_Concept Analyzing Codehttps://wikitech.wikimedia.org/wiki/SonarQube#Analyzing_Code IDE integrationhttps://wikitech.wikimedia.org/wiki/SonarQube#IDE_integration Where do we go from here?https://wikitech.wikimedia.org/wiki/SonarQube#Where_do_we_go_from_here? https://wikitech.wikimedia.org/wiki/Bast2001 bast2001 was the main bastion for the Codfw cluster. It has been replaced by bast2002. Serviceshttps://wikitech.wikimedia.org/wiki/Bast2001#Services https://wikitech.wikimedia.org/wiki/Shell_Request/Nicko Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Iridium iridium ince upon a time ran phabricator. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Phabricatorhttps://wikitech.wikimedia.org/wiki/Category:Phabricator Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History The Analytics Data Lake (ADL) is a large, analytics-oriented repository of data, both raw and aggregated, about Wikimedia projects (in industry terms, a data lake). It currently includes data on pageviews and a beta set of historical data about editing, including revisions, pages, and users As the Data Lake matures, we will add any and all data that can be safely made public. Initial Scopehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Initial_Scope Consolidating Editing Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Consolidating_Editing_Data Hive Tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Hive_Tables Druidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Druid Analytics Query Service / Dumpshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Analytics_Query_Service_/_Dumps Pleasant Side Effectshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Pleasant_Side_Effects Project Documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Project_Documentation Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Architecture Systemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Systems Stackhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Stack History reconstructionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#History_reconstruction Data pipelinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Data_pipeline Schemashttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Schemas Optimizationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Optimizations Incremental datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Incremental_data Query data in Druidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Query_data_in_Druid Pivot sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Pivot_sample_queries Dumpshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Dumps Ongoing Workhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Ongoing_Work EventBushttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#EventBus Historical data sourcinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Historical_data_sourcing Details not to Forgethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Details_not_to_Forget Full Texthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Project_History#Full_Text https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mediawiki_api_request == event.mediawiki_api_request == event.mediawiki_api_requesthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mediawiki_api_request#event.mediawiki_api_request Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mediawiki_api_request#Schema wmf.action_*https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mediawiki_api_request#wmf.action_* https://wikitech.wikimedia.org/wiki/Incidents/20160407-Mediawiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160407-Mediawiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160407-Mediawiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160407-Mediawiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160407-Mediawiki#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Edomaur Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/News/Tools_Precise_deprecation Hosts running Ubuntu Precise (12.04) as an operating system were removed from the Toolforge infrastructure on 2017-03-14. Why did we do this?https://wikitech.wikimedia.org/wiki/News/Tools_Precise_deprecation#Why_did_we_do_this? What changed?https://wikitech.wikimedia.org/wiki/News/Tools_Precise_deprecation#What_changed? What should I do if my jobs or webservice are not running now?https://wikitech.wikimedia.org/wiki/News/Tools_Precise_deprecation#What_should_I_do_if_my_jobs_or_webservice_are_not_running_now? What are the primary changes with moving from Precise to Trusty?https://wikitech.wikimedia.org/wiki/News/Tools_Precise_deprecation#What_are_the_primary_changes_with_moving_from_Precise_to_Trusty? Useful linkshttps://wikitech.wikimedia.org/wiki/News/Tools_Precise_deprecation#Useful_links https://wikitech.wikimedia.org/wiki/Wikimedia_site_requests Wikimedia site requests are requests to configure a Wikimedia project. This page gives an overview of the process for volunteers handling them, and other concerned parties from operations side. Lifecycle of a requesthttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Lifecycle_of_a_request Prioritizationhttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Prioritization Common taskshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Common_tasks Disable throttling of account creations for an IP at eventshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Disable_throttling_of_account_creations_for_an_IP_at_events Change the translation of a namespacehttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_the_translation_of_a_namespace Change the linktrailhttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_the_linktrail Update the interwiki cachehttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Update_the_interwiki_cache Change local group rightshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_local_group_rights Change user groups and restriction levelshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_user_groups_and_restriction_levels Enable or disable extensions on a wikihttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Enable_or_disable_extensions_on_a_wiki Change import sourceshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_import_sources Convert digits (numbers) into a different scripthttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Convert_digits_(numbers)_into_a_different_script Remove a namespace from being indexed by internet search engineshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Remove_a_namespace_from_being_indexed_by_internet_search_engines Change the default timezone for a wikihttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_the_default_timezone_for_a_wiki Add additional letters to the special characters toolbarhttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Add_additional_letters_to_the_special_characters_toolbar Add a wiki to a dblisthttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Add_a_wiki_to_a_dblist Areas in the MediaWiki code base itselfhttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Areas_in_the_MediaWiki_code_base_itself Replacing deprecated functionshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Replacing_deprecated_functions Upgrading dev librarieshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Upgrading_dev_libraries Alphabetize stuffhttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Alphabetize_stuff Common tasks that need a maintenance scripthttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Common_tasks_that_need_a_maintenance_script Add a custom namespacehttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Add_a_custom_namespace Change a namespacehttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_a_namespace Change category collationhttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_category_collation Change the logo of a Wikimedia wikihttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Change_the_logo_of_a_Wikimedia_wiki Useful linkshttps://wikitech.wikimedia.org/wiki/Wikimedia_site_requests#Useful_links https://wikitech.wikimedia.org/wiki/Services/Scap_Migration All Node.JS should start using Scap3 as the deployment method as soon as possible. Puppet Patcheshttps://wikitech.wikimedia.org/wiki/Services/Scap_Migration#Puppet_Patches Deployment Repohttps://wikitech.wikimedia.org/wiki/Services/Scap_Migration#Deployment_Repo Deploymenthttps://wikitech.wikimedia.org/wiki/Services/Scap_Migration#Deployment https://wikitech.wikimedia.org/wiki/Shell_Request/Sebastian_Berlin_(WMSE) Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/04 === Week of April 4th === Week of April 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/04#Week_of_April_4th Week of April 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/04#Week_of_April_11th Week of April 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/04#Week_of_April_18th Week of April 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/04#Week_of_April_25th https://wikitech.wikimedia.org/wiki/Yubikey-2FA = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Yubikey-2FA#Overview Key creationhttps://wikitech.wikimedia.org/wiki/Yubikey-2FA#Key_creation Authentication servershttps://wikitech.wikimedia.org/wiki/Yubikey-2FA#Authentication_servers https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2 == Access Wikistats == Access Wikistatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Access_Wikistats About Wikistatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#About_Wikistats Design Processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Design_Process Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Architecture Local install for developmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Local_install_for_development Cloning the projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Cloning_the_project Third-party UI elementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Third-party_UI_elements Generating the bundlehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Generating_the_bundle Technologyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Technology Vue.jshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Vue.js State management and data flowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#State_management_and_data_flow Metric modelshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Metric_models Visualizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Visualization Localizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Localization Testshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Tests Contributing and Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Contributing_and_Deployment Git repohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Git_repo CRshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#CRs Smoke testshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Smoke_tests Adding languageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Adding_languages Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Deployment Testing in betahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Testing_in_beta Releasing a new version to productionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Releasing_a_new_version_to_production Supported browsershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Supported_browsers Subpages of this pagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2#Subpages_of_this_page https://wikitech.wikimedia.org/wiki/Stat1004 stat1004 is an Analytics Cluster client node for accessing Hadoop. Usagehttps://wikitech.wikimedia.org/wiki/Stat1004#Usage  See alsohttps://wikitech.wikimedia.org/wiki/Stat1004#_See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1004#Notes https://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Timeline Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Analysis Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Actionables RESTBase https://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#RESTBase ChangeProp servicehttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#ChangeProp_service Mobile Content Servicehttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Mobile_Content_Service Parsoidhttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Parsoid Alertshttps://wikitech.wikimedia.org/wiki/Incidents/20160505-ChangeProp_RESTBase_Parsoid#Alerts https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/05 === Week of May 2nd === Week of May 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/05#Week_of_May_2nd Week of May 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/05#Week_of_May_9th Week of May 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/05#Week_of_May_16th Week of May 23thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/05#Week_of_May_23th Week of May 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/05#Week_of_May_30th https://wikitech.wikimedia.org/wiki/Incidents/20160503-Wikidata-Query-Service == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160503-Wikidata-Query-Service#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160503-Wikidata-Query-Service#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160503-Wikidata-Query-Service#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160503-Wikidata-Query-Service#Actionables https://wikitech.wikimedia.org/wiki/Kraz kraz was a virtual machine in Ganeti. It runs on ganeti01 in codfw. Serviceshttps://wikitech.wikimedia.org/wiki/Kraz#Services https://wikitech.wikimedia.org/wiki/Incidents/20160509-CirrusSearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160509-CirrusSearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160509-CirrusSearch#Timeline Analysishttps://wikitech.wikimedia.org/wiki/Incidents/20160509-CirrusSearch#Analysis Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160509-CirrusSearch#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes [(often abbreviated k8s) is an open-source system for automating deployment, and management of applications running in containers]. Kubernetes was selected in 2015 by the Cloud Services team as the replacement for Grid Engine in the Toolforge project. Subpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Subpages About this documenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#About_this_document Tutorialhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Tutorial Access kubectlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Access_kubectl Manage podshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Manage_pods List podshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#List_pods View logs for podhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#View_logs_for_pod Restart a podhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Restart_a_pod Manage workershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Manage_workers Add a workerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Add_a_worker Remove a workerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Remove_a_worker Drain and undrain a nodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Drain_and_undrain_a_node How-tohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#How-to Cluster managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Cluster_management Build a new clusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Build_a_new_cluster Upgrade Kuberneteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Upgrade_Kubernetes Upgrade Calicohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Upgrade_Calico Upgrade ingress-nginxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Upgrade_ingress-nginx Upgrade worker operating systemhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Upgrade_worker_operating_system Roll reboot clusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Roll_reboot_cluster etcdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#etcd Add etcd nodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Add_etcd_node Remove etcd nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Remove_etcd_nodes Upgrade etcdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Upgrade_etcd Component systemhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Component_system Deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Deployment Manage (tool) usershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Manage_(tool)_users Modify quotashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Modify_quotas Regenerate .kube/confighttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Regenerate_.kube/config Enable observer accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Enable_observer_access Manage user workloadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Manage_user_workloads Find newly added workloadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Find_newly_added_workloads Pod tracinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Pod_tracing Update prebuilt imageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Update_prebuilt_images Referencehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Reference Admission controllershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Admission_controllers Authentication, authorization, certificates and RBAChttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Authentication,_authorization,_certificates_and_RBAC cert-managerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#cert-manager External certificateshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#External_certificates maintain-kubeusershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#maintain-kubeusers Observer accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Observer_access Backupshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Backups Bastion nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Bastion_nodes Kubernetes designhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Kubernetes_design Control planehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Control_plane API serverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#API_server controller-manager and schedulerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#controller-manager_and_scheduler Workerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Worker Labelshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Labels Monitoring and metricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Monitoring_and_metrics Alert runbookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Alert_runbooks Kubernetes metrics stackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Kubernetes_metrics_stack Prometheus integrationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Prometheus_integration Networkinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Networking Calicohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Calico DNShttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#DNS Ingresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Ingress HAProxy (external service access)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#HAProxy_(external_service_access) NFS and LDAPhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#NFS_and_LDAP Pod isolationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Pod_isolation Testing and local deploymentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Testing_and_local_deployments User workloadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#User_workloads Jobs frameworkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Jobs_framework Raw Kubernetes API usershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Raw_Kubernetes_API_users Build service buildshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Build_service_builds Worker typeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Worker_types Discussionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Discussion Bring-your-own-imagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Bring-your-own-image GitOps toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#GitOps_tools Puppethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Puppet Single cluster reliancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Single_cluster_reliance Referenceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#References https://wikitech.wikimedia.org/wiki/Shell_Request/Avik_Das Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20160512-LabsLdapOutage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160512-LabsLdapOutage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160512-LabsLdapOutage#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160512-LabsLdapOutage#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Slaporte Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Jermaineberkley Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Labs_TOU_Consultation_Round_1_(2016) https://wikitech.wikimedia.org/wiki/Opsen Opsen is a term that was historically used in various parts of the Wikimedia movement to refer to a group of Operations Engineers. SREs is a more commonly used term now that we call the folks who maintain servers and infrastructure Site Reliability Engineers (SRE) rather than Operations Engineers. https://wikitech.wikimedia.org/wiki/Fundraising/Queue_wrangling When a lot of adyen or amazon messages show up in the damaged queue with MISSING_PREDECESSOR, it's usually because they can't find matching pending queue messages. Here's how to recreate those from logs: https://wikitech.wikimedia.org/wiki/Incidents/20160525-Toollabs_Webservices == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160525-Toollabs_Webservices#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160525-Toollabs_Webservices#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160525-Toollabs_Webservices#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160525-Toollabs_Webservices#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/local_packages Created using PAWS and https://public-paws.wmcloud. https://wikitech.wikimedia.org/wiki/Augeas Augeas is a open source library and command line tool for editing configuration files. It is used in Wikimedia Puppet configuration in modules such as grub. Puppethttps://wikitech.wikimedia.org/wiki/Category:Puppet Softwarehttps://wikitech.wikimedia.org/wiki/Category:Software https://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels#Timeline 2016-05-19https://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels#2016-05-19 2016-05-29https://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels#2016-05-29 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160531-wikilabels#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/analytics.wikimedia.org analytics.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/analytics.wikimedia.org#Service Operationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/analytics.wikimedia.org#Operation Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/analytics.wikimedia.org#Deployment https://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Conclusions Reinforce the efficiency of deploy processhttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Reinforce_the_efficiency_of_deploy_process Regarding "infrastructure" config changeshttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Regarding_"infrastructure"_config_changes Allow better testing of config changes at development timehttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Allow_better_testing_of_config_changes_at_development_time Middle term: Prioritize QAhttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Middle_term:_Prioritize_QA Longer term: 1% production testinghttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Longer_term:_1%_production_testing On a more positive note: what workedhttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#On_a_more_positive_note:_what_worked Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Actionables Acknowledgementhttps://wikitech.wikimedia.org/wiki/Incidents/20160601-MediaWiki#Acknowledgement https://wikitech.wikimedia.org/wiki/Incidents/20160601-CentralNotice == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160601-CentralNotice#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160601-CentralNotice#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160601-CentralNotice#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160601-CentralNotice#Actionables https://wikitech.wikimedia.org/wiki/Status.wikimedia.org status.wikimedia. Service noteshttps://wikitech.wikimedia.org/wiki/Status.wikimedia.org#Service_notes See alsohttps://wikitech.wikimedia.org/wiki/Status.wikimedia.org#See_also https://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing == Developing a Plan == Developing a Planhttps://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#Developing_a_Plan Things to test before a major version upgradehttps://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#Things_to_test_before_a_major_version_upgrade Checklisthttps://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#Checklist Node.js driver and native protocol versionshttps://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#Node.js_driver_and_native_protocol_versions Past Upgradeshttps://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#Past_Upgrades 2.1.13 -to- 2.2.6https://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#2.1.13_-to-_2.2.6 RESTBasehttps://wikitech.wikimedia.org/wiki/Cassandra/Upgrades_and_testing#RESTBase https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29 == 2016-05-31 == 2016-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-31 2016-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-30 2016-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-29 2016-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-28 2016-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-27 2016-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-26 2016-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-25 2016-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-24 2016-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-23 2016-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-22 2016-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-21 2016-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-20 2016-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-19 2016-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-18 2016-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-17 2016-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-16 2016-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-15 2016-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-14 2016-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-13 2016-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-12 2016-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-11 2016-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-10 2016-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-09 2016-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-08 2016-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-07 2016-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-06 2016-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-05 2016-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-04 2016-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-03 2016-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-02 2016-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-05-01 2016-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-30 2016-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-29 2016-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-28 2016-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-27 2016-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-26 2016-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-25 2016-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-24 2016-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-23 2016-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-22 2016-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-21 2016-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-20 2016-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-19 2016-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-18 2016-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-17 2016-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-16 2016-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-15 2016-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-14 2016-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-13 2016-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-12 2016-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-11 2016-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-10 2016-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-09 2016-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-08 2016-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-07 2016-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-06 2016-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-05 2016-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-04 2016-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-03 2016-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-02 2016-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-04-01 2016-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-31 2016-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-30 2016-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-29 2016-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-28 2016-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-27 2016-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-26 2016-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-25 2016-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-24 2016-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-23 2016-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-22 2016-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-21 2016-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-20 2016-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-19 2016-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-18 2016-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-17 2016-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-16 2016-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-15 2016-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-14 2016-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-13 2016-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-12 2016-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-11 2016-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-10 2016-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-09 2016-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-08 2016-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-07 2016-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-06 2016-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-05 2016-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-04 2016-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-03 2016-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-02 2016-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-03-01 2016-02-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-29 2016-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-28 2016-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-27 2016-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-26 2016-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-25 2016-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-24 2016-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-23 2016-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-22 2016-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-21 2016-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-20 2016-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-19 2016-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-18 2016-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-17 2016-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-16 2016-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-15 2016-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-14 2016-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-13 2016-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-12 2016-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-11 2016-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-10 2016-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-09 2016-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-08 2016-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-07 2016-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-06 2016-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-05 2016-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-04 2016-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-03 2016-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-02 2016-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-02-01 2016-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-31 2016-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-30 2016-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-29 2016-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-28 2016-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-27 2016-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-26 2016-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-25 2016-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-24 2016-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-23 2016-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-22 2016-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-21 2016-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-20 2016-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-19 2016-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-18 2016-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-17 2016-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-16 2016-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-15 2016-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-14 2016-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-13 2016-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-12 2016-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-11 2016-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-10 2016-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-09 2016-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-08 2016-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-07 2016-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-06 2016-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-05 2016-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-04 2016-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-03 2016-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-02 2016-01-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_29#2016-01-01 https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase === Summary === Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#Timeline 2016-05-31T16:15https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-05-31T16:15 2016-05-31T17:15https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-05-31T17:15 2016-05-31T20:12https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-05-31T20:12 2016-05-31T21:16https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-05-31T21:16 2016-06-01T17:47https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-06-01T17:47 2016-06-01T20:00https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-06-01T20:00 2016-06-01T23:57https://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#2016-06-01T23:57 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#Actionables Footnoteshttps://wikitech.wikimedia.org/wiki/Incidents/20160531-RESTBase#Footnotes https://wikitech.wikimedia.org/wiki/Incidents/20160606-otrsmail == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160606-otrsmail#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160606-otrsmail#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160606-otrsmail#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160606-otrsmail#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160608-gallium-disk-failure This is an ongoing incident, page opened as a placeholder 09:27, 8 June 2016 (UTC) Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160608-gallium-disk-failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160608-gallium-disk-failure#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160608-gallium-disk-failure#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160608-gallium-disk-failure#Actionables Referenceshttps://wikitech.wikimedia.org/wiki/Incidents/20160608-gallium-disk-failure#References https://wikitech.wikimedia.org/wiki/Shell_Request/ProgrammingGen Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20160608-SCB == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160608-SCB#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160608-SCB#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160608-SCB#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160608-SCB#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160610-ORES This is a template for an Incident Report. Replace notes with your own description. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160610-ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160610-ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160610-ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160610-ORES#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/06 === Week of June 6th === Week of June 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/06#Week_of_June_6th Week of June 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/06#Week_of_June_13th Week of June 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/06#Week_of_June_20th Week of June 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/06#Week_of_June_27th https://wikitech.wikimedia.org/wiki/Shell_Request/Ani3011 Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Writing_an_extension_for_deployment https://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers Proxy browsers are web browsers which use their own proxy server to send an optimized version of the page to the browser. The best-known example is Opera Mini. Browser vs Proxy browser vs Remote browserhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#Browser_vs_Proxy_browser_vs_Remote_browser Proxy/Remote Browsershttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#Proxy/Remote_Browsers Opera Minihttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#Opera_Mini Documentationhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#Documentation User Agenthttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#User_Agent UC minihttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#UC_mini Chromehttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#Chrome Puffinhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Proxy_browsers#Puffin https://wikitech.wikimedia.org/wiki/Incidents/20160620-ores == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160620-ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160620-ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160620-ores#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160620-ores#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160623-etherpad Etherpad had a catastrophic and unrecoverable downtime. Recovering from it in a timely manner meant restoring a day old snapshot of the database. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160623-etherpad#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160623-etherpad#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160623-etherpad#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160623-etherpad#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling Category:Data platform Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems https://wikitech.wikimedia.org/wiki/TCP_Fast_Open == Metrics == Metricshttps://wikitech.wikimedia.org/wiki/TCP_Fast_Open#Metrics Detecting server-side TFO supporthttps://wikitech.wikimedia.org/wiki/TCP_Fast_Open#Detecting_server-side_TFO_support Python client using BSD socketshttps://wikitech.wikimedia.org/wiki/TCP_Fast_Open#Python_client_using_BSD_sockets CLI toolshttps://wikitech.wikimedia.org/wiki/TCP_Fast_Open#CLI_tools Server key generationhttps://wikitech.wikimedia.org/wiki/TCP_Fast_Open#Server_key_generation Referenceshttps://wikitech.wikimedia.org/wiki/TCP_Fast_Open#References https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength Session Length is a standard web metric that measures the time users engage with a site. In some instances long session lengths might be indicative of "successful" user interactions (games, social networks). Quick Reference for Session Length v1.0.0https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Quick_Reference_for_Session_Length_v1.0.0 Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Overview Requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Requirements Performancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Performance Data sizehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Data_size Tab browsinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Tab_browsing Session definitionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Session_definition Privacyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Privacy Methodologyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Methodology Tickshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Ticks Sessionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Sessions Examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Example Implementationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Implementation Instrumenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Instrument Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Schema Samplinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Sampling Raw datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Raw_data Intermediate datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Intermediate_data Sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Sample_queries Dashboardhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Dashboard Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Caveats Interrupted sessionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Interrupted_sessions Lost eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Lost_events JS disabledhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#JS_disabled Events by botshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Events_by_bots Tab Browsinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Tab_Browsing Passive event listener supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Passive_event_listener_support Ad blockershttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Ad_blockers Alternative ideashttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Alternative_ideas Device-aware methodhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Device-aware_method Stretch-based collectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/SessionLength#Stretch-based_collection https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/UserRetention == Retention== Retentionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/UserRetention#Retention Definition 1: The ratio of returning visitors to all visitors. Daily and Monthly.https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/UserRetention#Definition_1:_The_ratio_of_returning_visitors_to_all_visitors._Daily_and_Monthly. How to measure an increase in readers using retentionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/UserRetention#How_to_measure_an_increase_in_readers_using_retention Definition 2: The number of returning visitors (devices) after a month or a a dayhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/UserRetention#Definition_2:_The_number_of_returning_visitors_(devices)_after_a_month_or_a_a_day Definition 3: Average frequency of the returned visitorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/UserRetention#Definition_3:_Average_frequency_of_the_returned_visitors https://wikitech.wikimedia.org/wiki/Lead lead was the gerrit host from 2016-07-25 to 2016-10-07 and replaced ytterbium. Decomhttps://wikitech.wikimedia.org/wiki/Lead#Decom MXhttps://wikitech.wikimedia.org/wiki/Lead#MX https://wikitech.wikimedia.org/wiki/Incidents/20160628-wdqs Switching WDQS to Scap3 deployment caused some issue and a downtime of the service. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160628-wdqs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160628-wdqs#Timeline Noteshttps://wikitech.wikimedia.org/wiki/Incidents/20160628-wdqs#Notes Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160628-wdqs#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160628-wdqs#Actionables https://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide This page is a guide for migrating Trebuchet deployed services to Scap3. Migration checklisthttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#Migration_checklist Canary hosts and checkshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#Canary_hosts_and_checks Puppet Patcheshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#Puppet_Patches hieradata/common/role/deployment.yamlhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#hieradata/common/role/deployment.yaml hieradata/role/common/deployment_server.yamlhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#hieradata/role/common/deployment_server.yaml scap::targethttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#scap::target New Userhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#New_User Other considerationshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#Other_considerations Scap3 Configurationhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#Scap3_Configuration First Deploymenthttps://wikitech.wikimedia.org/wiki/Scap/Scap3_migration_guide#First_Deployment https://wikitech.wikimedia.org/wiki/Incidents/20160705-commons-replication == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160705-commons-replication#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160705-commons-replication#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160705-commons-replication#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160705-commons-replication#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Marysun Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Bare_Metal The concept of Cloud VPS 'bare metal' has taken on a life of its own and caused confusion in the tradition of Labs labs labs. This page attempts to explain some of the history behind it, and also state the current position of the Cloud Services team. Current statushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Bare_Metal#Current_status Historyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Bare_Metal#History Capabilities & Limitations of the Proof of Concepthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Bare_Metal#Capabilities_&_Limitations_of_the_Proof_of_Concept Things that could be confused with 'bare metal in Cloud VPS'https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Bare_Metal#Things_that_could_be_confused_with_'bare_metal_in_Cloud_VPS' https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge This page includes a list of all Labs projects containing instances as of July 6th, 2016. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#What_happens_when_a_project_is_not_marked_as_active Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#Projects_and_Instances account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#account-creation-assistance adminhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#admin analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#analytics authmanagerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#authmanager bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#bastion botshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#bots butterflyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#butterfly catgraphhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#catgraph catscorehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#catscore codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#codereview commonsarchivehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#commonsarchive commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#commtech contintcloudhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#contintcloud contributorshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#contributors - conventionextensionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#-_conventionextension cuoshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#cuos cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#cvn cvresearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#cvresearch cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#dashiki debdeployhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#debdeploy deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#deployment-prep designhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#design developer-dochttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#developer-doc discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#discourse discovery-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#discovery-stats dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#dwl editor-engagementhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#editor-engagement embed-sandboxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#embed-sandbox encryptallthethingshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#encryptallthethings etcdhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#etcd etherpadhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#etherpad eximhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#exim experimenthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#experiment extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#fastcci fatghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#fatg full-text-reference-toolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#full-text-reference-tool fundraisinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#fundraising gangliahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ganglia githttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#git glamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#glam globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#google-api-proxy grantreviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#grantreview graphitehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#graphite gsoc2014-fonttailor-demohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#gsoc2014-fonttailor-demo hhvmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#hhvm hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#huggle icingahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#icinga ifttthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ifttt integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#integration ircdhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ircd ircnotifierhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ircnotifier jupyterhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#jupyter languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#language In use, please keephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#In_use,_please_keep Purge pleasehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#Purge_please librarybasehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#librarybase lizenzhinweisgeneratorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#lizenzhinweisgenerator mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#maps maps-teamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#maps-team mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#math mdchttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mdc mdc-easthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mdc-east mdc-westhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mdc-west mediahandler-testshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mediahandler-tests mediawiki-core-teamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mediawiki-core-team mediawiki-dockerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mediawiki-docker mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mediawiki-vagrant mediawiki-verphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mediawiki-verp metamorphosishttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#metamorphosis mobilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mobile monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#monitoring multimediahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#multimedia mw-api-testinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mw-api-testing mw-extension-idshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mw-extension-ids mwfuzzhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mwfuzz mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mwoffliner mwreviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mwreview mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#mwv-apt netflowhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#netflow newsletterhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#newsletter nginxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#nginx nonfreewikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#nonfreewiki ocghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ocg ogvjs-integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ogvjs-integration opengrokhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#opengrok openidhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#openid openocrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#openocr openstackhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#openstack orchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#orch oreshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ores ores-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ores-staging osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#osmit otrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#otrs oxygenguidehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#oxygenguide packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#packaging pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#paws persistencehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#persistence petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#petscan phabricatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#phabricator phlogistonhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#phlogiston phragilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#phragile popcornhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#popcorn privpol-captchahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#privpol-captcha project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#project-proxy pubsubhubbubhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#pubsubhubbub puppethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#puppet puppet3-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#puppet3-diffs quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#quarry queryrapihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#queryrapi rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#rcm reading-web-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#reading-web-staging redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#redirects reportcardhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#reportcard safesandboxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#safesandbox - salthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#-_salt scrumbugzhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#scrumbugz searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#search security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#security-tools sentryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#sentry servermonhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#servermon serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#services services-testbedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#services-testbed shinkenhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#shinken shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#signwriting snugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#snuggle social-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#social-tools structured-wikiquotehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#structured-wikiquote sugarcrmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#sugarcrm swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#swift telnethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#telnet testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#testlabs tool-renewalhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#tool-renewal toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#toolsbeta toolserver-legacyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#toolserver-legacy ttmserverhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ttmserver twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#twl uploadwizard-osm-embeddinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#uploadwizard-osm-embedding utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#utrs varnishhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#varnish ve-languagetoolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#ve-languagetool videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#video visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#visualeditor wdq-mmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wdq-mm wikibrainhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikibrain wikidata-buildhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-build wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-dev wikidata-ldfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-ldf wikidata-metricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-metrics wikidata-qualityhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-quality wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-query wikidata-topicmapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidata-topicmaps wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikidumpparse wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikilabels wikimania-supporthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikimania-support wikimetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikimetrics wikisource-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikisource-dev wikisource-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikisource-tools wikispyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikispy wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikistats wikistreamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikistream wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikitextexp wikitolearn-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wikitolearn-dev wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wildcat wlmjudginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wlmjudging wlmjurytoolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wlmjurytool Needs assistance wmthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#Needs_assistance_wmt wmve-techteamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wmve-techteam wpxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#wpx xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#xtools yandex-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#yandex-proxy Communications Regardinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2016_Purge#Communications_Regarding https://wikitech.wikimedia.org/wiki/Incidents/20160706-CI-Outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160706-CI-Outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160706-CI-Outage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160706-CI-Outage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160706-CI-Outage#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160707-Echo == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160707-Echo#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160707-Echo#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160707-Echo#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160707-Echo#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/07 === Week of July 4th === Week of July 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/07#Week_of_July_4th Week of July 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/07#Week_of_July_11th Week of July 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/07#Week_of_July_18th Week of July 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/07#Week_of_July_25th https://wikitech.wikimedia.org/wiki/Backport_windows/Deployers This document is intended to provide detailed instructions for deployers as to how to run the backport windows. Hopefully, this document will prove useful to new deployers as well as provide a place for more experienced deployers to take notes on any tips and tricks they have discovered in the course of doing deployments. General advice before you starthttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#General_advice_before_you_start Deploying patches outside scheduled deployment windowshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Deploying_patches_outside_scheduled_deployment_windows SSH Connections and Error Logs: Set up before deployinghttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#SSH_Connections_and_Error_Logs:_Set_up_before_deploying Browser tabshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Browser_tabs Terminal tabshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Terminal_tabs Using scap backporthttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Using_scap_backport Merging and applying patcheshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Merging_and_applying_patches Merging patcheshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Merging_patches Fetching patcheshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Fetching_patches operations/mediawiki-confighttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#operations/mediawiki-config mediawiki/corehttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#mediawiki/core mediawiki/extensions and mediawiki/skinshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#mediawiki/extensions_and_mediawiki/skins Security Patcheshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Security_Patches Deploying changeshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Deploying_changes Canaryhttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Canary Full deploymenthttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Full_deployment Purginghttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Purging Verificationhttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Verification Revertinghttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Reverting Processhttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Process Manual reverthttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Manual_revert Maintenance scriptshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Maintenance_scripts tmux or screenhttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#tmux_or_screen Run a maintenance script on a group of wikishttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Run_a_maintenance_script_on_a_group_of_wikis Run a maintenance script on all wikishttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#Run_a_maintenance_script_on_all_wikis createExtensionTableshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#createExtensionTables namespaceDupeshttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#namespaceDupes updateCollationhttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#updateCollation resetAuthenticationThrottlehttps://wikitech.wikimedia.org/wiki/Backport_windows/Deployers#resetAuthenticationThrottle https://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160713-ContentTranslation == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160713-ContentTranslation#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160713-ContentTranslation#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160713-ContentTranslation#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160713-ContentTranslation#Actionables https://wikitech.wikimedia.org/wiki/MariaDB/misc == Technical examples and documentations contained in this page == Technical examples and documentations contained in this pagehttps://wikitech.wikimedia.org/wiki/MariaDB/misc#Technical_examples_and_documentations_contained_in_this_page Misc informationshttps://wikitech.wikimedia.org/wiki/MariaDB/misc#Misc_informations m1https://wikitech.wikimedia.org/wiki/MariaDB/misc#m1 Current schemashttps://wikitech.wikimedia.org/wiki/MariaDB/misc#Current_schemas Deleted/archived schemashttps://wikitech.wikimedia.org/wiki/MariaDB/misc#Deleted/archived_schemas m2https://wikitech.wikimedia.org/wiki/MariaDB/misc#m2 m3https://wikitech.wikimedia.org/wiki/MariaDB/misc#m3 Dropped schemashttps://wikitech.wikimedia.org/wiki/MariaDB/misc#Dropped_schemas m5https://wikitech.wikimedia.org/wiki/MariaDB/misc#m5 db_inventoryhttps://wikitech.wikimedia.org/wiki/MariaDB/misc#db_inventory https://wikitech.wikimedia.org/wiki/Incidents/20160713-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160713-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160713-MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160713-MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160713-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Mw1099 mw1099 used to be an debug appserver for mediawiki. See alsohttps://wikitech.wikimedia.org/wiki/Mw1099#See_also https://wikitech.wikimedia.org/wiki/Prometheus Prometheus is an open source software ecosystem for monitoring and alerting, with focus on reliability and simplicity. See also upstream's Prometheus overview and Prometheus FAQ. What is it?https://wikitech.wikimedia.org/wiki/Prometheus#What_is_it? Servicehttps://wikitech.wikimedia.org/wiki/Prometheus#Service Server locationhttps://wikitech.wikimedia.org/wiki/Prometheus#Server_location Instanceshttps://wikitech.wikimedia.org/wiki/Prometheus#Instances Federation and multiple DCshttps://wikitech.wikimedia.org/wiki/Prometheus#Federation_and_multiple_DCs Architecturehttps://wikitech.wikimedia.org/wiki/Prometheus#Architecture Exportershttps://wikitech.wikimedia.org/wiki/Prometheus#Exporters Storagehttps://wikitech.wikimedia.org/wiki/Prometheus#Storage High availabilityhttps://wikitech.wikimedia.org/wiki/Prometheus#High_availability Backupshttps://wikitech.wikimedia.org/wiki/Prometheus#Backups Failure recoveryhttps://wikitech.wikimedia.org/wiki/Prometheus#Failure_recovery Service Discoveryhttps://wikitech.wikimedia.org/wiki/Prometheus#Service_Discovery Relabel ruleshttps://wikitech.wikimedia.org/wiki/Prometheus#Relabel_rules Adding new metricshttps://wikitech.wikimedia.org/wiki/Prometheus#Adding_new_metrics Direct service instrumentationhttps://wikitech.wikimedia.org/wiki/Prometheus#Direct_service_instrumentation Service exportershttps://wikitech.wikimedia.org/wiki/Prometheus#Service_exporters Machine-level metricshttps://wikitech.wikimedia.org/wiki/Prometheus#Machine-level_metrics Ephemeral jobs (Pushgateway)https://wikitech.wikimedia.org/wiki/Prometheus#Ephemeral_jobs_(Pushgateway) Network probes (blackbox exporter)https://wikitech.wikimedia.org/wiki/Prometheus#Network_probes_(blackbox_exporter) Metrics from Logs (prometheus-es-exporter)https://wikitech.wikimedia.org/wiki/Prometheus#Metrics_from_Logs_(prometheus-es-exporter) Example usehttps://wikitech.wikimedia.org/wiki/Prometheus#Example_use Query cheatsheethttps://wikitech.wikimedia.org/wiki/Prometheus#Query_cheatsheet FAQhttps://wikitech.wikimedia.org/wiki/Prometheus#FAQ How long are metrics stored in Prometheus?https://wikitech.wikimedia.org/wiki/Prometheus#How_long_are_metrics_stored_in_Prometheus? What are the semantics of rate/irate/increase?https://wikitech.wikimedia.org/wiki/Prometheus#What_are_the_semantics_of_rate/irate/increase? What best practices should we use for label and metric naminghttps://wikitech.wikimedia.org/wiki/Prometheus#What_best_practices_should_we_use_for_label_and_metric_naming How do I test/preview relabeling rules?https://wikitech.wikimedia.org/wiki/Prometheus#How_do_I_test/preview_relabeling_rules? Replacing Graphitehttps://wikitech.wikimedia.org/wiki/Prometheus#Replacing_Graphite Statsdhttps://wikitech.wikimedia.org/wiki/Prometheus#Statsd Cassandrahttps://wikitech.wikimedia.org/wiki/Prometheus#Cassandra JMXhttps://wikitech.wikimedia.org/wiki/Prometheus#JMX List/inspect existing mbeanshttps://wikitech.wikimedia.org/wiki/Prometheus#List/inspect_existing_mbeans Grafana dashboardshttps://wikitech.wikimedia.org/wiki/Prometheus#Grafana_dashboards Replacing Watchmouse (CA DX APP)https://wikitech.wikimedia.org/wiki/Prometheus#Replacing_Watchmouse_(CA_DX_APP) Runbookshttps://wikitech.wikimedia.org/wiki/Prometheus#Runbooks Global view (Thanos) web interfacehttps://wikitech.wikimedia.org/wiki/Prometheus#Global_view_(Thanos)_web_interface Access Prometheus web interfacehttps://wikitech.wikimedia.org/wiki/Prometheus#Access_Prometheus_web_interface List metrics with curlhttps://wikitech.wikimedia.org/wiki/Prometheus#List_metrics_with_curl Aggregate metrics from multiple siteshttps://wikitech.wikimedia.org/wiki/Prometheus#Aggregate_metrics_from_multiple_sites Sync data from an existing Prometheus hosthttps://wikitech.wikimedia.org/wiki/Prometheus#Sync_data_from_an_existing_Prometheus_host Prometheus host running out of spacehttps://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_host_running_out_of_space No space available on the volume grouphttps://wikitech.wikimedia.org/wiki/Prometheus#No_space_available_on_the_volume_group Add filesystems for a new instancehttps://wikitech.wikimedia.org/wiki/Prometheus#Add_filesystems_for_a_new_instance Add metrics from a new servicehttps://wikitech.wikimedia.org/wiki/Prometheus#Add_metrics_from_a_new_service Stop queries on problematic instanceshttps://wikitech.wikimedia.org/wiki/Prometheus#Stop_queries_on_problematic_instances Prometheus was restartedhttps://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_was_restarted Configuration reload failurehttps://wikitech.wikimedia.org/wiki/Prometheus#Configuration_reload_failure Prometheus job unavailablehttps://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_job_unavailable Prometheus exporters "up" metrics unavailablehttps://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_exporters_"up"_metrics_unavailable Failover Prometheus Pushgatewayhttps://wikitech.wikimedia.org/wiki/Prometheus#Failover_Prometheus_Pushgateway Stale file for node-exporter textfilehttps://wikitech.wikimedia.org/wiki/Prometheus#Stale_file_for_node-exporter_textfile Pingthing Non-23xx HTTP responsehttps://wikitech.wikimedia.org/wiki/Prometheus#Pingthing_Non-23xx_HTTP_response Depool Prometheus for reads and writeshttps://wikitech.wikimedia.org/wiki/Prometheus#Depool_Prometheus_for_reads_and_writes https://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective == ACTIONS! == ACTIONS!https://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective#ACTIONS! What happenedhttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective#What_happened What went poorlyhttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective#What_went_poorly What went wellhttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective#What_went_well What still confuses ushttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective#What_still_confuses_us Pre-meeting noteshttps://wikitech.wikimedia.org/wiki/Incidents/20160712-EchoCentralAuth/Retrospective#Pre-meeting_notes https://wikitech.wikimedia.org/wiki/Shell_Request/UsmanKhan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker toolsadmin.wikimedia. Featureshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#Features Servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#Service Production deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#Production_deployment Testing deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#Testing_deployment Local developmenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#Local_development Contributinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#Contributing See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#See_also External linkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker#External_link https://wikitech.wikimedia.org/wiki/Shell_Request/Nasirkhan Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20160721-LocalRenameUserJob == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160721-LocalRenameUserJob#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160721-LocalRenameUserJob#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160721-LocalRenameUserJob#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160721-LocalRenameUserJob#Actionables https://wikitech.wikimedia.org/wiki/XKey The xkey Varnish module adds secondary hashes to objects, allowing fast purges of objects with the same key. Setting Object Keyshttps://wikitech.wikimedia.org/wiki/XKey#Setting_Object_Keys Scalinghttps://wikitech.wikimedia.org/wiki/XKey#Scaling Namespacing and Encodinghttps://wikitech.wikimedia.org/wiki/XKey#Namespacing_and_Encoding Exampleshttps://wikitech.wikimedia.org/wiki/XKey#Examples MediaWiki articlehttps://wikitech.wikimedia.org/wiki/XKey#MediaWiki_article cache_upload imageshttps://wikitech.wikimedia.org/wiki/XKey#cache_upload_images https://wikitech.wikimedia.org/wiki/Shell_Request/EDi8tor Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deploying_to_Beta_Cluster Before deploying any new feature to the Production Cluster, you should first deploy them to the Beta Cluster and test them there. https://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES#Timeline Short versionhttps://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES#Short_version Longer with contexthttps://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES#Longer_with_context Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160801-ORES#Actionables https://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#Overview Architecturehttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#Architecture Worker nodeshttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#Worker_nodes Monitor nodehttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#Monitor_node On the Dumps datastoreshttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#On_the_Dumps_datastores Codehttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#Code Programs usedhttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#Programs_used File layouthttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#File_layout ETOOMANYSCRIPTShttps://wikitech.wikimedia.org/wiki/Dumps/Current_Architecture#ETOOMANYSCRIPTS https://wikitech.wikimedia.org/wiki/ORES The ORES infrastructure is being deprecated in favor of Machine Learning/LiftWing, as described in [The Machine Learning team has the following high level timeline: Machine Learning contactshttps://wikitech.wikimedia.org/wiki/ORES#Machine_Learning_contacts Bot/tool ownershttps://wikitech.wikimedia.org/wiki/ORES#Bot/tool_owners Example: migrating a Bot from ORES to Lift Winghttps://wikitech.wikimedia.org/wiki/ORES#Example:_migrating_a_Bot_from_ORES_to_Lift_Wing Streams deprecationhttps://wikitech.wikimedia.org/wiki/ORES#Streams_deprecation Model deprecationhttps://wikitech.wikimedia.org/wiki/ORES#Model_deprecation Where can I find revscoring model binaries?https://wikitech.wikimedia.org/wiki/ORES#Where_can_I_find_revscoring_model_binaries? Guide to migrate from ORES to Lift Winghttps://wikitech.wikimedia.org/wiki/ORES#Guide_to_migrate_from_ORES_to_Lift_Wing Old ORES documentationhttps://wikitech.wikimedia.org/wiki/ORES#Old_ORES_documentation https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid Druid is an analytics data store, which WMF began to use in 2016, first for the Data Lake. It is comprised of many services, each of which is fully redundant. Why Druid. Value Propositionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Why_Druid._Value_Proposition Access to Druid data via Turnilohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Access_to_Druid_data_via_Turnilo Access to Druid data via Supersethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Access_to_Druid_data_via_Superset Access via command linehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Access_via_command_line Ingesting EventLogging datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Ingesting_EventLogging_data Druid Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Druid_Administration Send commands to Druidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Send_commands_to_Druid Naming conventionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Naming_convention Restart an Indexing jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Restart_an_Indexing_job Delete segmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Delete_segments Delete segments from deep storagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Delete_segments_from_deep_storage Preparation for deletionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Preparation_for_deletion Actual deletion of deep storage segmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Actual_deletion_of_deep_storage_segments Overlords Administration UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Overlords_Administration_UI Deletion controlhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Deletion_control Coordinators Administration UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Coordinators_Administration_UI Indexing Logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Indexing_Logs Safe restart of MiddleManagers when running Real time Indexing jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Safe_restart_of_MiddleManagers_when_running_Real_time_Indexing_jobs Full Restart of serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Full_Restart_of_services Removing hosts/ taking hosts out of service from clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Removing_hosts/_taking_hosts_out_of_service_from_cluster Handling alarms for unavailable segmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Handling_alarms_for_unavailable_segments Regular indexations through Airflowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Regular_indexations_through_Airflow One-off indexing data into Druidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#One-off_indexing_data_into_Druid Whyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Why The ingestion spechttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#The_ingestion_spec Format of your datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Format_of_your_data Segmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Segments Sending the indexation taskhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Sending_the_indexation_task POSTing your spechttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#POSTing_your_spec Monitoring the taskhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Monitoring_the_task Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Troubleshooting Realtime indexation to Druidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#Realtime_indexation_to_Druid See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid#See_also https://wikitech.wikimedia.org/wiki/Grafana.wikimedia.org/ores.json { https://wikitech.wikimedia.org/wiki/SessionService/Draft == Goals == Goalshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Goals Requirementshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Requirements Availability / Fault-tolerancehttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Availability_/_Fault-tolerance Consistencyhttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Consistency Session creation (logins)https://wikitech.wikimedia.org/wiki/SessionService/Draft#Session_creation_(logins) Session auto-creationshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Session_auto-creations Session readshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Session_reads Session timestamp updateshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Session_timestamp_updates Session deletion (logouts)https://wikitech.wikimedia.org/wiki/SessionService/Draft#Session_deletion_(logouts) Performancehttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Performance Operationshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Operations Staffing/expertisehttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Staffing/expertise Reliabilityhttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Reliability Total cost of ownershiphttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Total_cost_of_ownership Candidateshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Candidates MySQLhttps://wikitech.wikimedia.org/wiki/SessionService/Draft#MySQL Descriptionhttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Description Questionshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Questions Cassandrahttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Cassandra Footnoteshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Footnotes Glosssaryhttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Glosssary Read-your-write consistencyhttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Read-your-write_consistency Stale readshttps://wikitech.wikimedia.org/wiki/SessionService/Draft#Stale_reads https://wikitech.wikimedia.org/wiki/Incidents/20160809-MediaWiki TLDR: migration of 2 extensions to wfLoadExtension() resulted in problems, Logstash wasn't displaying them. Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160809-MediaWiki#Timeline Casualtieshttps://wikitech.wikimedia.org/wiki/Incidents/20160809-MediaWiki#Casualties Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160809-MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160809-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160805-LabsSecurityGroups This is a placeholder, soon to be populated with incident details. https://wikitech.wikimedia.org/wiki/Incidents/20160810-MediaWiki TL;DR VipsScaler extension converted to extension registration, which meant scaling configuration was merged, not overridden by WMF config. This meant Vips was being used to scale jpg etc, when it should have just been doing large tiff and png. Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160810-MediaWiki#Timeline Casualtieshttps://wikitech.wikimedia.org/wiki/Incidents/20160810-MediaWiki#Casualties Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160810-MediaWiki#Conclusions https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/08 === Week of August 1st === Week of August 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/08#Week_of_August_1st Week of August 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/08#Week_of_August_8th Week of August 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/08#Week_of_August_15th Week of August 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/08#Week_of_August_22nd Week of August 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/08#Week_of_August_29th https://wikitech.wikimedia.org/wiki/Incidents/20160807-CI == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160807-CI#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160807-CI#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160807-CI#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160807-CI#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Siege == Siege == Siegehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Siege#Siege Docshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Siege#Docs Getting startedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Siege#Getting_started Examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Siege#Example https://wikitech.wikimedia.org/wiki/Incidents/20160810-CI On August 10 most of CI crawled to a near halt starting at (roughly) noon pacific time. This is due to issues between Nodepool (which runs a large portion of the tests now) and our OpenStack infrastructure. TImelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160810-CI#TImeline Causeshttps://wikitech.wikimedia.org/wiki/Incidents/20160810-CI#Causes Findingshttps://wikitech.wikimedia.org/wiki/Incidents/20160810-CI#Findings Actions going forwardhttps://wikitech.wikimedia.org/wiki/Incidents/20160810-CI#Actions_going_forward https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cdsh cdsh is a simple wrapper for dsh. It allows you to define a single hierarchical configuration for remote command execution, by cluster, data-center, and rack. Projecthttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cdsh#Project Configurationhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cdsh#Configuration Usagehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cdsh#Usage Exampleshttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cdsh#Examples https://wikitech.wikimedia.org/wiki/Cassandra/Tools __TOC__ cassandra-tools-wmfhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#cassandra-tools-wmf c-cqlshhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#c-cqlsh Synopsishttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#Synopsis Descriptionhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#Description Examplehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#Example cqlsh-instancehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#cqlsh-instance c-any-nthttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#c-any-nt c-foreach-nthttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#c-foreach-nt c-foreach-restarthttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#c-foreach-restart c-lshttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#c-ls streamshttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#streams uyamlhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#uyaml cassandra-ca-managerhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#cassandra-ca-manager cdshhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools#cdsh https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pagecounts-ez This dataset is described on its dumps download page. One hour skewing issuehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pagecounts-ez#One_hour_skewing_issue See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pagecounts-ez#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews The public pageviews dataset has per-article and per-project view counts for all Wikimedia Foundation projects since May 2015. It filters out as many spiders and bots as we can detect. Contained datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Contained_data Disambiguating abbreviations ending in “.m”https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Disambiguating_abbreviations_ending_in_“.m” Differences to the pagecounts-raw datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Differences_to_the_pagecounts-raw_dataset Requests to the mobile site and requests from mobile devices or appshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Requests_to_the_mobile_site_and_requests_from_mobile_devices_or_apps Requests to the zero site and Wikipedia Zero requestshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Requests_to_the_zero_site_and_Wikipedia_Zero_requests Availabilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Availability dumps.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#dumps.wikimedia.org stat1007.eqiad.wmnethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#stat1007.eqiad.wmnet Analytics clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Analytics_cluster Events and known problems since 2015-05-01https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Events_and_known_problems_since_2015-05-01 Idiosyncrasieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Idiosyncrasies Capitalization is split uphttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Capitalization_is_split_up See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#See_also Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews#Notes https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting == Cassandra Info == Cassandra Infohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Cassandra_Info TL:DRhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#TL:DR Tests setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Tests_setup Graphshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Graphs Druid Infohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Druid_Info Load Testshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Load_Tests TL;DRhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#TL;DR Tests 1. 2016-08-16. Three months loaded. Compaction has finishedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Tests_1._2016-08-16._Three_months_loaded._Compaction_has_finished Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Results Detail datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Detail_data Tests 1. 2016-08-18. Four months loaded. Compaction is happening while testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Tests_1._2016-08-18._Four_months_loaded._Compaction_is_happening_while_testing Detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Details Tests 1. 2016-08-26. Seven months loaded. Compaction is happening while testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Tests_1._2016-08-26._Seven_months_loaded._Compaction_is_happening_while_testing Tests 2016-09-17. All data loaded, deployed fix for nulls to zero. No compaction happeninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Tests_2016-09-17._All_data_loaded,_deployed_fix_for_nulls_to_zero._No_compaction_happening Calibration. Performance Tests on Old Clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/LoadTesting#Calibration._Performance_Tests_on_Old_Cluster https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/20160804 = 2016-08-04 = 2016-08-04https://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/20160804#2016-08-04 Agendahttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/20160804#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Incident_documentation_meeting/20160804#Notes https://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations __TOC__ Advicehttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#Advice For all usershttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#For_all_users For users of Microsoft Windowshttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#For_users_of_Microsoft_Windows For users of Apple macOShttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#For_users_of_Apple_macOS For users of Apple iPhone, iPad, and iPodhttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#For_users_of_Apple_iPhone,_iPad,_and_iPod For users of Android deviceshttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#For_users_of_Android_devices For IT personnel that manage outbound Proxy applianceshttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#For_IT_personnel_that_manage_outbound_Proxy_appliances Noteshttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#Notes Referenceshttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#References See alsohttps://wikitech.wikimedia.org/wiki/HTTPS/Browser_Recommendations#See_also https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-ca-manager Easily manage Java keystores using a self-signed certificate authority. Projecthttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-ca-manager#Project Usagehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-ca-manager#Usage Step 1https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-ca-manager#Step_1 Step 2https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-ca-manager#Step_2 Step 3https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-ca-manager#Step_3 https://wikitech.wikimedia.org/wiki/Incidents/20160818-Elasticsearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160818-Elasticsearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160818-Elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160818-Elasticsearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160818-Elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160823-ToolsProxy == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160823-ToolsProxy#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160823-ToolsProxy#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160823-ToolsProxy#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160823-ToolsProxy#Actionables https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-metrics-collector {{Warning|content=This project is no longer in use, and is unmaintained (see: [running instances of Cassandra on the local machine, collects performance metrics (via JMX), and writes them to a remote [https://github.com/graphite-project/carbon Carbon server in a format compatible with the Dropwizard metrics GraphiteReporter. Projecthttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-metrics-collector#Project Usagehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-metrics-collector#Usage https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments Historic and planned scap3 deployments of Striker. 2020-09-09https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2020-09-09 2020-09-02https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2020-09-02 2019-07-18https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2019-07-18 2019-07-16https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2019-07-16 2019-03-28https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2019-03-28 2019-03-21https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2019-03-21 2018-08-02https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2018-08-02 2018-01-03https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2018-01-03 2017-10-05https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2017-10-05 2017-08-28https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2017-08-28 2017-08-23https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2017-08-23 2017-05-08https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2017-05-08 2017-01-25https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2017-01-25 2016-11-23https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-11-23 2016-09-08https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-09-08 2016-09-05https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-09-05 2016-09-01https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-09-01 2016-08-29https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-08-29 2016-08-26https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-08-26 2016-08-25https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Deployments#2016-08-25 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/FAQ Frequently (un)asked questions about using the Toolforge admin console. Configure Diffusion to mirror a GitHub repohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/FAQ#Configure_Diffusion_to_mirror_a_GitHub_repo Mirror a Diffusion repo to GitHubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/FAQ#Mirror_a_Diffusion_repo_to_GitHub https://wikitech.wikimedia.org/wiki/Incidents/20160829-ToolLabs-Outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160829-ToolLabs-Outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160829-ToolLabs-Outage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160829-ToolLabs-Outage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160829-ToolLabs-Outage#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160831-ulsfo == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160831-ulsfo#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160831-ulsfo#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160831-ulsfo#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160831-ulsfo#Actionables https://wikitech.wikimedia.org/wiki/Gerrit/Running_in_Cloud_VPS To get a Gerrit instance running on a Cloud VPS instance, first setup a DB backend, then the actual Gerrit server. (Or use the existing DB instance gerrit-mysql). Setting up MySQL (DB and db user)https://wikitech.wikimedia.org/wiki/Gerrit/Running_in_Cloud_VPS#Setting_up_MySQL_(DB_and_db_user) Setting up gerrithttps://wikitech.wikimedia.org/wiki/Gerrit/Running_in_Cloud_VPS#Setting_up_gerrit Noticeshttps://wikitech.wikimedia.org/wiki/Gerrit/Running_in_Cloud_VPS#Notices Related links and taskshttps://wikitech.wikimedia.org/wiki/Gerrit/Running_in_Cloud_VPS#Related_links_and_tasks https://wikitech.wikimedia.org/wiki/CDN/Hardware This is an overview of our currently deployed and active cache hardware at the Traffic layer. Hardware classeshttps://wikitech.wikimedia.org/wiki/CDN/Hardware#Hardware_classes Deployed hardwarehttps://wikitech.wikimedia.org/wiki/CDN/Hardware#Deployed_hardware https://wikitech.wikimedia.org/wiki/Incidents/20160907-Android == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160907-Android#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160907-Android#Timeline Discussionhttps://wikitech.wikimedia.org/wiki/Incidents/20160907-Android#Discussion Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160907-Android#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160907-Android#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Mlakshmipavani Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Debian_Glue Debian Glue is a project to facilitate easier Debian package building in Jenkins jobs. Debian Glue utilizes cowbuilder, which itself is a tool for building Debian packages inside a clean chroot. Distributionshttps://wikitech.wikimedia.org/wiki/Debian_Glue#Distributions Referenceshttps://wikitech.wikimedia.org/wiki/Debian_Glue#References https://wikitech.wikimedia.org/wiki/SystemTap SystemTap is a scripting language and tool to instrument production Linux systems. SystemTap scripts are compiled into loadable kernel modules and can instrument the execution of functions or statements in the kernel or user-space. Exampleshttps://wikitech.wikimedia.org/wiki/SystemTap#Examples Building and running SystemTap scriptshttps://wikitech.wikimedia.org/wiki/SystemTap#Building_and_running_SystemTap_scripts https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/09 === Week of September 5th === Week of September 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/09#Week_of_September_5th Week of September 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/09#Week_of_September_12th Week of September 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/09#Week_of_September_19th Week of September 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/09#Week_of_September_26th https://wikitech.wikimedia.org/wiki/Shell_Request/Void Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Incidents/20160915-MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160915-MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160915-MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160915-MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160915-MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20160918-Wikitech2fa == Timeline == Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160918-Wikitech2fa#Timeline Casualtieshttps://wikitech.wikimedia.org/wiki/Incidents/20160918-Wikitech2fa#Casualties Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160918-Wikitech2fa#Conclusions https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train Holding the deployment train is not something the Release Engineering team takes lightly. When RelEng holds a deployment train for a production error, we expect all engineers with relevant expertise to be focused on resolving the issue. Issues that hold the trainhttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Issues_that_hold_the_train Security issueshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Security_issues Data losshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Data_loss Major feature regressionshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Major_feature_regressions Performance regressionshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Performance_regressions Major stylistic problems affecting all pageshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Major_stylistic_problems_affecting_all_pages Error-rate increases (See #Logspam)https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Error-rate_increases_(See_#Logspam) Deprecationshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Deprecations Severity increases with server groups (usually)https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Severity_increases_with_server_groups_(usually) What happens during backport windows while the train is on hold?https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#What_happens_during_backport_windows_while_the_train_is_on_hold? What happens next?https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#What_happens_next? Train "blocker tasks"https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Train_"blocker_tasks" Blocking (sub) tasks types:https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Blocking_(sub)_tasks_types: Priority of blocking (sub) tasks:https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Priority_of_blocking_(sub)_tasks: Status of blocking (sub) tasks:https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Status_of_blocking_(sub)_tasks: Communication on blocking tasks:https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Communication_on_blocking_tasks: Maintaining the task series in Phabricator:https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Maintaining_the_task_series_in_Phabricator: Logspamhttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Logspam What it ishttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#What_it_is Why it's a problemhttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Why_it's_a_problem Major causes (and how you can fix them)https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Major_causes_(and_how_you_can_fix_them) Incorrectly categorized log messageshttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Incorrectly_categorized_log_messages Notice "Undefined variable", "Undefined index", or "Undefined offset"https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Notice_"Undefined_variable",_"Undefined_index",_or_"Undefined_offset" See alsohttps://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#See_also https://wikitech.wikimedia.org/wiki/Incidents/20160924-ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160924-ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160924-ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160924-ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160924-ORES#Actionables https://wikitech.wikimedia.org/wiki/Shell_Request/Maxeeder Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Gabrieloli Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test This page documents a load test performed on the Analytics' Pivot instance and the Druid cluster on 2016-09-29. Experimenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test#Experiment Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test#Results Edit History Testhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test#Edit_History_Test Pageviews Dailyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test#Pageviews_Daily Pageviews Hourlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test#Pageviews_Hourly Conclusionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Load_test#Conclusions https://wikitech.wikimedia.org/wiki/Incidents/20160925-ores == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20160925-ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20160925-ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20160925-ores#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20160925-ores#Actionables https://wikitech.wikimedia.org/wiki/Cassandra/TimeWindowCompactionStrategy }} Sourcehttps://wikitech.wikimedia.org/wiki/Cassandra/TimeWindowCompactionStrategy#Source Deploymenthttps://wikitech.wikimedia.org/wiki/Cassandra/TimeWindowCompactionStrategy#Deployment Updating the deploy repohttps://wikitech.wikimedia.org/wiki/Cassandra/TimeWindowCompactionStrategy#Updating_the_deploy_repo https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction This process is the second step of the Data Lake pipeline. Whyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction#Why Use caseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction#Use_cases Howhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction#How The blessing and the curse: The logging tablehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction#The_blessing_and_the_curse:_The_logging_table What does the algorithm do?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction#What_does_the_algorithm_do? Resulting data setshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction#Resulting_data_sets https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_page_history This page describes the data set that stores the page history of WMF's wikis. It lives in Analytic's Hadoop cluster and is accessible via the Hive/Beeline external table wmf. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_page_history#Schema FAQhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_page_history#FAQ Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_page_history#Changes_and_known_problems https://wikitech.wikimedia.org/wiki/Shell_Request/MichaelSchoenitzer Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/10 === Week of October 3rd === Week of October 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/10#Week_of_October_3rd Week of October 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/10#Week_of_October_10th Week of October 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/10#Week_of_October_17th Week of October 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/10#Week_of_October_24th Week of October 31sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/10#Week_of_October_31st https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_user_history This page describes the data set that stores the user history of WMF's wikis. It lives in Analytics Hadoop cluster and is accessible via the Hive external table wmf. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_user_history#Schema Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_user_history#Changes_and_known_problems https://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign#Summary Impacted Usershttps://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign#Impacted_Users Other Linkshttps://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign#Other_Links Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161013-GlobalSign#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm This page describes the history reconstruction algorithm, with the performance challenges the Analytics team had when developing it and the solutions they found. Technical contexthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#Technical_context The algorithmhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#The_algorithm Problemhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#Problem Performance optimizationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#Performance_optimizations 1. Fixed-pointhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#1._Fixed-point 2. "Backwards time-lining"https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#2._"Backwards_time-lining" 3. Subgraph partitioninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Page_and_user_history_reconstruction_algorithm#3._Subgraph_partitioning https://wikitech.wikimedia.org/wiki/MariaDB/ImportTableSpace This is a subpage of MariaDB section Importing table spaces from other hosts with multi source replicationhttps://wikitech.wikimedia.org/wiki/MariaDB/ImportTableSpace#Importing_table_spaces_from_other_hosts_with_multi_source_replication Transportable tablespaceshttps://wikitech.wikimedia.org/wiki/MariaDB/ImportTableSpace#Transportable_tablespaces Exporting the tablespaceshttps://wikitech.wikimedia.org/wiki/MariaDB/ImportTableSpace#Exporting_the_tablespaces Importing the tablespaceshttps://wikitech.wikimedia.org/wiki/MariaDB/ImportTableSpace#Importing_the_tablespaces Issues facedhttps://wikitech.wikimedia.org/wiki/MariaDB/ImportTableSpace#Issues_faced https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history This page describes the data set that stores the denormalized edit history of WMF's wikis. It lives in the Analytics Hadoop cluster and is accessible via the Hive table wmf. Public versionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history#Public_version Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history#Schema Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history#Changes_and_known_problems https://wikitech.wikimedia.org/wiki/JVM_Tuning These are some notes about JVM tuning, in particular memory and garbage collection settings for various services and clusters. Overviewhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Overview Why tune the garbage collectorhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Why_tune_the_garbage_collector How Garbage collection workshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#How_Garbage_collection_works Blindingly fast overview of Java garbage collectionhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Blindingly_fast_overview_of_Java_garbage_collection Parallel GC for minor gcshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Parallel_GC_for_minor_gcs CMS for minor gcshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#CMS_for_minor_gcs G1 for minor gcshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#G1_for_minor_gcs Parallel GC for full gcshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Parallel_GC_for_full_gcs CMS for full gcshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#CMS_for_full_gcs G1 for full gcshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#G1_for_full_gcs First tuning optionshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#First_tuning_options The --server optionhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#The_--server_option Ergonomics/MaxGCPauseMillishttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Ergonomics/MaxGCPauseMillis Things that go wronghttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Things_that_go_wrong Too few/too many minor gc cycleshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Too_few/too_many_minor_gc_cycles Too few/too many full gc cycleshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Too_few/too_many_full_gc_cycles YoungGen space too small/too largehttps://wikitech.wikimedia.org/wiki/JVM_Tuning#YoungGen_space_too_small/too_large OldGen space too small/too largehttps://wikitech.wikimedia.org/wiki/JVM_Tuning#OldGen_space_too_small/too_large PermGen space too smallhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#PermGen_space_too_small Young objects promoted too fast/too slowhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Young_objects_promoted_too_fast/too_slow Garbage collector options tablehttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Garbage_collector_options_table Our services relying on JVMshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Our_services_relying_on_JVMs Which GC does my JVM use?https://wikitech.wikimedia.org/wiki/JVM_Tuning#Which_GC_does_my_JVM_use? Garbage collection logginghttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Garbage_collection_logging Logging outputhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Logging_output Tuning heap sizehttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Tuning_heap_size How to understand how much heap your application needshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#How_to_understand_how_much_heap_your_application_needs Exampleshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Examples Too many full GC in a short timehttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Too_many_full_GC_in_a_short_time Setting max and min heap (-Xmx and -Xms)https://wikitech.wikimedia.org/wiki/JVM_Tuning#Setting_max_and_min_heap_(-Xmx_and_-Xms) Additional readinghttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Additional_reading Toolshttps://wikitech.wikimedia.org/wiki/JVM_Tuning#Tools TODOhttps://wikitech.wikimedia.org/wiki/JVM_Tuning#TODO https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Revision_augmentation_and_denormalization This process is the third step of the Data Lake pipeline. Main functionalities of this stephttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Revision_augmentation_and_denormalization#Main_functionalities_of_this_step Performance challengeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Revision_augmentation_and_denormalization#Performance_challenges Solutionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Revision_augmentation_and_denormalization#Solution https://wikitech.wikimedia.org/wiki/Incidents/20161021-Maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161021-Maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161021-Maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161021-Maps#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161021-Maps#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_data_loading This page describes the first step of the edit history reconstruction pipeline: the loading of MediaWiki data into Hadoop. This is done using a couple of scripts stored in the analytics-refinery-source repository. Sqooping datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_data_loading#Sqooping_data Sqooping wikis in groupshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_data_loading#Sqooping_wikis_in_groups Namespace mapping scripthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_data_loading#Namespace_mapping_script https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_serving_layer This is the last step of the edit history reconstruction pipeline. It is composed of a back end storing service optimized for fast analytical queries, and a front end UI that is connected to it and permits simple slice and dice operations on the data. Publicly availablehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_serving_layer#Publicly_available Internal to WMFhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_serving_layer#Internal_to_WMF Back endhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_serving_layer#Back_end Front endhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_serving_layer#Front_end https://wikitech.wikimedia.org/wiki/Snuggle Snuggle is a workflow tool for helping Wikipedian mentors find goodfaith newcomers to support in Wikipedia. User documentionhttps://wikitech.wikimedia.org/wiki/Snuggle#User_documention Codehttps://wikitech.wikimedia.org/wiki/Snuggle#Code Developmenthttps://wikitech.wikimedia.org/wiki/Snuggle#Development Deploymenthttps://wikitech.wikimedia.org/wiki/Snuggle#Deployment Orchestrationhttps://wikitech.wikimedia.org/wiki/Snuggle#Orchestration https://wikitech.wikimedia.org/wiki/Shell_Request/Nephron Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/11 === Week of November 7th === Week of November 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/11#Week_of_November_7th Week of November 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/11#Week_of_November_14th Week of November 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/11#Week_of_November_21st Week of November 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/11#Week_of_November_28th https://wikitech.wikimedia.org/wiki/Einsteinium einsteinium replaced neon Serviceshttps://wikitech.wikimedia.org/wiki/Einsteinium#Services Also seehttps://wikitech.wikimedia.org/wiki/Einsteinium#Also_see https://wikitech.wikimedia.org/wiki/Tegmen tegmen was the equivalent of einsteinium in codfw and together they replaced neon. tegmen has been replaced by icinga2001 Serviceshttps://wikitech.wikimedia.org/wiki/Tegmen#Services Also seehttps://wikitech.wikimedia.org/wiki/Tegmen#Also_see https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences This page is about conferences the Analytics team has interest in. Conferences we attendedhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences#Conferences_we_attended https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016 Luca Toscano and Joseph Allemandou attended to that conference for the analytics team. Talk we attendedhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Talk_we_attended Day 1https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Day_1 Keynoteshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Keynotes Flinkhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Flink The Apache wayhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#The_Apache_way Session 1: GearPumphttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_1:_GearPump Session 2: Hive optimisations in 2.Xhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_2:_Hive_optimisations_in_2.X Session 3: Real time @ Uberhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_3:_Real_time_@_Uber Session 4: Planetary datasethttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_4:_Planetary_dataset Session 5: Hive + Druid integration using Calcitehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_5:_Hive_+_Druid_integration_using_Calcite Day 2https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Day_2 Hadoop @ Uberhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Hadoop_@_Uber ASF Big Tenthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#ASF_Big_Tent Session 1 - Hbasehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_1_-_Hbase Session 2 - Calcite adapter devhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_2_-_Calcite_adapter_dev session 3 - Data science - 50 yearshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#session_3_-_Data_science_-_50_years session 4 - Contributing to Sparkhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#session_4_-_Contributing_to_Spark Session 5 - Apache Bahirhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_5_-_Apache_Bahir Day 3https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Day_3 TensorFlowhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#TensorFlow Hadoop lessons learnthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Hadoop_lessons_learnt Session 1 - Beamhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_1_-_Beam Session 2 - Kuduhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_2_-_Kudu Session 3 - Parquet in detailshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Session_3_-_Parquet_in_details Ideas and discussionshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Ideas_and_discussions Kafkahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Kafka Hadoophttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Hadoop Sparkhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Spark Infrastructure in generalhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Infrastructure_in_general Interesting companieshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Interesting_companies Streaminghttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Streaming Federated SQL query servicehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Conferences/Apache_Big_Data_Europe_-_November_2016#Federated_SQL_query_service https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30 == 2016-08-31 == 2016-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-31 2016-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-30 2016-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-29 2016-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-28 2016-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-27 2016-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-26 2016-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-25 2016-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-24 2016-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-23 2016-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-22 2016-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-21 2016-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-20 2016-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-19 2016-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-18 2016-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-17 2016-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-16 2016-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-15 2016-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-14 2016-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-13 2016-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-12 2016-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-11 2016-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-10 2016-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-09 2016-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-08 2016-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-07 2016-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-06 2016-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-05 2016-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-04 2016-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-03 2016-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-02 2016-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-08-01 2016-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-31 2016-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-30 2016-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-29 2016-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-28 2016-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-27 2016-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-26 2016-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-25 2016-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-24 2016-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-23 2016-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-22 2016-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-21 2016-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-20 2016-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-19 2016-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-18 2016-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-17 2016-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-16 2016-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-15 2016-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-14 2016-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-13 2016-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-12 2016-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-11 2016-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-10 2016-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-09 2016-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-08 2016-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-07 2016-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-06 2016-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-05 2016-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-04 2016-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-03 2016-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-02 2016-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-07-01 2016-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-30 2016-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-29 2016-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-28 2016-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-27 2016-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-26 2016-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-25 2016-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-24 2016-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-23 2016-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-22 2016-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-21 2016-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-20 2016-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-19 2016-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-18 2016-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-17 2016-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-16 2016-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-15 2016-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-14 2016-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-13 2016-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-12 2016-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-11 2016-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-10 2016-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-09 2016-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-08 2016-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-07 2016-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-06 2016-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-05 2016-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-04 2016-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-03 2016-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-02 2016-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_30#2016-06-01 https://wikitech.wikimedia.org/wiki/Shell_Request/Arian_Writing Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/ORES/Update_grafana_repo In order to update the grafana dashboard repo, once you made your changes in grafana.wikimedia. https://wikitech.wikimedia.org/wiki/Shell_Request/AnnaSmo Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Shell_Request/Schach Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration == How to restart Oozie production jobs == How to restart Oozie production jobshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#How_to_restart_Oozie_production_jobs Job Restart Checklisthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#Job_Restart_Checklist When .properties file has changedhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#When_.properties_file_has_changed Gotchas when restarting webrequest_load bundlehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#Gotchas_when_restarting_webrequest_load_bundle If .properties file has not changed - Generic re-starthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#If_.properties_file_has_not_changed_-_Generic_re-start Individual job restarthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#Individual_job_restart Refinery full restarthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#Refinery_full_restart If nothing changed, a job just failed in production - Simple re-starthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#If_nothing_changed,_a_job_just_failed_in_production_-_Simple_re-start Hard killing a workflowhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Oozie/Administration#Hard_killing_a_workflow https://wikitech.wikimedia.org/wiki/Incidents/20161127-API == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161127-API#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161127-API#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161127-API#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161127-API#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage The goal of this document is to describe the use cases for the raw IP data stored on the webrequest data set for 60 days. Use cases are documented per team. Surveyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Survey Questionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Questions Teamshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Teams Analyticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Analytics Discoveryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Discovery Editinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Editing Legalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Legal Researchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Research Technical operationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Technical_operations Zerohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/RawIPUsage#Zero https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/EventStreams The Main EventStreams documentation page is at Event_Platform/EventStreams RCStream Deprecationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/EventStreams#RCStream_Deprecation Meetingshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/EventStreams#Meetings 2016-11-30. RCStream deprecation and Ownershiphttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/EventStreams#2016-11-30._RCStream_deprecation_and_Ownership https://wikitech.wikimedia.org/wiki/Analytics/Archive/Wikistats2.0/Design Data about how humans collaborate. Loads of it. Data on wikistats right nowhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Wikistats2.0/Design#Data_on_wikistats_right_now https://wikitech.wikimedia.org/wiki/Analytics/Archive/Wikistats2.0/Design# https://wikitech.wikimedia.org/wiki/Incidents/20161202-20161201-PageImages == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161202-20161201-PageImages#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161202-20161201-PageImages#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161202-20161201-PageImages#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161202-20161201-PageImages#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20161204-labservices1001 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161204-labservices1001#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161204-labservices1001#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161204-labservices1001#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161204-labservices1001#Actionables https://wikitech.wikimedia.org/wiki/Event* EventBlabla what?! So Many Event* services. Event Platformhttps://wikitech.wikimedia.org/wiki/Event*#Event_Platform Metrics Platformhttps://wikitech.wikimedia.org/wiki/Event*#Metrics_Platform EventBushttps://wikitech.wikimedia.org/wiki/Event*#EventBus EventBus Mediawiki extensionhttps://wikitech.wikimedia.org/wiki/Event*#EventBus_Mediawiki_extension Event Schema Repositories and HTTP Servicehttps://wikitech.wikimedia.org/wiki/Event*#Event_Schema_Repositories_and_HTTP_Service EventGate (repository)https://wikitech.wikimedia.org/wiki/Event*#EventGate_(repository) EventStreamConfighttps://wikitech.wikimedia.org/wiki/Event*#EventStreamConfig EventStreams (repository)https://wikitech.wikimedia.org/wiki/Event*#EventStreams_(repository) EventLogginghttps://wikitech.wikimedia.org/wiki/Event*#EventLogging EventLogging Extensionhttps://wikitech.wikimedia.org/wiki/Event*#EventLogging_Extension EventLogging Servicehttps://wikitech.wikimedia.org/wiki/Event*#EventLogging_Service EventLogging Schemashttps://wikitech.wikimedia.org/wiki/Event*#EventLogging_Schemas https://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial {{notice|Please help improve the docs by reviewing and updating this tutorial! See [Dashiki hasn't been maintained in a while, and therefore only builds with Node version 6. Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Overview Supported data sourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Supported_data_sources Supported layouts and visualizationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Supported_layouts_and_visualizations Necessary knowledgehttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Necessary_knowledge Tools usedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Tools_used Work time and calendar time expectationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Work_time_and_calendar_time_expectation Example dashboardshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Example_dashboards Step by stephttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Step_by_step Generating reportshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Generating_reports Adapt your SQL queries to reportupdater's conventionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Adapt_your_SQL_queries_to_reportupdater's_conventions Write the configuration for your reportshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Write_the_configuration_for_your_reports Test locallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Test_locally Deploy reportupdater jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Deploy_reportupdater_job Generating visualizationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Generating_visualizations Write the configuration for your dashboardhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Write_the_configuration_for_your_dashboard Config for the tabs layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Config_for_the_tabs_layout Config for the metrics-by-project layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Config_for_the_metrics-by-project_layout Config for the compare layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Config_for_the_compare_layout Deploy your dashboardhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Deploy_your_dashboard Supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Dashboard_tutorial#Support https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/12 === Week of December 5th === Week of December 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/12#Week_of_December_5th Week of December 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/12#Week_of_December_12th Week of December 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/12#Week_of_December_19th Week of December 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/12#Week_of_December_26th https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Metrics This table stores daily and monthly metrics computed over the denormalized mediawiki history dataset. It is partitioned by wiki_db and metric name to facilitate using its data outside of Hive, namely for display in Dashiki. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Metrics#Schema Definitionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Metrics#Definition https://wikitech.wikimedia.org/wiki/Netconsole == What is netconsole? What is it used for? What is netconsole? What is it used for?https://wikitech.wikimedia.org/wiki/Netconsole#What_is_netconsole?_What_is_it_used_for? Production setuphttps://wikitech.wikimedia.org/wiki/Netconsole#Production_setup Manual setuphttps://wikitech.wikimedia.org/wiki/Netconsole#Manual_setup How can I test if it is working:https://wikitech.wikimedia.org/wiki/Netconsole#How_can_I_test_if_it_is_working: https://wikitech.wikimedia.org/wiki/Incidents/20161221-ToollabsKubernetesAPI A non-user affecting Kubernetes API downtime lasting about 1hour Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161221-ToollabsKubernetesAPI#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161221-ToollabsKubernetesAPI#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161221-ToollabsKubernetesAPI#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161221-ToollabsKubernetesAPI#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Varnishkafka [is a daemon that runs on all the Wikimedia frontend caching hosts. Since Varnish logs HTTP requests in its own format in shared memory, Varnishkafka uses the Varnish Log API to read data, format it following some user input and finally send the result to a specific Kafka topic (using [https://github. Testing a code changehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Varnishkafka#Testing_a_code_change Varnishkafka instanceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Varnishkafka#Varnishkafka_instances Monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Varnishkafka#Monitoring Delivery errorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Varnishkafka#Delivery_errors No Messages Deliveredhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Varnishkafka#No_Messages_Delivered https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017#By_month https://wikitech.wikimedia.org/wiki/HAProxy HAProxy is a mature and relatively simple proxy for L3/L4 (TCP/IP) and L7 (HTTP/HTTPS) traffic. We sometimes use it in different parts of our infrastructure as either a TLS terminator, load balancer, or automatic switchover handler. HAProxy for edge cachinghttps://wikitech.wikimedia.org/wiki/HAProxy#HAProxy_for_edge_caching Session state at disconnectionhttps://wikitech.wikimedia.org/wiki/HAProxy#Session_state_at_disconnection Silent-drophttps://wikitech.wikimedia.org/wiki/HAProxy#Silent-drop HAProxy for MariaDBhttps://wikitech.wikimedia.org/wiki/HAProxy#HAProxy_for_MariaDB Find out if a proxy is being actively usedhttps://wikitech.wikimedia.org/wiki/HAProxy#Find_out_if_a_proxy_is_being_actively_used Failoverhttps://wikitech.wikimedia.org/wiki/HAProxy#Failover Reloading configurationhttps://wikitech.wikimedia.org/wiki/HAProxy#Reloading_configuration Other interesting commandshttps://wikitech.wikimedia.org/wiki/HAProxy#Other_interesting_commands External linkshttps://wikitech.wikimedia.org/wiki/HAProxy#External_links https://wikitech.wikimedia.org/wiki/Incidents/20161227-ores == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161227-ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161227-ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161227-ores#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161227-ores#Actionables https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service EventStreams is a web service that exposes continuous streams of structured event data. It does so over HTTP using chunked transfer encoding following the Server-Sent Events protocol (SSE). Streamshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Streams When not to use EventStreamshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#When_not_to_use_EventStreams Exampleshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Examples Web browserhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Web_browser JavaScripthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#JavaScript Node.js ESM (with wikimedia-streams)https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Node.js_ESM_(with_wikimedia-streams) Node.js (with eventsource)https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Node.js_(with_eventsource) TypeScripthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#TypeScript Node.js (with wikimedia-streams)https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Node.js_(with_wikimedia-streams) Pythonhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Python Command-linehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Command-line APIhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#API Stream selectionhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Stream_selection Historical Consumptionhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Historical_Consumption Response Formathttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Response_Format Canary Eventshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Canary_Events Filteringhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Filtering Architecturehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Architecture SSE vs. WebSockets/Socket.IOhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#SSE_vs._WebSockets/Socket.IO KafkaSSEhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#KafkaSSE Kafkahttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Kafka Noteshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Notes Server side enforced timeouthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Server_side_enforced_timeout See alsohttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#See_also Further readinghttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#Further_reading External linkshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams_HTTP_Service#External_links https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration See EventStreams for an overview of the EventStreams service. Configurationhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Configuration Kafkahttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Kafka NodeJS Kafka Clienthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#NodeJS_Kafka_Client Repositorieshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Repositories Deploymenthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Deployment Submitting changeshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Submitting_changes Change to KafkaSSE libraryhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Change_to_KafkaSSE_library Change to mediawiki/services/eventstreams repositoryhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Change_to_mediawiki/services/eventstreams_repository Update operations/deployment-charts repositoryhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Update_operations/deployment-charts_repository Deployhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Deploy Logshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Logs Metricshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Metrics Throughput limitshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Throughput_limits Alertshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Alerts Incidentshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration#Incidents https://wikitech.wikimedia.org/wiki/Incidents/2017-01-04_MonologSpi == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-04_MonologSpi#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-04_MonologSpi#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-04_MonologSpi#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-04_MonologSpi#Actionables https://wikitech.wikimedia.org/wiki/Cumin Cumin is a cluster automation and orchestration framework written in Python. Resourceshttps://wikitech.wikimedia.org/wiki/Cumin#Resources Featureshttps://wikitech.wikimedia.org/wiki/Cumin#Features Host selectionhttps://wikitech.wikimedia.org/wiki/Cumin#Host_selection PuppetDB host selectionhttps://wikitech.wikimedia.org/wiki/Cumin#PuppetDB_host_selection OpenStack backendhttps://wikitech.wikimedia.org/wiki/Cumin#OpenStack_backend SSH Known Hosts files backendhttps://wikitech.wikimedia.org/wiki/Cumin#SSH_Known_Hosts_files_backend Direct backendhttps://wikitech.wikimedia.org/wiki/Cumin#Direct_backend HostFile backend (Enabled only in Cloud VPS)https://wikitech.wikimedia.org/wiki/Cumin#HostFile_backend_(Enabled_only_in_Cloud_VPS) Global grammar host selectionhttps://wikitech.wikimedia.org/wiki/Cumin#Global_grammar_host_selection Host list manipulationhttps://wikitech.wikimedia.org/wiki/Cumin#Host_list_manipulation Command executionhttps://wikitech.wikimedia.org/wiki/Cumin#Command_execution Output handlinghttps://wikitech.wikimedia.org/wiki/Cumin#Output_handling WMF installationhttps://wikitech.wikimedia.org/wiki/Cumin#WMF_installation Production infrastructurehttps://wikitech.wikimedia.org/wiki/Cumin#Production_infrastructure Rootless production infrastructurehttps://wikitech.wikimedia.org/wiki/Cumin#Rootless_production_infrastructure NODE GROUPhttps://wikitech.wikimedia.org/wiki/Cumin#NODE_GROUP https://wikitech.wikimedia.org/wiki/Cumin# Making hosts manageable with rootless Cuminhttps://wikitech.wikimedia.org/wiki/Cumin#Making_hosts_manageable_with_rootless_Cumin WMCS Cloud VPS infrastructurehttps://wikitech.wikimedia.org/wiki/Cumin#WMCS_Cloud_VPS_infrastructure WMCS Cloud VPS single project installationhttps://wikitech.wikimedia.org/wiki/Cumin#WMCS_Cloud_VPS_single_project_installation Cumin CLI examples in the WMF production infrastructurehttps://wikitech.wikimedia.org/wiki/Cumin#Cumin_CLI_examples_in_the_WMF_production_infrastructure Run Puppet discarding the outputhttps://wikitech.wikimedia.org/wiki/Cumin#Run_Puppet_discarding_the_output NO OUTPUThttps://wikitech.wikimedia.org/wiki/Cumin#NO_OUTPUT Run Puppet keeping the outputhttps://wikitech.wikimedia.org/wiki/Cumin#Run_Puppet_keeping_the_output Disable Puppethttps://wikitech.wikimedia.org/wiki/Cumin#Disable_Puppet Enable Puppethttps://wikitech.wikimedia.org/wiki/Cumin#Enable_Puppet Run Puppet only if last run failedhttps://wikitech.wikimedia.org/wiki/Cumin#Run_Puppet_only_if_last_run_failed Check if systemd service is runninghttps://wikitech.wikimedia.org/wiki/Cumin#Check_if_systemd_service_is_running Reboothttps://wikitech.wikimedia.org/wiki/Cumin#Reboot Check TLS certificatehttps://wikitech.wikimedia.org/wiki/Cumin#Check_TLS_certificate Check TLS private keyhttps://wikitech.wikimedia.org/wiki/Cumin#Check_TLS_private_key Check MySQL semi-sync replication statushttps://wikitech.wikimedia.org/wiki/Cumin#Check_MySQL_semi-sync_replication_status Upgrade Debian packageshttps://wikitech.wikimedia.org/wiki/Cumin#Upgrade_Debian_packages Check EtcdConfig for MediaWiki hostshttps://wikitech.wikimedia.org/wiki/Cumin#Check_EtcdConfig_for_MediaWiki_hosts Target all hosts running Stretchhttps://wikitech.wikimedia.org/wiki/Cumin#Target_all_hosts_running_Stretch Troubleshooting Production issueshttps://wikitech.wikimedia.org/wiki/Cumin#Troubleshooting_Production_issues Logshttps://wikitech.wikimedia.org/wiki/Cumin#Logs PuppetDB is downhttps://wikitech.wikimedia.org/wiki/Cumin#PuppetDB_is_down Sudo is brokenhttps://wikitech.wikimedia.org/wiki/Cumin#Sudo_is_broken How to contribute to Cuminhttps://wikitech.wikimedia.org/wiki/Cumin#How_to_contribute_to_Cumin Did you find a bug?https://wikitech.wikimedia.org/wiki/Cumin#Did_you_find_a_bug? Contributing to the codehttps://wikitech.wikimedia.org/wiki/Cumin#Contributing_to_the_code See alsohttps://wikitech.wikimedia.org/wiki/Cumin#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-01-06_Cache-upload From 16:08 to 18:11 UTC on Friday, 06 January 2017 several requests for images Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-06_Cache-upload#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-06_Cache-upload#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-06_Cache-upload#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-01-11_multiversion == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-11_multiversion#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-11_multiversion#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-11_multiversion#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-11_multiversion#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/01 === Week of January 2nd === Week of January 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/01#Week_of_January_2nd Week of January 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/01#Week_of_January_9th Week of January 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/01#Week_of_January_16th Week of January 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/01#Week_of_January_23rd Week of January 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/01#Week_of_January_30th https://wikitech.wikimedia.org/wiki/Cassandra/PrometheusJmxExporter The Prometheus JMX Exporter is a JVM agent that creates an HTTP listener to export MBean metrics for Prometheus. Sourcehttps://wikitech.wikimedia.org/wiki/Cassandra/PrometheusJmxExporter#Source Deploymenthttps://wikitech.wikimedia.org/wiki/Cassandra/PrometheusJmxExporter#Deployment Updating the deploy repohttps://wikitech.wikimedia.org/wiki/Cassandra/PrometheusJmxExporter#Updating_the_deploy_repo https://wikitech.wikimedia.org/wiki/Puppet-ecdsacert It is now possible to generate general-purpose ECDSA certificates using our internal puppet CA and then use those for serving HTTPS traffic internally. Use in labs with non-central puppetmastershttps://wikitech.wikimedia.org/wiki/Puppet-ecdsacert#Use_in_labs_with_non-central_puppetmasters See alsohttps://wikitech.wikimedia.org/wiki/Puppet-ecdsacert#See_also https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server Apache Traffic Server, aka ATS, is a caching HTTP proxy used as the backend (on-disk) component of Wikimedia's CDN. In-memory, ephemeral caching is done by cache frontends running Varnish. Architecturehttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Architecture Terminologyhttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Terminology Configurationhttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Configuration Load balancinghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Load_balancing Logginghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Logging Cache inspectorhttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Cache_inspector Additional ATS instanceshttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Additional_ATS_instances Debugginghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Debugging Process counthttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Process_count CPU usagehttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#CPU_usage Request logshttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Request_logs Testing patches in labshttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Testing_patches_in_labs Building and running from Githttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Building_and_running_from_Git Packaginghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Packaging Running autestshttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Running_autests Cheatsheethttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Cheatsheet Lua scriptinghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Lua_scripting Choosing origin serverhttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Choosing_origin_server Negative response cachinghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Negative_response_caching Setting X-Cache-Inthttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Setting_X-Cache-Int Custom metricshttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Custom_metrics Forcing a cache miss (similar to ban)https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Forcing_a_cache_miss_(similar_to_ban) Unit testinghttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Unit_testing Storagehttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Storage External linkshttps://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#External_links https://wikitech.wikimedia.org/wiki/Incidents/2017-01-19_Labstore == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-19_Labstore#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-19_Labstore#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-19_Labstore#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-19_Labstore#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-01-18_Labs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-18_Labs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-18_Labs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-18_Labs#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-18_Labs#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-01-24_WikibaseClient-InterwikiSorting == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-24_WikibaseClient-InterwikiSorting#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-24_WikibaseClient-InterwikiSorting#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-24_WikibaseClient-InterwikiSorting#Actionables https://wikitech.wikimedia.org/wiki/Puppet/Testing We have a set of helpers to lint, check style and even test the Puppet code we write. This part cover how to run the utilities, how to write your own tests and even how to debug! Configuring the environment - Bundlerhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Configuring_the_environment_-_Bundler Running testshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Running_tests Ignoring lint warnings and errorshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Ignoring_lint_warnings_and_errors Find out which warnings/errors are currently ignoredhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Find_out_which_warnings/errors_are_currently_ignored Rake explainedhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Rake_explained Global taskshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Global_tasks Module taskhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Module_task Rspechttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Rspec Debugginghttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Debugging Dump resourceshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Dump_resources Puppet debug loghttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Puppet_debug_log Run a single spec / examplehttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Run_a_single_spec_/_example Pass options to rspec from envhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Pass_options_to_rspec_from_env ruby debuggerhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#ruby_debugger Cloud VPS testinghttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Cloud_VPS_testing catalog compilationhttps://wikitech.wikimedia.org/wiki/Puppet/Testing#catalog_compilation Manual module testinghttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Manual_module_testing Integration with Jenkinshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Integration_with_Jenkins Common errorshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Common_errors Resourceshttps://wikitech.wikimedia.org/wiki/Puppet/Testing#Resources https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh == Goals == Goalshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Goals AQS servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#AQS_service Current clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Current_cluster Problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Problems Traffic analyticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Traffic_analytics Requirements for the new clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Requirements_for_the_new_cluster Cluster overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Cluster_overview Disks layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Disks_layout Load testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Load_testing Cassandra consistencyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Cassandra_consistency Failure scenarioshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Failure_scenarios One disk failurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#One_disk_failure Two disks failureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Two_disks_failures Three disks failureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Three_disks_failures Four disks failureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Four_disks_failures Combined failureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Combined_failures Alternativeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2016/Hardware_Refresh#Alternatives https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2017/Cluster_Expansion == Goals == Goalshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2017/Cluster_Expansion#Goals Current clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2017/Cluster_Expansion#Current_cluster Problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2017/Cluster_Expansion#Problems Related taskshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2017/Cluster_Expansion#Related_tasks Remarkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2017/Cluster_Expansion#Remarks https://wikitech.wikimedia.org/wiki/Reattach_a_global_account == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Reattach_a_global_account#Background Steps to reattach a global accounthttps://wikitech.wikimedia.org/wiki/Reattach_a_global_account#Steps_to_reattach_a_global_account See alsohttps://wikitech.wikimedia.org/wiki/Reattach_a_global_account#See_also https://wikitech.wikimedia.org/wiki/Stuck_global_renames == Reporting a stuck rename == Reporting a stuck renamehttps://wikitech.wikimedia.org/wiki/Stuck_global_renames#Reporting_a_stuck_rename Fixing a stuck renamehttps://wikitech.wikimedia.org/wiki/Stuck_global_renames#Fixing_a_stuck_rename Former workflowhttps://wikitech.wikimedia.org/wiki/Stuck_global_renames#Former_workflow Debugging a stuck renamehttps://wikitech.wikimedia.org/wiki/Stuck_global_renames#Debugging_a_stuck_rename Additional linkshttps://wikitech.wikimedia.org/wiki/Stuck_global_renames#Additional_links https://wikitech.wikimedia.org/wiki/Stream.wikimedia.org stream.wikimedia. Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/Incidents/2017-02-01_Phabricator This is a template for an Incident Report. Replace notes with your own description. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-01_Phabricator#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-01_Phabricator#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-01_Phabricator#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-01_Phabricator#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-01-26_API_Slowdown On the 2017-01-26, from 17:51 to 18:15 (all times UTC) there was a slowdown/increase in 500 responses on Wikimedia wikis' [Action API]. While there was scheduled maintenance at the time, no user impact should have been seen, the underlying cause is still being researched. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-26_API_Slowdown#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-26_API_Slowdown#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-26_API_Slowdown#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-01-26_API_Slowdown#Actionables https://wikitech.wikimedia.org/wiki/Zero [Zero] is short for zero-rated access to some Wikimedia sites, available from certain mobile ISPs who have partnered with the WMF. Technical information is available at [Zero/Development] and [Zero]. Code involvedhttps://wikitech.wikimedia.org/wiki/Zero#Code_involved Testing changeshttps://wikitech.wikimedia.org/wiki/Zero#Testing_changes https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31 == 2016-12-31 == 2016-12-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-31 2016-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-29 2016-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-28 2016-12-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-27 2016-12-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-26 2016-12-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-25 2016-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-23 2016-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-22 2016-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-21 2016-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-20 2016-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-19 2016-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-18 2016-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-17 2016-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-16 2016-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-15 2016-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-14 2016-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-13 2016-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-12 2016-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-10 2016-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-09 2016-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-08 2016-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-07 2016-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-06 2016-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-05 2016-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-04 2016-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-03 2016-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-02 2016-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-12-01 2016-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-30 2016-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-29 2016-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-28 2016-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-27 2016-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-26 2016-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-25 2016-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-24 2016-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-23 2016-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-22 2016-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-21 2016-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-20 2016-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-19 2016-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-18 2016-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-17 2016-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-16 2016-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-15 2016-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-14 2016-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-13 2016-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-12 2016-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-11 2016-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-10 2016-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-09 2016-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-08 2016-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-07 2016-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-06 2016-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-05 2016-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-04 2016-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-03 2016-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-02 2016-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-11-01 2016-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-31 2016-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-30 2016-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-29 2016-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-28 2016-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-27 2016-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-26 2016-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-25 2016-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-24 2016-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-22 2016-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-21 2016-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-20 2016-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-19 2016-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-18 2016-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-17 2016-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-16 2016-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-15 2016-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-14 2016-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-13 2016-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-12 2016-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-11 2016-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-10 2016-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-09 2016-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-08 2016-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-07 2016-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-06 2016-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-05 2016-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-04 2016-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-03 2016-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-02 2016-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-10-01 2016-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-30 2016-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-29 2016-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-28 2016-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-27 2016-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-26 2016-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-25 2016-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-24 2016-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-23 2016-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-22 2016-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-21 2016-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-20 2016-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-19 2016-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-18 2016-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-17 2016-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-16 2016-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-15 2016-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-14 2016-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-13 2016-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-12 2016-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-11 2016-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-10 2016-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-09 2016-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-08 2016-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-07 2016-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-06 2016-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-05 2016-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-04 2016-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-03 2016-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-02 2016-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_31#2016-09-01 https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/coreproduction-main-20170207 == db1089 == db1089https://wikitech.wikimedia.org/wiki/MariaDB/query_performance/coreproduction-main-20170207#db1089 https://wikitech.wikimedia.org/wiki/Server_Lifecycle/reclaim_checklist This checklist is able to be copied and pasted into phabricator hardware request tasks for reclaiming systems to spare or decom. https://wikitech.wikimedia.org/wiki/Install1002 install1002 was an install server which consisted of DHCP, TFTP, webproxy (Squid) and apt.wikimedia. https://wikitech.wikimedia.org/wiki/Install2002 install2002 was an install server which consisted of DHCP, TFTP, webproxy (Squid) and apt.wikimedia. https://wikitech.wikimedia.org/wiki/Mwmaint2001 mwmaint2001 was the maintenance script host for Codfw. It was [called] wasat. Connectinghttps://wikitech.wikimedia.org/wiki/Mwmaint2001#Connecting Serviceshttps://wikitech.wikimedia.org/wiki/Mwmaint2001#Services See alsohttps://wikitech.wikimedia.org/wiki/Mwmaint2001#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/02 === Week of February 6th === Week of February 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/02#Week_of_February_6th Week of February 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/02#Week_of_February_13th Week of February 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/02#Week_of_February_20th Week of February 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/02#Week_of_February_27th https://wikitech.wikimedia.org/wiki/Incidents/2017-02-22_www-portals == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-22_www-portals#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-22_www-portals#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-22_www-portals#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-22_www-portals#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-02-23_AQS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-23_AQS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-23_AQS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-23_AQS#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-02-23_AQS#Actionables https://wikitech.wikimedia.org/wiki/Bast3002 bast3002 was the main bastion for the Esams cluster, replacing bast3001 (changed per [It was in turn replaced by bast3004]. Serviceshttps://wikitech.wikimedia.org/wiki/Bast3002#Services https://wikitech.wikimedia.org/wiki/Flow This is a How-To guide on how to deal with installation and removal of [on the Wikis. Installing Flow on a wikihttps://wikitech.wikimedia.org/wiki/Flow#Installing_Flow_on_a_wiki Uninstalling Flow from a wikihttps://wikitech.wikimedia.org/wiki/Flow#Uninstalling_Flow_from_a_wiki Known problemshttps://wikitech.wikimedia.org/wiki/Flow#Known_problems https://wikitech.wikimedia.org/wiki/Incidents/2017-03-06_maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-06_maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-06_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-06_maps#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-06_maps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-03-08_Labstore == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-08_Labstore#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-08_Labstore#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-08_Labstore#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-08_Labstore#Actionables https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Powered_By == Unavailable == Unavailablehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Powered_By#Unavailable https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/03 === Week of March 6th === Week of March 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/03#Week_of_March_6th Week of March 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/03#Week_of_March_13th Week of March 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/03#Week_of_March_20th Week of March 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/03#Week_of_March_27th https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_session_metrics The tables mobile_apps_session_metrics and mobile_apps_session_metrics_by_os (available on Hive) contain aggregate stats about pageview sessions on the Android and iOS Wikipedia mobile apps, updated weekly. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_session_metrics#Schema Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_session_metrics#Caveats See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_session_metrics#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Legacy_Pagecounts https://wikitech.wikimedia.org/wiki/Deployments/Weekly_template === Week of $MonthDay === Week of $MonthDayhttps://wikitech.wikimedia.org/wiki/Deployments/Weekly_template#Week_of_$MonthDay https://wikitech.wikimedia.org/wiki/How_to_deploy_code/Adding_a_new_submodule Normally, new extension submodules are added to weekly core deploy branches by the make-release release tool. This is the preferred method for deploying a new extension to production. Deploymenthttps://wikitech.wikimedia.org/wiki/Category:Deployment https://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages#Actionables Direct actionables to prevent this issue from reappearinghttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages#Direct_actionables_to_prevent_this_issue_from_reappearing Long term actionables to solve more generic issues (to be discussed)https://wikitech.wikimedia.org/wiki/Incidents/2017-03-20_Special_AllPages#Long_term_actionables_to_solve_more_generic_issues_(to_be_discussed) https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN This page is a dumping ground for links and documentation in the process of moving CloudVPS to using Neutron. Preamblehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Preamble Labtest Allocationshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Labtest_Allocations Open questionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Open_questions Conceptualhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Conceptual Migration(s)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Migration(s) OpenVSwitchhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#OpenVSwitch Linux Bridginghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Linux_Bridging ML2 Linux Bridginghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#ML2_Linux_Bridging VXLANhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#VXLAN OpenVSwitch vs Linux Bridginghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#OpenVSwitch_vs_Linux_Bridging ML2: The Plugin Of Pluginshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#ML2:_The_Plugin_Of_Plugins Next Phaseshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Next_Phases Associatedhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Associated Misc Referencehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Misc_Reference Sub Pageshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN#Sub_Pages https://wikitech.wikimedia.org/wiki/Incidents/2017-03-22_AuthDNS Authoritative DNS was fully unavailable on 2017-03-22 from 13:34:43 to 13:37:26 (2m43s). It was at least partially degraded (< 3 servers responding) during the broader surrounding window of 13:30:36 to 13:38:55 (8m19s). Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-22_AuthDNS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-22_AuthDNS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-22_AuthDNS#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-22_AuthDNS#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-03-23_wikibase == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-23_wikibase#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-23_wikibase#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-23_wikibase#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-03-23_wikibase#Actionables https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap === Open Questions === Open Questionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#Open_Questions Keystonehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#Keystone LDAP Groupshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#LDAP_Groups LDAP vs Keystone: identify and assignemnthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#LDAP_vs_Keystone:_identify_and_assignemnt ldap assignment (we don't use this)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#ldap_assignment_(we_don't_use_this) LDAP OUhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#LDAP_OU LDAP (via wikitech) Creationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#LDAP_(via_wikitech)_Creation Referencehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/ldap#Reference https://wikitech.wikimedia.org/wiki/Analytics/Archive/Doc_proposal == To Do == To Dohttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Doc_proposal#To_Do Donehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Doc_proposal#Done https://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance == 2020 Switch Datacenter == 2020 Switch Datacenterhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance#2020_Switch_Datacenter Important dateshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance#Important_dates Failover schedulehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance#Failover_schedule Taskshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance#Tasks 2018 Switch Datacenterhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance#2018_Switch_Datacenter 2017 Switch Datacenterhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/planned_db_maintenance#2017_Switch_Datacenter https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Administrator_meeting_template Notes are taken in Etherpad pages named "WMCS-YYY-MM-DD". Following the meeting, the contents of the etherpad are archived to officewiki and a new pad is started for the following week. https://wikitech.wikimedia.org/wiki/DNS/Discovery DNS Discovery is a simple dynamic service discovery system to get the closest active endpoint of a given service that is running in multiple data centers. Active/active serviceshttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Active/active_services Active/passive serviceshttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Active/passive_services Read-only and read-writehttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Read-only_and_read-write Failure scenariohttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Failure_scenario How to manage a DNS Discovery servicehttps://wikitech.wikimedia.org/wiki/DNS/Discovery#How_to_manage_a_DNS_Discovery_service Add a service to productionhttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Add_a_service_to_production Remove a service from productionhttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Remove_a_service_from_production Discrepancyhttps://wikitech.wikimedia.org/wiki/DNS/Discovery#Discrepancy https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake The Analytics Data Lake (ADL), or the Data Lake for short, is a large, analytics-oriented repository of data about Wikimedia projects (in industry terms, a [lake|data lake]). Data availablehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#Data_available Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#Access Syntax differences between the SQL engineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#Syntax_differences_between_the_SQL_engines Integer division in Prestohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#Integer_division_in_Presto Table and file formatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#Table_and_file_formats Technical architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#Technical_architecture All Subpages ofhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake#All_Subpages_of https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits The Analytics Data Lake contains a number of editing datasets. Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Datasets Reference Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Reference_Data Raw Mediawiki datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Raw_Mediawiki_data Processed datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Processed_data Public datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Public_dataset Limitations of the historical datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Limitations_of_the_historical_datasets Why?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Why? How much/Which data is missing?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#How_much/Which_data_is_missing? Will there be improvements in the future to correct this missing data?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Will_there_be_improvements_in_the_future_to_correct_this_missing_data? Exampleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits#Examples https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Introduction Switch from EQIAD to CODFWhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Switch_from_EQIAD_to_CODFW Switchdc Menuhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Switchdc_Menu Stage 00https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_00 rollbackhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#rollback outputhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#output t00_disable_puppethttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t00_disable_puppet t00_reduce_ttlhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t00_reduce_ttl Stage 01https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_01 NO OUTPUThttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#NO_OUTPUT NODE GROUPhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#NODE_GROUP https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki# Stage 02https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_02 Stage 03https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_03 Stage 04https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_04 Stage 05https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_05 t05_switch_datacenterhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t05_switch_datacenter t05_switch_traffichttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t05_switch_traffic Stage 06https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_06 Stage 07https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_07 Stage 08https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_08 Stage 09https://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#Stage_09 t09_restart_parsoidhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t09_restart_parsoid t09_restore_ttlhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t09_restore_ttl t09_start_maintenancehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t09_start_maintenance t09_tendrilhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/MediaWiki#t09_tendril https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Quarterly_Reviews This page lists links to Analytics Quarterly Reviews notes https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/04 === Week of April 3rd === Week of April 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/04#Week_of_April_3rd Week of April 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/04#Week_of_April_10th Week of April 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/04#Week_of_April_17th Week of April 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/04#Week_of_April_24th https://wikitech.wikimedia.org/wiki/Fundraising/tech/ssh_config Moved to collab https://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation#Timeline Investigationhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation#Investigation Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation#Actionables Also seehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ContentTranslation#Also_see https://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ToolsProxy == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ToolsProxy#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ToolsProxy#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ToolsProxy#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_ToolsProxy#Actionables https://wikitech.wikimedia.org/wiki/Etcd/Clients This page describes the clients that use etcd in the WMF stack. PyBalhttps://wikitech.wikimedia.org/wiki/Etcd/Clients#PyBal Confdhttps://wikitech.wikimedia.org/wiki/Etcd/Clients#Confd Conftoolhttps://wikitech.wikimedia.org/wiki/Etcd/Clients#Conftool https://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_restbase == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_restbase#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_restbase#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_restbase#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_restbase#Actionables Footnoteshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-19_restbase#Footnotes https://wikitech.wikimedia.org/wiki/Two-factor_authentication Two-factor authentication (TFA or 2FA) is a method of confirming a user's claimed identity by utilizing a combination of two different components. Two-factor authentication is a type of [authentication|multi-factor authentication]. See alsohttps://wikitech.wikimedia.org/wiki/Two-factor_authentication#See_also https://wikitech.wikimedia.org/wiki/Deploy2001 deploy2001 (previously known as naos) was the deployment host for Codfw. It replaced mira, and was in turn replaced by deploy2002 ([Connecting == Connectinghttps://wikitech.wikimedia.org/wiki/Deploy2001#Connecting Serviceshttps://wikitech.wikimedia.org/wiki/Deploy2001#Services See alsohttps://wikitech.wikimedia.org/wiki/Deploy2001#See_also https://wikitech.wikimedia.org/wiki/IP_and_AS_allocations This page lists IP addresses and Autonomous system numbers (ASN) allocated by Wikimedia Foundation. Public IPshttps://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#Public_IPs IPV4https://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#IPV4 IPv6https://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#IPv6 RFC1918 IPshttps://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#RFC1918_IPs Multicasthttps://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#Multicast Autonomous System Numbershttps://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#Autonomous_System_Numbers BGP communitieshttps://wikitech.wikimedia.org/wiki/IP_and_AS_allocations#BGP_communities https://wikitech.wikimedia.org/wiki/Incidents/2017-04-26_ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-26_ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-26_ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-26_ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-26_ORES#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_redis-ipaddress == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_redis-ipaddress#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_redis-ipaddress#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_redis-ipaddress#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_redis-ipaddress#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_archiva == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_archiva#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_archiva#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_archiva#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_archiva#Actionables https://wikitech.wikimedia.org/wiki/Perf = Observe $pid behavior = Observe $pid behaviorhttps://wikitech.wikimedia.org/wiki/Perf#Observe_$pid_behavior Probes Cheatsheethttps://wikitech.wikimedia.org/wiki/Perf#Probes_Cheatsheet https://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_ocg == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_ocg#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_ocg#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_ocg#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-04-27_ocg#Actionables https://wikitech.wikimedia.org/wiki/Kubernetes [(often abbreviated k8s) is an open-source system for automating deployment, and management of applications running in containers]. This page collects some notes/docs on the Kubernetes setup in the Foundation production environment. Clustershttps://wikitech.wikimedia.org/wiki/Kubernetes#Clusters Packageshttps://wikitech.wikimedia.org/wiki/Kubernetes#Packages Imageshttps://wikitech.wikimedia.org/wiki/Kubernetes#Images Serviceshttps://wikitech.wikimedia.org/wiki/Kubernetes#Services Deployment Chartshttps://wikitech.wikimedia.org/wiki/Kubernetes#Deployment_Charts Debugginghttps://wikitech.wikimedia.org/wiki/Kubernetes#Debugging Administrationhttps://wikitech.wikimedia.org/wiki/Kubernetes#Administration See alsohttps://wikitech.wikimedia.org/wiki/Kubernetes#See_also Toolforge Infohttps://wikitech.wikimedia.org/wiki/Kubernetes#Toolforge_Info https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity Banner Activity is a private data set served through Analytics' Druid datastore and Pivot analysis tool. It contains data about banner impressions, campaigns, status codes and others across all wikis and languages in minutely resolution. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Current_Schema Loading of the datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Loading_of_the_data Nearly real-time (streaming) loadinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Nearly_real-time_(streaming)_loading Daily loadinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Daily_loading Monthly loadinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Monthly_loading Sanitization after 90 dayshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Sanitization_after_90_days Examples of usehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Examples_of_use Changes and known problems since 2017-05-01https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#Changes_and_known_problems_since_2017-05-01 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Banner_activity#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo Turnilo provides a friendly user interface to Druid and is used internally at Wikimedia Foundation. As of 2017, most of the data available in Turnilo comes from Hadoop. Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Access Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Administration Restarthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Restart Logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Logs Deployhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Deploy Test Staging Turnilohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Test_Staging_Turnilo Test config changeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#Test_config_changes Historyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Turnilo#History https://wikitech.wikimedia.org/wiki/Incidents/2017-05-07_labs-dns == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-07_labs-dns#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-07_labs-dns#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-07_labs-dns#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-07_labs-dns#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_missing_index On 3th May, after the datacenter switch back to eqiad, between 14:26 and 15:12 UTC, revision deletions failed on the final step (showing older logs and adding a comment/more options), showing the following error instead: A database query error has occurred. This may indicate a bug in the software. Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_missing_index#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_missing_index#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_missing_index#Actionables https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products |talk page]]. Rebranding productshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Rebranding_products Rebranding communication channelshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Rebranding_communication_channels Emailhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Email IRChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#IRC Phabricatorhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Phabricator Database replicashttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Database_replicas Updating wiki contenthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Updating_wiki_content Changing domain nameshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Changing_domain_names Updating internal configurationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Updating_internal_configuration Timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Rebranding_Cloud_Services_products#Timeline https://wikitech.wikimedia.org/wiki/Calico Calico is a virtual network infrastructure that we use to manage Kubernetes networking. IPAMhttps://wikitech.wikimedia.org/wiki/Calico#IPAM Operationshttps://wikitech.wikimedia.org/wiki/Calico#Operations Typhahttps://wikitech.wikimedia.org/wiki/Calico#Typha Kube Controllershttps://wikitech.wikimedia.org/wiki/Calico#Kube_Controllers Resource Usagehttps://wikitech.wikimedia.org/wiki/Calico#Resource_Usage Packaginghttps://wikitech.wikimedia.org/wiki/Calico#Packaging Updating helm chartshttps://wikitech.wikimedia.org/wiki/Calico#Updating_helm_charts Publishinghttps://wikitech.wikimedia.org/wiki/Calico#Publishing The Debian Packageshttps://wikitech.wikimedia.org/wiki/Calico#The_Debian_Packages The Docker Imageshttps://wikitech.wikimedia.org/wiki/Calico#The_Docker_Images Updatinghttps://wikitech.wikimedia.org/wiki/Calico#Updating External linkshttps://wikitech.wikimedia.org/wiki/Calico#External_links https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/05 === Week of May 1st === Week of May 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/05#Week_of_May_1st Week of May 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/05#Week_of_May_8th Week of May 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/05#Week_of_May_15th Week of May 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/05#Week_of_May_22nd Week of May 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/05#Week_of_May_29th https://wikitech.wikimedia.org/wiki/Maps/Infrastructure_plans This page describes plans and not the current state of maps servers Constraintshttps://wikitech.wikimedia.org/wiki/Maps/Infrastructure_plans#Constraints Architecturehttps://wikitech.wikimedia.org/wiki/Maps/Infrastructure_plans#Architecture Recommendations 2022-12https://wikitech.wikimedia.org/wiki/Maps/Infrastructure_plans#Recommendations_2022-12 https://wikitech.wikimedia.org/wiki/Incidents/2017-05-12_API == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-12_API#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-12_API#Timeline Other service impacts because of the core changehttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-12_API#Other_service_impacts_because_of_the_core_change Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-12_API#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-12_API#Actionables https://wikitech.wikimedia.org/wiki/Pwstore pwstore (pws) is a tool to maintain a collection of [Privacy Guard|GPG] encrypted files in a directory tree and/or a [control|SCM] system. https://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch This is a page to summarize all the things to look for when upgrading an instance/server from jessie to stretch. Apachehttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#Apache libapache2-mod-phphttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#libapache2-mod-php MySQLhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#MySQL mysql-server-5.5https://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#mysql-server-5.5 mysql-client-5.5https://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#mysql-client-5.5 mysql_ functions in PHPhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#mysql_functions_in_PHP PHPhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#PHP php5https://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#php5 php5-clihttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#php5-cli php5-mysqlhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#php5-mysql Pythonhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#Python instance upgrade reportshttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#instance_upgrade_reports Phabricatorhttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#Phabricator Wikistatshttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#Wikistats External linkshttps://wikitech.wikimedia.org/wiki/Distribution_upgrades/jessie_stretch#External_links https://wikitech.wikimedia.org/wiki/APT_repository/Stretch-Key -----BEGIN PGP PUBLIC KEY BLOCK----- https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance This page is for routine maintenance tasks performed by Cloud Services operators. For troubleshooting immediate issues, see the troubleshooting page. Rebooting hosts (e.g. for security upgrades)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#Rebooting_hosts_(e.g._for_security_upgrades) cloudbackupXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudbackupXXXX cloudcontrolXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudcontrolXXXX cloudnetXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudnetXXXX cloudrabbitXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudrabbitXXXX cloudservicesXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudservicesXXXX cloudvirtXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudvirtXXXX cloudvirtlocalXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudvirtlocalXXXX cloudvirt-wdqsXXXXhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#cloudvirt-wdqsXXXX Live Migrating Virtual Machineshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#Live_Migrating_Virtual_Machines Openstack Upgrade test planhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#Openstack_Upgrade_test_plan Admin/Maintenance scriptshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#Admin/Maintenance_scripts credentialshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#credentials wmcs-openstackhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-openstack migration scriptshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#migration_scripts wmcs-cold-migratehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-cold-migrate wmcs-cold-nova-migratehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-cold-nova-migrate wmcs-live-migratehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-live-migrate wmcs-region-migratehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-region-migrate wmcs-region-migrate-security-groupshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-region-migrate-security-groups wmcs-region-migrate-quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-region-migrate-quotas novastatshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#novastats wmcs-novastats-imagestatshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-novastats-imagestats wmcs-novastats-alltrustyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-novastats-alltrusty wmcs-novastats-flavorreporthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-novastats-flavorreport wmcs-novastats-puppetleakshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-novastats-puppetleaks wmcs-novastats-capacityhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-novastats-capacity wmcs-dnsleakshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-dnsleaks wmcs-novastats-proxyleakshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-novastats-proxyleaks DNShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#DNS wmcs-makedomainhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-makedomain wmcs-wikireplica-dnshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-wikireplica-dns wmcs-populate-domainshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-populate-domains othershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#others wmcs-spreadcheckhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-spreadcheck wmcs-vm-extra-specshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-vm-extra-specs wmcs-instancepurgehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#wmcs-instancepurge See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance#See_also https://wikitech.wikimedia.org/wiki/Portal:Data_Services Data Services includes services that allow for direct access to databases and dumps, as well as web interfaces for querying and programmatic access to data stores. Data storeshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Data_stores Wiki Replicashttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Wiki_Replicas Wikimedia Dumpshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Wikimedia_Dumps Shared Storagehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Shared_Storage CirrusSearch Elasticsearch replicashttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#CirrusSearch_Elasticsearch_replicas Wikimedia Enterprisehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Wikimedia_Enterprise Web interfaceshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Web_interfaces Supersethttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#Superset PAWShttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#PAWS See alsohttps://wikitech.wikimedia.org/wiki/Portal:Data_Services#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin Documentation of admin procedures for Cloud VPS. See Help:Cloud VPS for user-facing documentation. Admin permissionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin#Admin_permissions Deploymentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin#Deployments Useful linkshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin#Useful_links All subpageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin#All_subpages https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin Useful tools: https://tool-db-usage.toolforge. Cloud Services adminhttps://wikitech.wikimedia.org/wiki/Category:Cloud_Services_admin Data Services adminhttps://wikitech.wikimedia.org/wiki/Category:Data_Services_admin https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage Read-write NFS shares are currently hosted on per-project Cloud VPS VMs. In addition, the clouddumps servers host the dumps files in a read-only fashion. Operationshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#Operations NFS volume cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#NFS_volume_cleanup NFS client operationshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#NFS_client_operations How to enable NFS for a projecthttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#How_to_enable_NFS_for_a_project Referencehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#Reference nfs-exportdhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#nfs-exportd Backupshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Shared_storage#Backups https://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_x1_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_x1_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_x1_outage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_x1_outage#Conclusions Actions Takenhttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_x1_outage#Actions_Taken Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-03_x1_outage#Actionables https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Summary Componentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Components Deployment Shared components [Per Site]https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Deployment_Shared_components_[Per_Site] Deployment Separate Componentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Deployment_Separate_Components Phaseshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Phases Phase 0https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Phase_0 Phase 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Phase_1 Phase 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#Phase_2 See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Neutron_SDN/phases#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-05-25_MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-25_MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-25_MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-25_MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-05-25_MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team == Subpages == Subpageshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team#Subpages https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties The WMCS team practices a clinic duty rotation that runs from one weekly team meeting to the next. Each team member takes a turn sequentially performing these duties. Clinic dutyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Clinic_duty Start of clinic dutyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Start_of_clinic_duty Meetingshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Meetings Phabricatorhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Phabricator Community Requestshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Community_Requests IRChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#IRC Oncall dutyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Oncall_duty Alertshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Alerts Cloud VPS alertshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Cloud_VPS_alerts Dashboardshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Dashboards Improvementshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Clinic_duties#Improvements https://wikitech.wikimedia.org/wiki/Etcd/Main_cluster The main etcd cluster is the Etcd cluster used as a state management system for the WMF production cluster. It is operated by SRE Service Ops under the etcd main cluster SLO. Usage in productionhttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Usage_in_production Architecturehttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Architecture Consistencyhttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Consistency Replicationhttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Replication Recovering from replication failureshttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Recovering_from_replication_failures Individual cluster configurationhttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Individual_cluster_configuration Operationshttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Operations Master cluster switchoverhttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Master_cluster_switchover Reimage clusterhttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#Reimage_cluster See alsohttps://wikitech.wikimedia.org/wiki/Etcd/Main_cluster#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-06-01_Maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-01_Maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-01_Maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-01_Maps#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-01_Maps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-06-07_scrape == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-07_scrape#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-07_scrape#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-07_scrape#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-07_scrape#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/06 === Week of June 5th === Week of June 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/06#Week_of_June_5th Week of June 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/06#Week_of_June_12th Week of June 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/06#Week_of_June_19th Week of June 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/06#Week_of_June_26th https://wikitech.wikimedia.org/wiki/Incidents/2017-06-13_ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-13_ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-13_ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-13_ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-13_ORES#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines The Analytics Engineering team is considering establishing some schema guidelines that would make ingestion into Data Analysis tools easier. The current idea is that we can automatically load conforming schemas into Druid and make them available for analysis in Turnilo (formerly Pivot) or Superset, but the particular technologies used aren't too important. Guidelineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Guidelines Schema set uphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Schema_set_up Ingestion into Druidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Ingestion_into_Druid Example Schema Conforming to Guidelinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Example_Schema_Conforming_to_Guideline Dimensionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Dimension Regarding Dimensions with "many" Numeric Valueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Regarding_Dimensions_with_"many"_Numeric_Values Bucketing time measureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#Bucketing_time_measures See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/Schema_Guidelines#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-06-16_PHAB == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-16_PHAB#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-16_PHAB#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-16_PHAB#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-06-16_PHAB#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20170617-Phabricator-spam == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20170617-Phabricator-spam#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20170617-Phabricator-spam#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20170617-Phabricator-spam#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20170617-Phabricator-spam#Actionables Related linkshttps://wikitech.wikimedia.org/wiki/Incidents/20170617-Phabricator-spam#Related_links https://wikitech.wikimedia.org/wiki/Incidents/20170623-ORES ORES scoring service was intermittently unavailable for ~7 hours on 2017-06-23. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20170623-ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20170623-ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20170623-ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20170623-ORES#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20170629-ganeti Various services were unavailable for ~40 mins Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20170629-ganeti#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20170629-ganeti#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20170629-ganeti#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20170629-ganeti#Actionables https://wikitech.wikimedia.org/wiki/Network_monitoring == Monitoring resources == Monitoring resourceshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Monitoring_resources Runbookshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Runbooks Icinga alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Icinga_alerts host (ipv6) downhttps://wikitech.wikimedia.org/wiki/Network_monitoring#host_(ipv6)_down Router interface downhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down Juniper alarmhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Juniper_alarm BFD statushttps://wikitech.wikimedia.org/wiki/Network_monitoring#BFD_status OSPF statushttps://wikitech.wikimedia.org/wiki/Network_monitoring#OSPF_status BGP statushttps://wikitech.wikimedia.org/wiki/Network_monitoring#BGP_status VCP statushttps://wikitech.wikimedia.org/wiki/Network_monitoring#VCP_status Atlas alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Atlas_alerts NEL alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#NEL_alerts VRRP statushttps://wikitech.wikimedia.org/wiki/Network_monitoring#VRRP_status BGPmon alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#BGPmon_alerts RPKI Validation Failedhttps://wikitech.wikimedia.org/wiki/Network_monitoring#RPKI_Validation_Failed RIPE alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#RIPE_alerts Resource Certification (RPKI) alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Resource_Certification_(RPKI)_alerts LibreNMS alertshttps://wikitech.wikimedia.org/wiki/Network_monitoring#LibreNMS_alerts Primary outbound port utilization over 80%https://wikitech.wikimedia.org/wiki/Network_monitoring#Primary_outbound_port_utilization_over_80% Sensor over limithttps://wikitech.wikimedia.org/wiki/Network_monitoring#Sensor_over_limit Juniper environment statushttps://wikitech.wikimedia.org/wiki/Network_monitoring#Juniper_environment_status Juniper alarm activehttps://wikitech.wikimedia.org/wiki/Network_monitoring#Juniper_alarm_active DC uplink low traffichttps://wikitech.wikimedia.org/wiki/Network_monitoring#DC_uplink_low_traffic Processor usage over 85% or Memory over 85%https://wikitech.wikimedia.org/wiki/Network_monitoring#Processor_usage_over_85%_or_Memory_over_85% Storage /var over 50% or Storage over 90%https://wikitech.wikimedia.org/wiki/Network_monitoring#Storage_/var_over_50%_or_Storage_over_90% Critical or emergency syslog messageshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Critical_or_emergency_syslog_messages Inbound/outbound interface errorshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Inbound/outbound_interface_errors Traffic bill over quotahttps://wikitech.wikimedia.org/wiki/Network_monitoring#Traffic_bill_over_quota Poller is taking too longhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Poller_is_taking_too_long BGP peer above prefix limithttps://wikitech.wikimedia.org/wiki/Network_monitoring#BGP_peer_above_prefix_limit Port with no description on access switchhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Port_with_no_description_on_access_switch Port downhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Port_down Traffic on tunnel linkhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Traffic_on_tunnel_link Duplicate IP on mgmt networkhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Duplicate_IP_on_mgmt_network Storm control in effecthttps://wikitech.wikimedia.org/wiki/Network_monitoring#Storm_control_in_effect Outbound discardshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Outbound_discards virtual-chassis crashhttps://wikitech.wikimedia.org/wiki/Network_monitoring#virtual-chassis_crash Access port speed <https://wikitech.wikimedia.org/wiki/Network_monitoring#Access_port_speed_< Not accepting/receiving prefixes from anycast BGP peerhttps://wikitech.wikimedia.org/wiki/Network_monitoring#Not_accepting/receiving_prefixes_from_anycast_BGP_peer Blackbox Probes (Prometheus)https://wikitech.wikimedia.org/wiki/Network_monitoring#Blackbox_Probes_(Prometheus) ProbeDownhttps://wikitech.wikimedia.org/wiki/Network_monitoring#ProbeDown PingUnreachablehttps://wikitech.wikimedia.org/wiki/Network_monitoring#PingUnreachable DNSUnavailablehttps://wikitech.wikimedia.org/wiki/Network_monitoring#DNSUnavailable Sysloghttps://wikitech.wikimedia.org/wiki/Network_monitoring#Syslog Operationshttps://wikitech.wikimedia.org/wiki/Network_monitoring#Operations netmon failoverhttps://wikitech.wikimedia.org/wiki/Network_monitoring#netmon_failover https://wikitech.wikimedia.org/wiki/Incidents/20170629-Labstore_Kernel_Upgrade == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20170629-Labstore_Kernel_Upgrade#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20170629-Labstore_Kernel_Upgrade#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20170629-Labstore_Kernel_Upgrade#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20170629-Labstore_Kernel_Upgrade#Actionables https://wikitech.wikimedia.org/wiki/Swift/Thumbnails_Cleanup Media thumbnails are generated on demand (of arbitrary width) and stored in swift, however MediaWiki doesn't know about the full list of widths being requested by users. Further, thumbnails are never cleaned up from swift, thus as part of Techops FY2016-2017 goals there has been investigation on how to periodically and effectively clean up thumbnails stored in swift. Collect webrequest datahttps://wikitech.wikimedia.org/wiki/Swift/Thumbnails_Cleanup#Collect_webrequest_data Collect swift datahttps://wikitech.wikimedia.org/wiki/Swift/Thumbnails_Cleanup#Collect_swift_data Further cleanup strategieshttps://wikitech.wikimedia.org/wiki/Swift/Thumbnails_Cleanup#Further_cleanup_strategies https://wikitech.wikimedia.org/wiki/Wiki_Replica_redaction This page is to document how the data is sanitized for the Wiki Replicas public databases that Wikimedia Cloud Services provides. Sanitarium hostshttps://wikitech.wikimedia.org/wiki/Wiki_Replica_redaction#Sanitarium_hosts Wiki Replicas viewshttps://wikitech.wikimedia.org/wiki/Wiki_Replica_redaction#Wiki_Replicas_views Document redaction decisionshttps://wikitech.wikimedia.org/wiki/Wiki_Replica_redaction#Document_redaction_decisions https://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue | wikitech-static.wikimedia. Your own Internethttps://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue#Your_own_Internet Wikimedia's websiteshttps://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue#Wikimedia's_websites Additional troubleshootinghttps://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue#Additional_troubleshooting Test connectivity to multiple Wikimedia Point of Presence (PoP) locationshttps://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue#Test_connectivity_to_multiple_Wikimedia_Point_of_Presence_(PoP)_locations Test IP fragmentation issueshttps://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue#Test_IP_fragmentation_issues Show latency for various parts of an exchangehttps://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue#Show_latency_for_various_parts_of_an_exchange https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/07 === Week of July 3rd === Week of July 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/07#Week_of_July_3rd Week of July 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/07#Week_of_July_10th Week of July 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/07#Week_of_July_17th Week of July 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/07#Week_of_July_24th Week of July 31sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/07#Week_of_July_31st https://wikitech.wikimedia.org/wiki/HTTPS [(also called HTTP over Transport Layer Security (TLS), HTTP over SSL, and HTTP Secure) is a communications protocol for secure communication over a computer network which is widely used on the Internet. The Wikimedia family of wikis and services use HTTPS encryption to prevent eavesdropping and man-in-the-middle attacks]. Current policies and standardshttps://wikitech.wikimedia.org/wiki/HTTPS#Current_policies_and_standards For all public-facing Web sites and services under Wikimedia controlhttps://wikitech.wikimedia.org/wiki/HTTPS#For_all_public-facing_Web_sites_and_services_under_Wikimedia_control Certificate Issuance and Renewalhttps://wikitech.wikimedia.org/wiki/HTTPS#Certificate_Issuance_and_Renewal Foundation canonical domain nameshttps://wikitech.wikimedia.org/wiki/HTTPS#Foundation_canonical_domain_names Related informationhttps://wikitech.wikimedia.org/wiki/HTTPS#Related_information https://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging#Timeline Mon July 10 11:31:10 UTC 2017https://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging#Mon_July_10_11:31:10_UTC_2017 Mon Apr 6 18:32 UTC 2015https://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging#Mon_Apr_6_18:32_UTC_2015 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-11_EventLogging#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-07-18_JobQueue == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-18_JobQueue#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-18_JobQueue#Timeline Detailed loghttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-18_JobQueue#Detailed_log Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-18_JobQueue#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-18_JobQueue#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#Timeline CI/betahttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#CI/beta Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#Conclusions Annexeshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#Annexes Incident taskshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#Incident_tasks Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-19_ldap#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-07-20_novaadmin_LDAP_password == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-20_novaadmin_LDAP_password#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-20_novaadmin_LDAP_password#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-20_novaadmin_LDAP_password#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-20_novaadmin_LDAP_password#Actionables https://wikitech.wikimedia.org/wiki/Stat1006 stat1006 is an analytics server for general computation and for accessing the Analytics MariaDB databases. Successor to Stat1003. Usagehttps://wikitech.wikimedia.org/wiki/Stat1006#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1006#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1006#See_also https://wikitech.wikimedia.org/wiki/Stat1005 The stat1005 server is an Analytics Cluster client node for accessing Analytics MariaDB databases or Hadoop. Successor to stat1002. Usagehttps://wikitech.wikimedia.org/wiki/Stat1005#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1005#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1005#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1005#Notes https://wikitech.wikimedia.org/wiki/PC PC or pc may refer to: https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_uniques The tables mobile_apps_uniques_daily and mobile_apps_uniques_monthly(available in the wmf database on Hive) count how many different Android and iOS Wikipedia mobile apps installs accessed Wikimedia sites during the given day or month, determined as the number of app uuids appearing in the webrequest table (via the X-Analytics header or [the query part of the URL). Schemas https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_uniques#Schemas Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_uniques#Caveats See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/mobile_apps_uniques#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only Wikidata and the German Wikipedia were in read-only mode from 5:48 to 7:04 on 2017-07-28. No edits, user creations were possible between these two timestamps. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only#Actionables Short termhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only#Short_term Long termhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-28_s5_(WikiData_and_dewiki)_read-only#Long_term https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/Tagging == Webrequest Tagging == Webrequest Tagginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/Tagging#Webrequest_Tagging Usage of tags column in SQLhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/Tagging#Usage_of_tags_column_in_SQL Code examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest/Tagging#Code_example https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration We rebuild the mediawiki edit history from the clouddb db replicas. Those databases only hold public data. Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Administration Test Sqoop Runhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Test_Sqoop_Run Rerun what's neededhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Rerun_what's_needed See sqoop errorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#See_sqoop_errors QA: Assessing quality of a snapshothttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#QA:_Assessing_quality_of_a_snapshot Automatic validation steps. What to do if things failhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Automatic_validation_steps._What_to_do_if_things_fail Have events disappeared or moved mysteriously?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Have_events_disappeared_or_moved_mysteriously? Manually compare data with available data sourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Manually_compare_data_with_available_data_sources Data Loadinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#Data_Loading How is this data gathered: public data from labshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#How_is_this_data_gathered:_public_data_from_labs How is this data gathered: ad-hoc private replicashttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Edit_history_administration#How_is_this_data_gathered:_ad-hoc_private_replicas https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/08 === Week of August 7th === Week of August 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/08#Week_of_August_7th Week of August 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/08#Week_of_August_14th Week of August 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/08#Week_of_August_21st Week of August 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/08#Week_of_August_28th https://wikitech.wikimedia.org/wiki/Incidents/2017-07-21_Train-Wikidata == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-21_Train-Wikidata#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-21_Train-Wikidata#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-21_Train-Wikidata#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-07-21_Train-Wikidata#Actionables https://wikitech.wikimedia.org/wiki/HTTPS/3DES_Deprecation == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/HTTPS/3DES_Deprecation#Overview Impacthttps://wikitech.wikimedia.org/wiki/HTTPS/3DES_Deprecation#Impact Processhttps://wikitech.wikimedia.org/wiki/HTTPS/3DES_Deprecation#Process Technical Rationalehttps://wikitech.wikimedia.org/wiki/HTTPS/3DES_Deprecation#Technical_Rationale https://wikitech.wikimedia.org/wiki/WebPageTest/Run_locally Running a WebPageTest instance on your local machine has been made a lot easier in 2017 with the support for Linux agent. The agent is still experimental but it is a good start for us to be able to fix bugs and test things locally. Mac OS Xhttps://wikitech.wikimedia.org/wiki/WebPageTest/Run_locally#Mac_OS_X Known issueshttps://wikitech.wikimedia.org/wiki/WebPageTest/Run_locally#Known_issues https://wikitech.wikimedia.org/wiki/Incidents/2017-08-29_EventStreams == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-29_EventStreams#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-29_EventStreams#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-29_EventStreams#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-29_EventStreams#Actionables https://wikitech.wikimedia.org/wiki/WMDE/Analytics Documentation for the WMDE analytics activities. Puppetizationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#Puppetization Grafanahttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#Grafana analytics/wmde/scripts repohttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#analytics/wmde/scripts_repo Logshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#Logs analytics/wmde/toolkit-analyzer repo and buildhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#analytics/wmde/toolkit-analyzer_repo_and_build Ad-hoc Hive querieshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#Ad-hoc_Hive_queries Ad-hoc MediaWiki Logginghttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#Ad-hoc_MediaWiki_Logging WDCMhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics#WDCM https://wikitech.wikimedia.org/wiki/Incidents/2017-08-31_Zookeeper == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-31_Zookeeper#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-31_Zookeeper#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-31_Zookeeper#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-31_Zookeeper#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-08-14_Train == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-14_Train#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-14_Train#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-14_Train#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-08-14_Train#Actionables https://wikitech.wikimedia.org/wiki/Wiki_Replicas_Special_Interest_Group/Meetings Meeting notes will be published here. https://wikitech.wikimedia.org/wiki/Wiki_Replicas_Special_Interest_Group The Wiki Replicas [Interest Groups|Special Interest Group], is a small group of stakeholders from various teams and demographics, who directly work on issues related to the Wiki Replicas. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate Cloud VPS DNS is [backed by a database controlled by OpenStack Designate. Designate services run on cloudcontrol node and use the same galera cluster database as other openstack services. Basic infohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Basic_info Designate serviceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Designate_services Initial designate/pdns node setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Initial_designate/pdns_node_setup Basic operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Basic_operations New PTR recordhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#New_PTR_record New A recordshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#New_A_records New NS recordhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#New_NS_record Updating an existing recordhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Updating_an_existing_record Maintenance operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Maintenance_operations If things are misbehavinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#If_things_are_misbehaving Restart everythinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Restart_everything Check the designate-sink logshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Check_the_designate-sink_logs Look at pdnshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Look_at_pdns Cleaning up leaked recordshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Cleaning_up_leaked_records Manual fix for multiple IP recordshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Manual_fix_for_multiple_IP_records DNS zone creating / transfershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#DNS_zone_creating_/_transfers Zoneshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Zones tools.eqiad.wmflabshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#tools.eqiad.wmflabs .wmflabs and .wikimedia.cloudhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#.wmflabs_and_.wikimedia.cloud svc zone in .wikimedia.cloud domainhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#svc_zone_in_.wikimedia.cloud_domain Administrative scriptshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Administrative_scripts Wiki Replica DNShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Wiki_Replica_DNS labs-ip-alias-dumphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#labs-ip-alias-dump dns-floating-ip-updaterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#dns-floating-ip-updater See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim == Email maintenance == Email maintenancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim#Email_maintenance Blocking a sender from sending outbound mailhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim#Blocking_a_sender_from_sending_outbound_mail Stopping all in/outbound mailhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim#Stopping_all_in/outbound_mail Exim runs as a queue on each exec nodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim#Exim_runs_as_a_queue_on_each_exec_node Failoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim#Failover See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Exim#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/09 === Week of September 4th === Week of September 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/09#Week_of_September_4th Week of September 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/09#Week_of_September_11th Week of September 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/09#Week_of_September_18th Week of September 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/09#Week_of_September_25th https://wikitech.wikimedia.org/wiki/Incidents/20170917-MediaWiki-API == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20170917-MediaWiki-API#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20170917-MediaWiki-API#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20170917-MediaWiki-API#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20170917-MediaWiki-API#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Elasticsearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Elasticsearch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Elasticsearch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Logstash == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Logstash#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Logstash#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Logstash#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-20_Logstash#Actionables https://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential In June 2017 we started using Phabricator's git management solution, Differential, with the Wikistats 2 repository. We chose it as a compromise to use a modern Github-style repository, avoiding gerrit, while at the same time hosting the project in a solution owned by the Foundation. Issueshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Issues An initial entry barrier to the projecthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#An_initial_entry_barrier_to_the_project Confusing approach to githttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Confusing_approach_to_git Insufficient documentationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Insufficient_documentation Prone to error behaviour (dark patterns)https://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Prone_to_error_behaviour_(dark_patterns) Other conshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Other_cons Advantageshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Advantages Next stepshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Next_steps Move to Gerrithttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Move_to_Gerrit Set up CIhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Set_up_CI Update documentationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Differential#Update_documentation https://wikitech.wikimedia.org/wiki/Incidents/2017-09-22_REST-API-alert-pageimage-update == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-22_REST-API-alert-pageimage-update#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-22_REST-API-alert-pageimage-update#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-22_REST-API-alert-pageimage-update#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-09-22_REST-API-alert-pageimage-update#Actionables https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32 == 2017-07-31 == 2017-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-31 2017-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-29 2017-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-28 2017-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-27 2017-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-26 2017-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-25 2017-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-24 2017-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-23 2017-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-21 2017-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-20 2017-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-19 2017-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-18 2017-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-17 2017-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-15 2017-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-14 2017-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-13 2017-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-12 2017-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-11 2017-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-10 2017-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-08 2017-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-07 2017-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-06 2017-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-05 2017-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-04 2017-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-03 2017-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-02 2017-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-07-01 2017-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-30 2017-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-29 2017-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-28 2017-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-27 2017-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-26 2017-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-25 2017-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-23 2017-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-22 2017-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-21 2017-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-20 2017-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-19 2017-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-18 2017-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-17 2017-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-16 2017-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-15 2017-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-14 2017-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-13 2017-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-12 2017-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-11 2017-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-10 2017-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-09 2017-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-08 2017-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-07 2017-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-06 2017-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-05 2017-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-04 2017-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-03 2017-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-02 2017-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-06-01 2017-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-31 2017-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-30 2017-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-29 2017-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-28 2017-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-27 2017-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-26 2017-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-25 2017-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-24 2017-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-23 2017-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-22 2017-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-21 2017-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-20 2017-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-19 2017-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-18 2017-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-17 2017-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-16 2017-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-15 2017-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-14 2017-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-13 2017-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-12 2017-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-11 2017-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-10 2017-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-09 2017-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-08 2017-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-07 2017-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-06 2017-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-05 2017-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-04 2017-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-03 2017-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-02 2017-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-05-01 2017-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-30 2017-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-29 2017-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-28 2017-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-27 2017-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-26 2017-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-25 2017-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-24 2017-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-23 2017-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-22 2017-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-21 2017-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-20 2017-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-19 2017-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-18 2017-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-17 2017-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-16 2017-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-14 2017-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-13 2017-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-12 2017-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-11 2017-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-10 2017-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-09 2017-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-08 2017-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-07 2017-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-06 2017-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-05 2017-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-04 2017-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-03 2017-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-02 2017-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-04-01 2017-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-31 2017-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-30 2017-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-29 2017-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-28 2017-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-27 2017-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-26 2017-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-25 2017-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-24 2017-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-23 2017-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-22 2017-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-21 2017-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-20 2017-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-19 2017-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-18 2017-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-17 2017-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-16 2017-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-15 2017-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-14 2017-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-13 2017-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-12 2017-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-11 2017-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-10 2017-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-09 2017-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-08 2017-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-07 2017-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-06 2017-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-05 2017-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-04 2017-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-03 2017-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-02 2017-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-03-01 2017-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-28 2017-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-27 2017-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-26 2017-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-25 2017-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-24 2017-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-23 2017-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-22 2017-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-21 2017-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-20 2017-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-19 2017-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-18 2017-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-17 2017-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-16 2017-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-15 2017-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-14 2017-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-13 2017-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-12 2017-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-11 2017-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-10 2017-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-09 2017-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-08 2017-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-07 2017-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-06 2017-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-05 2017-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-04 2017-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-03 2017-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-02 2017-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-02-01 2017-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-31 2017-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-30 2017-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-29 2017-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-28 2017-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-27 2017-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-26 2017-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-25 2017-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-24 2017-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-23 2017-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-22 2017-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-21 2017-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-20 2017-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-19 2017-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-18 2017-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-17 2017-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-16 2017-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-15 2017-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-14 2017-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-13 2017-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-12 2017-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-11 2017-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-10 2017-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-09 2017-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-08 2017-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-07 2017-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-06 2017-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-05 2017-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-04 2017-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-03 2017-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-02 2017-01-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_32#2017-01-01 https://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design We will streamline and integrate the delivery of services, by building a new production platform for integrated development, testing, deployment and hosting of applications. Goalhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Goal Designhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Design Development environmenthttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Development_environment Testing/building pipelinehttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Testing/building_pipeline Build configurationhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Build_configuration Step 1: Build 'test' imagehttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Step_1:_Build_'test'_image Step 2: Run image entry pointhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Step_2:_Run_image_entry_point Step 3: Build 'production' imagehttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Step_3:_Build_'production'_image Step 4: Isolated deploy and e2e testshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Step_4:_Isolated_deploy_and_e2e_tests Step 5: Push 'production' image for staging deployhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Step_5:_Push_'production'_image_for_staging_deploy Artifact Registryhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Artifact_Registry Deployment toolinghttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Deployment_tooling Configuration registryhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Configuration_registry Staging environmenthttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Staging_environment What it will behttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#What_it_will_be Mode of operationhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Mode_of_operation What it will NOT behttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#What_it_will_NOT_be Production environmenthttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Production_environment Highly Available in all manners possiblehttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Highly_Available_in_all_manners_possible Present on all primary DCs (2 currently)https://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Present_on_all_primary_DCs_(2_currently) Adequately filtering traffic between applications as well as the rest of the worldhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Adequately_filtering_traffic_between_applications_as_well_as_the_rest_of_the_world Equipped with Access Control mechanisms for configuration and deployment of applicationshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Equipped_with_Access_Control_mechanisms_for_configuration_and_deployment_of_applications Capable of high levels of inbound/outbound traffichttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Capable_of_high_levels_of_inbound/outbound_traffic Capable of load balancing traffic between various application endpointshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Capable_of_load_balancing_traffic_between_various_application_endpoints Capable of responding both automatically and manually to increases/decreases of traffichttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Capable_of_responding_both_automatically_and_manually_to_increases/decreases_of_traffic Supporting monitoring, health checkshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Supporting_monitoring,_health_checks Podshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Pods Probeshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Probes Livenesshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Liveness Readinesshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Readiness Serviceshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Services ClusterIPhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#ClusterIP NodePorthttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#NodePort Headless serviceshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Headless_services LoadBalancerhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#LoadBalancer ExternalNamehttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#ExternalName Supporting telemetry and transparent encryption for application communicationhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Supporting_telemetry_and_transparent_encryption_for_application_communication Rolling deployshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Rolling_deploys Relation to the pipelinehttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#Relation_to_the_pipeline See alsohttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design#See_also https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas/DNS The Wiki Replica servers use service names managed by the Cloud VPS Designate API to expose databases to Cloud Services users. The /usr/local/sbin/wmcs-wikireplica-dns script is used to create and update these service names. Changing the backend server for a sectionhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas/DNS#Changing_the_backend_server_for_a_section Adding a new wikidb aliashttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas/DNS#Adding_a_new_wikidb_alias See alsohttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas/DNS#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-10-01_labvirt1015 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-01_labvirt1015#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-01_labvirt1015#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-01_labvirt1015#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-01_labvirt1015#Actionables https://wikitech.wikimedia.org/wiki/Bookmarks A list of reads collected while browsing the internet, that might be of interest to TechOps. 2017-10-03https://wikitech.wikimedia.org/wiki/Bookmarks#2017-10-03 https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance How to measure and analyze frontend performance after you've started development. If you are starting a new project or otherwise have not yet set performance objectives, first read our guidance Frontend performance practices. Measure your change earlyhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Measure_your_change_early Using developer toolshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Using_developer_tools Chromehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Chrome Firefoxhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Firefox Edgehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Edge Speed testshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Speed_tests Measure using the beta clusterhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Measure_using_the_beta_cluster Measure a change that is already in productionhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_frontend_performance#Measure_a_change_that_is_already_in_production https://wikitech.wikimedia.org/wiki/Thumbor/JPEG Wikimedia JPEG thumbnailing has a number of specificities detailed here. Chroma subsamplinghttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#Chroma_subsampling qlowhttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#qlow Conditional sharpeninghttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#Conditional_sharpening EXIF processinghttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#EXIF_processing EXIF field filteringhttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#EXIF_field_filtering ICC profile substitutionhttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#ICC_profile_substitution EXIF orientationhttps://wikitech.wikimedia.org/wiki/Thumbor/JPEG#EXIF_orientation https://wikitech.wikimedia.org/wiki/Thumbor/STL == Rendering == Renderinghttps://wikitech.wikimedia.org/wiki/Thumbor/STL#Rendering Format detectionhttps://wikitech.wikimedia.org/wiki/Thumbor/STL#Format_detection https://wikitech.wikimedia.org/wiki/Thumbor/DjVu Our custom DjVu engine leverages the ddjvu utility. Like all multipage engines we have, it is used in combination with the page filter, which simply passes the requested page number to the engine. https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/10 === Week of October 2nd === Week of October 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/10#Week_of_October_2nd Week of October 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/10#Week_of_October_9th Week of October 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/10#Week_of_October_16th Week of October 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/10#Week_of_October_23rd Week of October 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/10#Week_of_October_30th https://wikitech.wikimedia.org/wiki/Thumbor/SVG Our SVG engine relies on rsvg. https://wikitech.wikimedia.org/wiki/Thumbor/GIF Our Thumbor GIF engine reuses the built-in GIF engine, with minor additions. MAX_ANIMATED_GIF_AREAhttps://wikitech.wikimedia.org/wiki/Thumbor/GIF#MAX_ANIMATED_GIF_AREA Color palettes and resizinghttps://wikitech.wikimedia.org/wiki/Thumbor/GIF#Color_palettes_and_resizing https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build {{Obsolete|reason=This scap3 build and deploy process was replaced with PipelineLib and Docker. [[[Striker] build and deploy process involves updating the [git repository and then pushing the repository out to servers running Striker via [[scap3]. Deploy directory structurehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#Deploy_directory_structure Submoduleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#Submodules labs-strikerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#labs-striker labs-striker-staticfileshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#labs-striker-staticfiles labs-striker-wheelshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#labs-striker-wheels Testing in Cloud VPS projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#Testing_in_Cloud_VPS_project Manual testshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#Manual_tests Deployhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Striker/Build#Deploy https://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline The MLR pipeline is a set of offline tools and processes used to train models for ranking search results on WMF wiki sites using CirrusSearch. Overviewhttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Overview Data preparationhttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Data_preparation Generation of query clickshttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Generation_of_query_clicks Training datahttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Training_data Grouping querieshttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Grouping_queries Samplinghttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Sampling Labels generationhttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Labels_generation Feature vectorshttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Feature_vectors Notes on the kafka workflowhttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Notes_on_the_kafka_workflow Feature Selectionhttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Feature_Selection Traininghttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Training Evaluate feature importancehttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Evaluate_feature_importance Deploy a model to productionhttps://wikitech.wikimedia.org/wiki/Search/MLR_Pipeline#Deploy_a_model_to_production https://wikitech.wikimedia.org/wiki/News/Wiki_Replica_c1_and_c3_shutdown The labsdb1001.eqiad. TL;DRhttps://wikitech.wikimedia.org/wiki/News/Wiki_Replica_c1_and_c3_shutdown#TL;DR What is changing?https://wikitech.wikimedia.org/wiki/News/Wiki_Replica_c1_and_c3_shutdown#What_is_changing? Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Wiki_Replica_c1_and_c3_shutdown#Why_are_we_doing_this? https://wikitech.wikimedia.org/wiki/Incidents/2017-10-17_webm-audio-mediatype == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-17_webm-audio-mediatype#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-17_webm-audio-mediatype#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-17_webm-audio-mediatype#Conclusions https://wikitech.wikimedia.org/wiki/Incidents/2017-10-18_wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-18_wdqs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-18_wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-18_wdqs#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-10-18_wdqs#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising The fundraising department uses the following statistics from the main wiki cluster to inform campaigns and update banners in realtime: Banner Impressionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#Banner_Impressions Kafka/Kafkatee/pgehres databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#Kafka/Kafkatee/pgehres_database Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#Hive Druid/Pivothttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#Druid/Pivot EN6C Banner History Documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#EN6C_Banner_History_Documentation Landing page impressionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#Landing_page_impressions Unique email clickshttps://wikitech.wikimedia.org/wiki/Data_Platform/Fundraising#Unique_email_clicks https://wikitech.wikimedia.org/wiki/Thumbor/Video Unlike other file formats that are solely handled by a custom engine, video is handled in Thumbor via a custom loader. This allows us to leverage ffmpeg's seeking capabilities, only fetching the frame we're interested in over the network, rather than the entire video file. https://wikitech.wikimedia.org/wiki/Thumbor/XCF Our custom XCF engine simply converts the XCF to a PNG using xcf2png and passes on the result to our default custom imagemagick engine. https://wikitech.wikimedia.org/wiki/Thumbor/PDF PDF is handled by our custom Ghostscript engine. It handles multipage support via the custom "page" filter, which simply exposes the page URL parameter to the engine. https://wikitech.wikimedia.org/wiki/Thumbor/TIFF TIFFs has 2 custom engines. The vips engine is leveraged when the TIFF is over a size limit, defined by the VIPS_ENGINE_MIN_PIXELS Thumbor configuration value. https://wikitech.wikimedia.org/wiki/Thumbor/PNG PNG is handled by our default custom Imagemagick engine. The only special treatment for PNG is the override of the quality value, because the -quality parameter in Imagemagick means something different for PNG (compression strategy rather than image quality). https://wikitech.wikimedia.org/wiki/HTTPS/Unified_Certificates These are the primary multi-wildcard-SAN certificates that not only serve our Traffic clusters but also serve other Wikimedia functions such as Fundraising. They have a number of unique properties operationally: Certificate Vendor Deployment and Switching on Failurehttps://wikitech.wikimedia.org/wiki/HTTPS/Unified_Certificates#Certificate_Vendor_Deployment_and_Switching_on_Failure Validationhttps://wikitech.wikimedia.org/wiki/HTTPS/Unified_Certificates#Validation See alsohttps://wikitech.wikimedia.org/wiki/HTTPS/Unified_Certificates#See_also https://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor The Wikidata Concepts Monitor (WDCM) is a system that analyzes and visualizes Wikidata usage across the Wikimedia projects Wikidata Project Page]|WDCM Dashboards|Gerrit|[is developed and maintained (mainly) by [[User:GoranSMilovanovic|Goran S. Milovanovic, Data Scientist, WMDE]; any suggestions, contributions, and questions are welcome and should be directed to him. Introductionhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Introduction General Approach to the Study of Wikidata usagehttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#General_Approach_to_the_Study_of_Wikidata_usage Wikidata usage patternshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Wikidata_usage_patterns The variety of usage patternshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#The_variety_of_usage_patterns Motivationhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Motivation Definitionshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Definitions Wikidata usagehttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Wikidata_usage Wikidata usage analyticshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Wikidata_usage_analytics Wikidata usage (statistics)https://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Wikidata_usage_(statistics) [AN IMPORTANT] NOTE on the Wikidata usage definitionhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#[AN_IMPORTANT]_NOTE_on_the_Wikidata_usage_definition WDCM Taxonomyhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_Taxonomy WDCM Data Modelhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_Data_Model HDFS, Big Data component (Production)https://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#HDFS,_Big_Data_component_(Production) wdcm_clients_wb_entity_usagehttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#wdcm_clients_wb_entity_usage Cloud VPS Instance Local Data Component/Public Datasetshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Cloud_VPS_Instance_Local_Data_Component/Public_Datasets WDCM System Operation Workflowhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_System_Operation_Workflow WDCM Dashboardshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_Dashboards List of WDCM Dashboardshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#List_of_WDCM_Dashboards WDCM (S)itelinks Dashboardhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_(S)itelinks_Dashboard Dashboard Update Engine: schedule, wrangling, and modeling procedureshttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Dashboard_Update_Engine:_schedule,_wrangling,_and_modeling_procedures Dashboard Functionalityhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#Dashboard_Functionality WDCM (T)titles Dashboardhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_(T)titles_Dashboard WDCM Code Repositoryhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_Code_Repository WDCM Puppetizationhttps://wikitech.wikimedia.org/wiki/Wikidata_Concepts_Monitor#WDCM_Puppetization https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities Talking Puppet, Hiera, Openstack and process Meeting Agendahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities#Meeting_Agenda Old universehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities#Old_universe Generalhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities#General Upstream to us Stylehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities#Upstream_to_us_Style To Be Donehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities#To_Be_Done Moving forwardhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Puppet_Possibilities#Moving_forward https://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey The [Toolforge Survey|Annual Toolforge Survey] is conducted once per year to help the [Cloud Services team|Wikimedia Cloud Services team] get a sense of how their efforts to support Wikimedia technical contributors are being received. Results of the survey are [Toolforge Survey|published on metawiki]. See alsohttps://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey#See_also https://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/Opt_out The [Services Annual Survey|Cloud Services Annual Survey] is conducted once per year to help the [Cloud Services team|Wikimedia Cloud Services team] get a sense of how their efforts to support Wikimedia technical contributors are being received. Announcements of each iteration of the survey are [via email] to Toolforge users and Cloud VPS project admins who: Toolforge survey email opt-out listhttps://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/Opt_out#Toolforge_survey_email_opt-out_list https://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Introduction Kubernetes clusterhttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Kubernetes_cluster Deploymenthttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Deployment Architecturehttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Architecture Current Setuphttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Current_Setup Jupyterhub deploymenthttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Jupyterhub_deployment Jupyterhub & PAWS Componentshttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Jupyterhub_&_PAWS_Components Databasehttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Database Moving to sqlitehttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin#Moving_to_sqlite https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component It is expected for the Wikistats 2 team to start development of a map component similar in features and functionality to [Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Background Differences between WiViVi and Wikistats 2's maphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Differences_between_WiViVi_and_Wikistats_2's_map Scopehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Scope Wikiproject breadthhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Wikiproject_breadth Backend constraintshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Backend_constraints UI optionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#UI_options Option A: Adding a new Reading metric, called Pageviews by Countryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Option_A:_Adding_a_new_Reading_metric,_called_Pageviews_by_Country Option B: Including the map view in the current Pageviews metrichttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Option_B:_Including_the_map_view_in_the_current_Pageviews_metric Option C: Adding a new map section to Wikistatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Option_C:_Adding_a_new_map_section_to_Wikistats Data optionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Data_options Option A: Tops endpointhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Option_A:_Tops_endpoint Option B: Timeserieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Option_B:_Timeseries Option C: Tileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Map_Component#Option_C:_Tiles https://wikitech.wikimedia.org/wiki/Deployments/Blocking_tasks Each version of MediaWiki that is deployed to Wikimedia's production clusters should have a corresponding task in Phabricator. When a release-critical issue is discovered and reported in Phabricator, it should be added as a subtask under the blocker task for the most current or any other affected versions. Maintaining the blocking taskshttps://wikitech.wikimedia.org/wiki/Deployments/Blocking_tasks#Maintaining_the_blocking_tasks Limitationshttps://wikitech.wikimedia.org/wiki/Deployments/Blocking_tasks#Limitations Install requirementshttps://wikitech.wikimedia.org/wiki/Deployments/Blocking_tasks#Install_requirements See Alsohttps://wikitech.wikimedia.org/wiki/Deployments/Blocking_tasks#See_Also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/11 === Week of November 6th === Week of November 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/11#Week_of_November_6th Week of November 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/11#Week_of_November_13th Week of November 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/11#Week_of_November_20th https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas This page holds most of the knowledge we have regarding Wiki Replicas for admins. Service architecture by layershttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Service_architecture_by_layers From production to Wiki Replicashttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#From_production_to_Wiki_Replicas Physical database server layerhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Physical_database_server_layer Web (realtime workloads)https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Web_(realtime_workloads) Analytics (long-processing workloads)https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Analytics_(long-processing_workloads) DB layerhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#DB_layer Proxy layerhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Proxy_layer DNShttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#DNS Updating the DNS configurationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Updating_the_DNS_configuration Account management (maintain-dbusers)https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Account_management_(maintain-dbusers) populate_new_accountshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#populate_new_accounts create_accountshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#create_accounts Who admins whathttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Who_admins_what Admin guidehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Admin_guide Adding a wikihttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Adding_a_wiki User connection limitshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#User_connection_limits De-pooling Replica Servershttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#De-pooling_Replica_Servers Updating viewshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Updating_views Update a wiki's sectionhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Update_a_wiki's_section Historyhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#History See alsohttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Interlanguage = Inter-language Datasets = Inter-language Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Interlanguage#Inter-language_Datasets Interlanguage Navigationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Interlanguage#Interlanguage_Navigation See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Interlanguage#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-11-16_s5-dewiki-wikidata == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-16_s5-dewiki-wikidata#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-16_s5-dewiki-wikidata#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-16_s5-dewiki-wikidata#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-16_s5-dewiki-wikidata#Actionables https://wikitech.wikimedia.org/wiki/SIGDOCS https://wikitech.wikimedia.org/wiki/Incidents/2017-11-20_Ext:ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-20_Ext:ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-20_Ext:ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-20_Ext:ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-20_Ext:ORES#Actionables Relatedhttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-20_Ext:ORES#Related https://wikitech.wikimedia.org/wiki/Incidents/2017-11-25_statsd == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-25_statsd#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-25_statsd#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-25_statsd#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-25_statsd#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors This is a private dataset that shows, in aggregate, what countries editors edit from. It is available only on the private cluster for now as we work out how to publish it for broader use. Aggregated datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Aggregated_data Geoeditors Monthlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Geoeditors_Monthly Geoeditors Edits Monthlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Geoeditors_Edits_Monthly Unique Editors By Country Monthlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Unique_Editors_By_Country_Monthly Archived report: Geoeditors edits yearlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Archived_report:_Geoeditors_edits_yearly Public bucketed versionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Public_bucketed_version Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Access Raw datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Raw_data Editors dailyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Editors_daily wmf_raw.mediawiki_private_cu_changeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#wmf_raw.mediawiki_private_cu_changes Changes and known problems since 2019-09https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Changes_and_known_problems_since_2019-09 Data loss 2017https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Data_loss_2017 Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors#Notes https://wikitech.wikimedia.org/wiki/Eqsin_data_center eqsin (pronounced eh-cue-sin, or the Singapore DC) is a caching data center located at Equinix's] SG3 data center in [Further reading == Further readinghttps://wikitech.wikimedia.org/wiki/Eqsin_data_center#Further_reading See alsohttps://wikitech.wikimedia.org/wiki/Eqsin_data_center#See_also https://wikitech.wikimedia.org/wiki/Incidents/2017-11-30_wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-30_wdqs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-30_wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-30_wdqs#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-30_wdqs#Actionables https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service Wikidata Query Service is the Wikimedia implementation of SPARQL server, based on the Blazegraph engine, to service queries for Wikidata and other data sets. Please see more detailed description in the [query service/User Manual|User Manual]. Development environmenthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Development_environment Codehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Code Buildhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Build Build Blazegraphhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Build_Blazegraph Administrationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Administration Hardwarehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Hardware Monitoringhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Monitoring I've got a new WDQS host, how do I get it ready for production?https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#I've_got_a_new_WDQS_host,_how_do_I_get_it_ready_for_production? Create and Commit Puppet codehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Create_and_Commit_Puppet_code Apply puppet role (Puppet patch 1)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Apply_puppet_role_(Puppet_patch_1) Suppress Alerts (Puppet patch 2)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Suppress_Alerts_(Puppet_patch_2) Manual Steps (Likely to Change Frequently)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Manual_Steps_(Likely_to_Change_Frequently) Application Deploymenthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Application_Deployment Sourceshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Sources Labs Deploymenthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Labs_Deployment Production Deploymenthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Production_Deployment Initial Preparationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Initial_Preparation Further required preparationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Further_required_preparation The actual code deployhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#The_actual_code_deploy Post code-deploy operational stepshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Post_code-deploy_operational_steps GUI deployment general noteshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#GUI_deployment_general_notes Data reload procedure (SRE-level access required)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Data_reload_procedure_(SRE-level_access_required) Warninghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Warning Reloadinghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Reloading Ensure clouddumps1001.wikimedia.org is mounted via NFS on the target hosthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Ensure_clouddumps1001.wikimedia.org_is_mounted_via_NFS_on_the_target_host Run the data-reload cookbookhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Run_the_data-reload_cookbook Manual Processhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Manual_Process Data transfer procedurehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Data_transfer_procedure Updating federation allowlisthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Updating_federation_allowlist Manually updating entitieshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Manually_updating_entities Updating IDs by timeframehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Updating_IDs_by_timeframe Updating value or reference nodeshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Updating_value_or_reference_nodes Notes about running the service on non-WMF infrastructurehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Notes_about_running_the_service_on_non-WMF_infrastructure runUpdate.sh optionshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#runUpdate.sh_options LDF (Linked Data Fragments) endpointhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#LDF_(Linked_Data_Fragments)_endpoint Issueshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Issues Known limitationshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Known_limitations Scaling strategyhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Scaling_strategy Contactshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service#Contacts https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage This page lists uses of Wikidata Query Service inside Wikimedia Foundation projects. Any change to the service should account for these services' existence and requirements. Example: Goat locator servicehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Example:_Goat_locator_service Extensionshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Extensions WikibaseQualityConstraintshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#WikibaseQualityConstraints Deepcat searchhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Deepcat_search Serviceshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Services Recommendation APIhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Recommendation_API Gadgets and user scriptshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Gadgets_and_user_scripts HarvestLabelhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#HarvestLabel wdcat.jshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#wdcat.js Mobile appshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Mobile_apps Finding nearby places in Commons mobile apphttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Finding_nearby_places_in_Commons_mobile_app Web appshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Usage#Web_apps https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2 https://wikitech.wikimedia.org/wiki/Performance/Alerts == Alerts in Grafana == Alerts in Grafanahttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Alerts_in_Grafana Historyhttps://wikitech.wikimedia.org/wiki/Performance/Alerts#History Finding regressionshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Finding_regressions Current setuphttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Current_setup Alertshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Alerts WebPageReplayhttps://wikitech.wikimedia.org/wiki/Performance/Alerts#WebPageReplay Direct synthetic testshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Direct_synthetic_tests Navigation Timinghttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Navigation_Timing Synthetic tools status alertshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Synthetic_tools_status_alerts Save Timingshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Save_Timings JavaScript and CSS increasehttps://wikitech.wikimedia.org/wiki/Performance/Alerts#JavaScript_and_CSS_increase Known problemshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Known_problems Self healing alertshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Self_healing_alerts Known non working querieshttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Known_non_working_queries Creating an alerthttps://wikitech.wikimedia.org/wiki/Performance/Alerts#Creating_an_alert https://wikitech.wikimedia.org/wiki/WebPageReplay == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/WebPageReplay#Background Replaying vs non replayinghttps://wikitech.wikimedia.org/wiki/WebPageReplay#Replaying_vs_non_replaying WebPageReplay setuphttps://wikitech.wikimedia.org/wiki/WebPageReplay#WebPageReplay_setup Servershttps://wikitech.wikimedia.org/wiki/WebPageReplay#Servers Upgrade to a new versionhttps://wikitech.wikimedia.org/wiki/WebPageReplay#Upgrade_to_a_new_version Alertshttps://wikitech.wikimedia.org/wiki/WebPageReplay#Alerts Maintenancehttps://wikitech.wikimedia.org/wiki/WebPageReplay#Maintenance Debug missing metricshttps://wikitech.wikimedia.org/wiki/WebPageReplay#Debug_missing_metrics See alsohttps://wikitech.wikimedia.org/wiki/WebPageReplay#See_also https://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts ==XML Dumpsdata hosts== XML Dumpsdata hostshttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#XML_Dumpsdata_hosts Hardwarehttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#Hardware Serviceshttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#Services Deploying a new hosthttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#Deploying_a_new_host Now done by dc ops!https://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#Now_done_by_dc_ops! Doing the actual swap in of a spare dumpsdata host for a live onehttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#Doing_the_actual_swap_in_of_a_spare_dumpsdata_host_for_a_live_one The puppet patch to swap in a new hosthttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#The_puppet_patch_to_swap_in_a_new_host Reimaging an old hosthttps://wikitech.wikimedia.org/wiki/Dumps/Dumpsdata_hosts#Reimaging_an_old_host https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12 === Week of November 27th === Week of November 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12#Week_of_November_27th Week of December 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12#Week_of_December_4th Week of December 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12#Week_of_December_11th Week of December 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12#Week_of_December_18th Week of December 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12#Week_of_December_25th https://wikitech.wikimedia.org/wiki/Cergen cergen is a Python command line tool and library to help with managing and generating asymmetric key pairs and x509 certificates for use with TLS/SSL encryption and authentication. Usage on Puppet CA hosthttps://wikitech.wikimedia.org/wiki/Cergen#Usage_on_Puppet_CA_host Cheatsheethttps://wikitech.wikimedia.org/wiki/Cergen#Cheatsheet Update a certificatehttps://wikitech.wikimedia.org/wiki/Cergen#Update_a_certificate Distribution via Puppethttps://wikitech.wikimedia.org/wiki/Cergen#Distribution_via_Puppet Future workhttps://wikitech.wikimedia.org/wiki/Cergen#Future_work Migrating a service based on Envoy to CFSSLhttps://wikitech.wikimedia.org/wiki/Cergen#Migrating_a_service_based_on_Envoy_to_CFSSL Gather the list of alt_names for the new certificatehttps://wikitech.wikimedia.org/wiki/Cergen#Gather_the_list_of_alt_names_for_the_new_certificate Generating the new certificateshttps://wikitech.wikimedia.org/wiki/Cergen#Generating_the_new_certificates https://wikitech.wikimedia.org/wiki/Incidents/2017-11-28_ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-28_ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-28_ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-28_ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2017-11-28_ORES#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/Data_Quality/VettingPerProject In this page we present data quality checks we've made for AQS-Wikistats. 8 most viewed Wikipedias: English, Russian, German, Spanish, Japanese, French, Chinese and Italianhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/Data_Quality/VettingPerProject#8_most_viewed_Wikipedias:_English,_Russian,_German,_Spanish,_Japanese,_French,_Chinese_and_Italian Other special big wiki projects: Wikidata and Commonshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/Data_Quality/VettingPerProject#Other_special_big_wiki_projects:_Wikidata_and_Commons A small Wikipedia project: Tibetan Wikipediahttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/Data_Quality/VettingPerProject#A_small_Wikipedia_project:_Tibetan_Wikipedia Other thingshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/Data_Quality/VettingPerProject#Other_things https://wikitech.wikimedia.org/wiki/Blubber 300px|frameless|center|middle Developershttps://wikitech.wikimedia.org/wiki/Blubber#Developers https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes == Post Mortem Meeting for train blocker - 20171120-Ext:ORES == Post Mortem Meeting for train blocker - 20171120-Ext:OREShttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Post_Mortem_Meeting_for_train_blocker_-_20171120-Ext:ORES Meeting Date:https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Meeting_Date: Attendees:https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Attendees: For reference:https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#For_reference: Main Taskhttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Main_Task Related Taskshttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Related_Tasks Resulting Taskshttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Resulting_Tasks Topics:https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Topics: Brief Summary of Problem(s)https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Brief_Summary_of_Problem(s) How problem(s) was/were discovered?https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#How_problem(s)_was/were_discovered? How problem(s) were introduced?https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#How_problem(s)_were_introduced? What was learned?https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#What_was_learned? How could problem(s) could have been avoidedhttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#How_could_problem(s)_could_have_been_avoided How could we detect this kind of problem before train/deploymenthttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#How_could_we_detect_this_kind_of_problem_before_train/deployment What changes have been put in place or are planned to avoid similar scenario in future deployments.https://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#What_changes_have_been_put_in_place_or_are_planned_to_avoid_similar_scenario_in_future_deployments. Action Itemshttps://wikitech.wikimedia.org/wiki/Incidents/20171120-Ext:ORES/minutes#Action_Items https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats/Traffic Wikistats 1 consists of two almost independent clusters of data and scripts. Process flow for Wikistats 1, traffic reportshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats/Traffic#Process_flow_for_Wikistats_1,_traffic_reports https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews/Pageviews_per_project This page documents the implications and decisions taken regarding user privacy in the Pageviews by country data set. Is Pageviews per project privacy sensitive?https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews/Pageviews_per_project#Is_Pageviews_per_project_privacy_sensitive? Monthly granularityhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews/Pageviews_per_project#Monthly_granularity K-anonymizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews/Pageviews_per_project#K-anonymization Bucketshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews/Pageviews_per_project#Buckets Final data sethttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Pageviews/Pageviews_per_project#Final_data_set https://wikitech.wikimedia.org/wiki/Reading_List_Service The Reading List Service is the combination of a few proxy endpoints in RESTBase and a MediaWiki extension. See [for the non-Wikimedia-specific bits. Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue Job queue based on Apache Kafka is a new backend transport and scheduler implementation for the [queue|MediaWiki JobQueue] based on the [extension] and WMF's Event Platform, the [propagation|Change-Propagation service] and Apache Kafka. Architecture overviewhttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Architecture_overview Monitoringhttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Monitoring Logshttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Logs Graphshttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Graphs Scriptshttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Scripts Tips and trickshttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Tips_and_tricks Miscellaneoushttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Miscellaneous Debugginghttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Debugging Multi-DC supporthttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#Multi-DC_support See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_JobQueue#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ This page aims to document the reasons why metrics might differ among legacy wikistats (http://stats.wikimedia. How does data differ among wikistats 1 and wikistats 2https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#How_does_data_differ_among_wikistats_1_and_wikistats_2 Why are pageviews numbers sometimes 0 and sometimes undefined?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Why_are_pageviews_numbers_sometimes_0_and_sometimes_undefined? Does active editor metrics include contributors that were blocked and whose contributions were deleted ?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Does_active_editor_metrics_include_contributors_that_were_blocked_and_whose_contributions_were_deleted_? Pages created: numbers for project X do not match with data on legacy wikistats, those numbers are lowerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Pages_created:_numbers_for_project_X_do_not_match_with_data_on_legacy_wikistats,_those_numbers_are_lower Total number of pages created as reported by Wikistats 2 is less than the total number of pages on projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Total_number_of_pages_created_as_reported_by_Wikistats_2_is_less_than_the_total_number_of_pages_on_project You can't combine two or more splits and filtershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#You_can't_combine_two_or_more_splits_and_filters Are splits always exclusivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Are_splits_always_exclusive How do we count anonymous usershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#How_do_we_count_anonymous_users Wikistats is Primarily for the Communityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Wikistats_is_Primarily_for_the_Community Why do pageviews API endpoints serve fresh data but edit API endpoints serve monthly datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Why_do_pageviews_API_endpoints_serve_fresh_data_but_edit_API_endpoints_serve_monthly_data How does Wikistats handle deleted and restored pageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#How_does_Wikistats_handle_deleted_and_restored_pages Editors metric has changed from April 2019https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#Editors_metric_has_changed_from_April_2019 The wiki I am interested on does not appear on the drop down menuhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Metrics/FAQ#The_wiki_I_am_interested_on_does_not_appear_on_the_drop_down_menu https://wikitech.wikimedia.org/wiki/Data_Platform/Web_publication This page describes how to make Tier 3: Low Risk (or Tier 2: Medium Risk and sanitized) datasets, notebooks, or other research products public on the web in the analytics.wikimedia. Instructionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Web_publication#Instructions https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/Metrics_Definition https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations This page describes some standard admin procedures and operations for our Cloud VPS deployments. Manual routing failoverhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#Manual_routing_failover Remove hypervisorhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#Remove_hypervisor VM/Hypervisor pinninghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#VM/Hypervisor_pinning Canary VM instance in every hypervisorhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#Canary_VM_instance_in_every_hypervisor Updating openstack database passwordhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#Updating_openstack_database_password novahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#nova neutronhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#neutron glancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#glance designatehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#designate keystonehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#keystone Rotating or revoking keystone fernet tokenshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#Rotating_or_revoking_keystone_fernet_tokens Fixing nova VM wrong statehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#Fixing_nova_VM_wrong_state cloudvirt reboothttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#cloudvirt_reboot See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Procedures_and_operations#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response https://phabricator.wikimedia. Summaryhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Summary Preparationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Preparation Commandshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Commands Guest updates: We know what to upgrade to for each distro and believe performance will be survivablehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Guest_updates:_We_know_what_to_upgrade_to_for_each_distro_and_believe_performance_will_be_survivable Question!https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Question! PIlot in Toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#PIlot_in_Toolforge First canaries from 1001-1009 (pcid) and 1010-1019 (pcid and invpcid) (both should have headroom)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#First_canaries_from_1001-1009_(pcid)_and_1010-1019_(pcid_and_invpcid)_(both_should_have_headroom) Rollout to all guestshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Rollout_to_all_guests Labvirts: At this point all guests are pending a kernel upgrade post reboot along w/ the labvirtshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Labvirts:_At_this_point_all_guests_are_pending_a_kernel_upgrade_post_reboot_along_w/_the_labvirts Remaining Main deployment labvirt poolhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Remaining_Main_deployment_labvirt_pool Post: at his point all guests and labvirts are rebooted with new kernelshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Post:_at_his_point_all_guests_and_labvirts_are_rebooted_with_new_kernels Checks for Arturo on Monday 15thhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Meltdown_Response#Checks_for_Arturo_on_Monday_15th https://wikitech.wikimedia.org/wiki/Postgres PostgreSQL is used for specific services in the foundation's infrastructure. Currently Maps, Netbox, Airflow and PuppetDB use Postgres to store data. Monitoringhttps://wikitech.wikimedia.org/wiki/Postgres#Monitoring Syncing Postgres replicahttps://wikitech.wikimedia.org/wiki/Postgres#Syncing_Postgres_replica POSTGRES_HOT_STANDBY_DELAYhttps://wikitech.wikimedia.org/wiki/Postgres#POSTGRES_HOT_STANDBY_DELAY Dashboardshttps://wikitech.wikimedia.org/wiki/Postgres#Dashboards https://wikitech.wikimedia.org/wiki/Incidents/2018-01-10_swift == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-10_swift#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-10_swift#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-10_swift#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-10_swift#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018#By_month https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/01 === Week of January 1st === Week of January 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/01#Week_of_January_1st Week of January 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/01#Week_of_January_8th Week of January 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/01#Week_of_January_15th Week of January 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/01#Week_of_January_22nd Week of January 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/01#Week_of_January_29th https://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics This page is Best Practices for Documenting Graphite Metricshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#Best_Practices_for_Documenting_Graphite_Metrics Best practices [Section to be expaned]https://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#Best_practices_[Section_to_be_expaned] Dashboard Feature Templatehttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#Dashboard_Feature_Template WMDE Grafana Dashboardshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#WMDE_Grafana_Dashboards Mediawiki TwoColConflicthttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#Mediawiki_TwoColConflict Dashboard Descriptionhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#Dashboard_Description Grafana Componentshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/WMDE_Anayltics_Graphite_Metrics#Grafana_Components https://wikitech.wikimedia.org/wiki/Incidents/2018-01-11_LegacyEncoding == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-11_LegacyEncoding#Summary Analysishttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-11_LegacyEncoding#Analysis Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-11_LegacyEncoding#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-11_LegacyEncoding#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-11_LegacyEncoding#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/EventCapsule This page will document EventLogging's EventCapsule, a wrapper that stores meta information about EventLogging events. The EventCapsule is stored in the EventLogging source code in eventlogging/capsule. Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems https://wikitech.wikimedia.org/wiki/Incidents/2018-01-29_MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-29_MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-29_MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-29_MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-01-29_MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests ==LDAP access== LDAP accesshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#LDAP_access Checklisthttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Checklist WMF Grouphttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#WMF_Group NDA Grouphttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#NDA_Group WMDE Grouphttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#WMDE_Group Analytics Groupshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Analytics_Groups analytics-privatedata-usershttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#analytics-privatedata-users Other groupshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Other_groups Create/Get LDAP accounthttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Create/Get_LDAP_account Update data.yamlhttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Update_data.yaml Modify LDAP groupshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Modify_LDAP_groups Production shell accesshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Production_shell_access Check listhttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Check_list Deployment Groupshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Deployment_Groups Creating new shell usershttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Creating_new_shell_users Renaming shell usershttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Renaming_shell_users IRC channel accesshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#IRC_channel_access Check on a Phabricator userhttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Check_on_a_Phabricator_user Google & Bing search console accesshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Google_&_Bing_search_console_access Verifying WMF developer accountshttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Verifying_WMF_developer_accounts Backgroundhttps://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#Background https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine Refine is a Spark job that 'refines' arbitrary datasets into Parquet backed Hive tables. It passes over the incoming dataset, creates or alters a Hive table to match the dataset based on its schema, and then inserts the data into the Hive table. Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Administration logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#logs Failed jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Failed_jobs Check if the schema is inactivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Check_if_the_schema_is_inactive Rerunning jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Rerunning_jobs Rerunning a Refine job that has a malformed or corrupt recordshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Rerunning_a_Refine_job_that_has_a_malformed_or_corrupt_records Running Refine in local or yarn client modehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Running_Refine_in_local_or_yarn_client_mode Rerunning a specific Refine jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Rerunning_a_specific_Refine_job See data that might have failedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#See_data_that_might_have_failed Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Refine#Troubleshooting https://wikitech.wikimedia.org/wiki/Incidents/2018-02-06_Phabricator == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-06_Phabricator#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-06_Phabricator#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-06_Phabricator#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-06_Phabricator#Actionables https://wikitech.wikimedia.org/wiki/Analytics/Archive/Alexa Meeting notes Alexa usage of Wikipediahttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Alexa#Alexa_usage_of_Wikipedia Wikipedia servicehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Alexa#Wikipedia_service Fact servicehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Alexa#Fact_service APIhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Alexa#API https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/02 === Week of February 5th === Week of February 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/02#Week_of_February_5th Week of February 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/02#Week_of_February_12th Week of February 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/02#Week_of_February_19th Week of February 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/02#Week_of_February_26th https://wikitech.wikimedia.org/wiki/Incidents/2018-02-14_labvirt1008-failure == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-14_labvirt1008-failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-14_labvirt1008-failure#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-14_labvirt1008-failure#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-14_labvirt1008-failure#Actionables https://wikitech.wikimedia.org/wiki/SRE_Onboarding This documentation has been folded into the org-wide onboarding templates on Office Wiki: https://office.wikimedia. https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Overview Complete list of nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Complete_list_of_nodes Purpose of nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Purpose_of_nodes Bastion nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Bastion_nodes Kubernetes nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Kubernetes_nodes Web nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Web_nodes Docker registry and harborhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Docker_registry_and_harbor Elasticsearch nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Elasticsearch_nodes checker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#checker_nodes misc nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#misc_nodes Canary nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#Canary_nodes See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Nodes#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-02-20_thumbor Thumbor was unavailable for a brief period of time following a configuration deployment. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-20_thumbor#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-20_thumbor#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-20_thumbor#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-20_thumbor#Actionables https://wikitech.wikimedia.org/wiki/Gerrit/NewUser Welcome! You can now login to Gerrit. https://wikitech.wikimedia.org/wiki/WebPageTest/UpdateToLinux === Background === Backgroundhttps://wikitech.wikimedia.org/wiki/WebPageTest/UpdateToLinux#Background Statushttps://wikitech.wikimedia.org/wiki/WebPageTest/UpdateToLinux#Status Timeplanhttps://wikitech.wikimedia.org/wiki/WebPageTest/UpdateToLinux#Timeplan Known issueshttps://wikitech.wikimedia.org/wiki/WebPageTest/UpdateToLinux#Known_issues Migrating your WebPageTest Grafana dashboardshttps://wikitech.wikimedia.org/wiki/WebPageTest/UpdateToLinux#Migrating_your_WebPageTest_Grafana_dashboards https://wikitech.wikimedia.org/wiki/Incidents/20180222-wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20180222-wdqs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20180222-wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20180222-wdqs#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20180222-wdqs#Actionables https://wikitech.wikimedia.org/wiki/Apt-upgrade The [| apt-upgrade script] is a custom tool that can be used to know which suite/channel/repo have pending package upgrades and also to perform the actual upgrade. FAQhttps://wikitech.wikimedia.org/wiki/Apt-upgrade#FAQ https://wikitech.wikimedia.org/wiki/Incidents/2018-02-26_WikibaseQualityConstraints == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-26_WikibaseQualityConstraints#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-26_WikibaseQualityConstraints#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-26_WikibaseQualityConstraints#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-26_WikibaseQualityConstraints#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-02-28_puppetmaster == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-28_puppetmaster#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-28_puppetmaster#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-28_puppetmaster#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-28_puppetmaster#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Alerts See Wikimedia_Cloud_Services_team/Alerts https://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin/Chico%27s_notes == Notes on setting up a PAWS staging env in toolsbeta VPS project (T188428)== Notes on setting up a PAWS staging env in toolsbeta VPS project (T188428)https://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin/Chico%27s_notes#Notes_on_setting_up_a_PAWS_staging_env_in_toolsbeta_VPS_project_(T188428) Notes on K8S upgrade in PAWS-betahttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin/Chico%27s_notes#Notes_on_K8S_upgrade_in_PAWS-beta cluster control planehttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin/Chico%27s_notes#cluster_control_plane Upgrade nodeshttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin/Chico%27s_notes#Upgrade_nodes k8s upgrade in PAWShttps://wikitech.wikimedia.org/wiki/PAWS/Tools/Admin/Chico%27s_notes#k8s_upgrade_in_PAWS https://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train#Timeline T188479https://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train#T188479 T188555https://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train#T188555 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-02_Train#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/03 === Week of March 5th === Week of March 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/03#Week_of_March_5th Week of March 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/03#Week_of_March_12th Week of March 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/03#Week_of_March_19th Week of March 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/03#Week_of_March_26th https://wikitech.wikimedia.org/wiki/Incidents/2018-03-06_MasterMergedInWMFBranch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-06_MasterMergedInWMFBranch#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-06_MasterMergedInWMFBranch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-06_MasterMergedInWMFBranch#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-06_MasterMergedInWMFBranch#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes == Post Mortem Meeting for train blocker - 20180111-LegacyEncoding == Post Mortem Meeting for train blocker - 20180111-LegacyEncodinghttps://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes#Post_Mortem_Meeting_for_train_blocker_-_20180111-LegacyEncoding Topics:https://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes#Topics: Brief Summary of Problem(s)https://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes#Brief_Summary_of_Problem(s) How problem(s) were introduced:https://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes#How_problem(s)_were_introduced: Learnings:https://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes#Learnings: Action Items:https://wikitech.wikimedia.org/wiki/Incidents/20180111-LegacyEncoding/minutes#Action_Items: https://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig This page details how we use Etcd with MediaWiki in production at Wikimedia Foundation. For the documentation about the EtcdConfig class in MediaWiki, refer to doc. Value formathttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#Value_format Get valueshttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#Get_values Edit existing valueshttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#Edit_existing_values Add a new valuehttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#Add_a_new_value Operational guarantees and failure scenarioshttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#Operational_guarantees_and_failure_scenarios Alertinghttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#Alerting See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_and_EtcdConfig#See_also https://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert We use Grafana alerts for WebPageReplay tests to get notified of potential frontend performance regressions, based on the metrics we collect from the Browsertime and WebPageReplay infrastructure.. Metahttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert#Meta Alert setuphttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert#Alert_setup WebPageReplay alert firedhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert#WebPageReplay_alert_fired Front end performance regressionhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert#Front_end_performance_regression Browser performance regressionhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert#Browser_performance_regression Test server performance regressionhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageReplay_alert#Test_server_performance_regression https://wikitech.wikimedia.org/wiki/Incidents/20180312-Cache-text This is a draft, edit heavily please. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20180312-Cache-text#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20180312-Cache-text#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20180312-Cache-text#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20180312-Cache-text#Actionables https://wikitech.wikimedia.org/wiki/CX CX refers to "content translation". You may be looking for: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages Serviceshttps://wikitech.wikimedia.org/wiki/Category:Services https://wikitech.wikimedia.org/wiki/Creating_new_tables Follow the steps below to create a new database table. If you want to make changes to the existing database schema, use this guide instead. Preparationhttps://wikitech.wikimedia.org/wiki/Creating_new_tables#Preparation Deploymenthttps://wikitech.wikimedia.org/wiki/Creating_new_tables#Deployment Future-proofinghttps://wikitech.wikimedia.org/wiki/Creating_new_tables#Future-proofing https://wikitech.wikimedia.org/wiki/Bast1002 bast1002 was the main bastion for Eqiad. It replaced bast1001, and was in turn replaced by bast1003 per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast1002#Services https://wikitech.wikimedia.org/wiki/Git-lfs "git large file storage" or git-lfs is a tool that helps with tracking large files inside a git repository while the file content is stored outside of git. The need for such functionality is necessitated by limitations in git performance which degrades as the size of the repository grows beyond a few megabytes. git-lfs support in Gerrithttps://wikitech.wikimedia.org/wiki/Git-lfs#git-lfs_support_in_Gerrit Installing git-lfs clienthttps://wikitech.wikimedia.org/wiki/Git-lfs#Installing_git-lfs_client Setting a http password in gerrithttps://wikitech.wikimedia.org/wiki/Git-lfs#Setting_a_http_password_in_gerrit Setting lfs.url in your project's git confighttps://wikitech.wikimedia.org/wiki/Git-lfs#Setting_lfs.url_in_your_project's_git_config Git credential storehttps://wikitech.wikimedia.org/wiki/Git-lfs#Git_credential_store libsecrethttps://wikitech.wikimedia.org/wiki/Git-lfs#libsecret libgnome-keyringhttps://wikitech.wikimedia.org/wiki/Git-lfs#libgnome-keyring See alsohttps://wikitech.wikimedia.org/wiki/Git-lfs#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-03-14_ORES == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-14_ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-14_ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-14_ORES#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-03-14_ORES#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset Apache Superset enables visualizations and dashboards built from various analytics data sources. Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#Access Usage noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#Usage_notes Advanced time rangeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#Advanced_time_ranges Druid datasources vs Druid tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#Druid_datasources_vs_Druid_tables Migrate a chart to Druid tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#Migrate_a_chart_to_Druid_tables SQL Labhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#SQL_Lab Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#Administration See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset#See_also https://wikitech.wikimedia.org/wiki/Debian_installer_rescue_mode Some notes on having access to Debian installer in rescue mode in physical servers of WMF infrastructure. Option 1: interrupting autoinstallhttps://wikitech.wikimedia.org/wiki/Debian_installer_rescue_mode#Option_1:_interrupting_autoinstall Option 2: pxe-bootable rescue imagehttps://wikitech.wikimedia.org/wiki/Debian_installer_rescue_mode#Option_2:_pxe-bootable_rescue_image https://wikitech.wikimedia.org/wiki/News Cloud Services news and major change announcements Current announcementshttps://wikitech.wikimedia.org/wiki/News#Current_announcements Recently completedhttps://wikitech.wikimedia.org/wiki/News#Recently_completed Archivehttps://wikitech.wikimedia.org/wiki/News#Archive https://wikitech.wikimedia.org/wiki/Deploy1001 deploy1001 was the deployment host for Eqiad. It replaced tin, and was in turn replaced by deploy1002 ([Connecting == Connectinghttps://wikitech.wikimedia.org/wiki/Deploy1001#Connecting Serviceshttps://wikitech.wikimedia.org/wiki/Deploy1001#Services See alsohttps://wikitech.wikimedia.org/wiki/Deploy1001#See_also https://wikitech.wikimedia.org/wiki/Bast5001 bast5001 was the main bastion for Eqsin. It was replaced by bast5002 per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast5001#Services https://wikitech.wikimedia.org/wiki/Bast4002 bast4002 is a bastion for Ulsfo. Also see bast4003 and bast4001. Serviceshttps://wikitech.wikimedia.org/wiki/Bast4002#Services https://wikitech.wikimedia.org/wiki/Bast4001 base4001 is a bastion for Ulsfo. Also see bast4002. Serviceshttps://wikitech.wikimedia.org/wiki/Bast4001#Services https://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org toolhub.wikimedia. Production deploymenthttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Production_deployment Monitoringhttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Monitoring Datacenter failoverhttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Datacenter_failover How to deployhttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#How_to_deploy Testing deploymenthttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Testing_deployment Updating the demo buildhttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Updating_the_demo_build Local developmenthttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Local_development Visualizations related to Tools and Account creationhttps://wikitech.wikimedia.org/wiki/Toolhub.wikimedia.org#Visualizations_related_to_Tools_and_Account_creation https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats_2/Smoke_Testing If you're adding a new feature or performing a big change on the UI's, you should run some smoke tests manually. We generally don't automate tests directly on the rendering of the UI, except for very basic integration tests, so here's a list of actions to ensure that the site is working correctly. Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems Wikistatshttps://wikitech.wikimedia.org/wiki/Category:Wikistats https://wikitech.wikimedia.org/wiki/Incidents/2018-02-29_Train-1.31.0-wmf.27 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-29_Train-1.31.0-wmf.27#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-29_Train-1.31.0-wmf.27#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-29_Train-1.31.0-wmf.27#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-02-29_Train-1.31.0-wmf.27#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring This page describes how monitoring works as deployed and managed by the WMCS team, for both Cloud VPS and Toolforge. Monitoring for Cloud VPS metal infrastructurehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Monitoring_for_Cloud_VPS_metal_infrastructure metricsinfra: Monitoring services for Cloud VPShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#metricsinfra:_Monitoring_services_for_Cloud_VPS Metricsinfra Prometheushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Metricsinfra_Prometheus Managing scrape targetshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Managing_scrape_targets Managing alert ruleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Managing_alert_rules Metricsinfra Alertmanagerhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Metricsinfra_Alertmanager Silencing alertshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Silencing_alerts Managing notification groupshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Managing_notification_groups Managing ACLshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Managing_ACLs Managing access for project-specific Prometheus instanceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Managing_access_for_project-specific_Prometheus_instances Metricsinfra Grafanahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Metricsinfra_Grafana Managing data sourceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Managing_data_sources Monitoring for Toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Monitoring_for_Toolforge Dashboards and handy linkshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#Dashboards_and_handy_links See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Monitoring#See_also https://wikitech.wikimedia.org/wiki/Ping_offload Service status: Production Deploymenthttps://wikitech.wikimedia.org/wiki/Ping_offload#Deployment Monitoringhttps://wikitech.wikimedia.org/wiki/Ping_offload#Monitoring InAddrErrors alerthttps://wikitech.wikimedia.org/wiki/Ping_offload#InAddrErrors_alert How-tohttps://wikitech.wikimedia.org/wiki/Ping_offload#How-to Deploy a new hosthttps://wikitech.wikimedia.org/wiki/Ping_offload#Deploy_a_new_host Temporarily stop the ICMP echo redirecthttps://wikitech.wikimedia.org/wiki/Ping_offload#Temporarily_stop_the_ICMP_echo_redirect Possible improvementshttps://wikitech.wikimedia.org/wiki/Ping_offload#Possible_improvements https://wikitech.wikimedia.org/wiki/Incidents/2018-04-04_mathoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-04_mathoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-04_mathoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-04_mathoid#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-04_mathoid#Actionables Noteshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-04_mathoid#Notes https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Testing_deployment This page describes the testing deployment for Cloud VPS, which consists in an OpenStack deployment currently called codfw1dev. Infrastructurehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Testing_deployment#Infrastructure How to join this deployment for the first timehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Testing_deployment#How_to_join_this_deployment_for_the_first_time 2FA Resethttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Testing_deployment#2FA_Reset SSH accesshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Testing_deployment#SSH_access LDAPhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Testing_deployment#LDAP https://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates This is a list of templates that exist on Wikitech and which may be useful for technical documentation. (Compare with [guide/templates]. Caution and Warninghttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Caution_and_Warning Codesamplehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Codesample Collapse top and Collapse bottomhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Collapse_top_and_Collapse_bottom Collapsed contenthttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Collapsed_content Doing, Not Done, Donehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Doing,_Not_Done,_Done Drafthttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Draft Fixmehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Fixme Fixme inlinehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Fixme_inline Hiddenhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Hidden Historicalhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Historical Just a notehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Just_a_note Mergehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Merge Navigation sidebarhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Navigation_sidebar Noticehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Notice Outdatedhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Outdated Remarkhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Remark See alsohttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#See_also Staginghttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Staging Statushttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Status Linking to Gerrit, Phabricator, etchttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Linking_to_Gerrit,_Phabricator,_etc Link to Phabricatorhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Link_to_Phabricator Link to a repositoryhttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Link_to_a_repository Link to a changehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Link_to_a_change Link to a filehttps://wikitech.wikimedia.org/wiki/Wikitech_documentation_templates#Link_to_a_file https://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Deleting_a_page_on_enwiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Deleting_a_page_on_enwiki#Summary Timeline (IN UTC)https://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Deleting_a_page_on_enwiki#Timeline_(IN_UTC) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Deleting_a_page_on_enwiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Deleting_a_page_on_enwiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Routing == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Routing#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Routing#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Routing#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-10_Routing#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/04 === Week of April 2nd === Week of April 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/04#Week_of_April_2nd Week of April 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/04#Week_of_April_9th Week of April 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/04#Week_of_April_16th Week of April 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/04#Week_of_April_23rd Week of April 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/04#Week_of_April_30th https://wikitech.wikimedia.org/wiki/SMART As part of we are now exporting SMART attributes from disks installed on all physical hosts. Overviewhttps://wikitech.wikimedia.org/wiki/SMART#Overview Metricshttps://wikitech.wikimedia.org/wiki/SMART#Metrics Operationshttps://wikitech.wikimedia.org/wiki/SMART#Operations Alertshttps://wikitech.wikimedia.org/wiki/SMART#Alerts SMART not healthyhttps://wikitech.wikimedia.org/wiki/SMART#SMART_not_healthy TODOhttps://wikitech.wikimedia.org/wiki/SMART#TODO https://wikitech.wikimedia.org/wiki/Dumps/New_dumps_and_datasets == New dumps or datasets == New dumps or datasetshttps://wikitech.wikimedia.org/wiki/Dumps/New_dumps_and_datasets#New_dumps_or_datasets Adding new dumpshttps://wikitech.wikimedia.org/wiki/Dumps/New_dumps_and_datasets#Adding_new_dumps Adding new datasetshttps://wikitech.wikimedia.org/wiki/Dumps/New_dumps_and_datasets#Adding_new_datasets https://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading OpenStreetMap data is loaded with aid of the script process-osm-data.sh Access requiredhttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Access_required Resettinghttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Resetting Downloadinghttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Downloading Database checkshttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Database_checks Database setuphttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Database_setup Update bordershttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Update_borders Importing OSM datahttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Importing_OSM_data Update databasehttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Update_database Load static datahttps://wikitech.wikimedia.org/wiki/Maps/ClearTables/Loading#Load_static_data https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images Cloud VPS uses special VM images that contain all the customizations required for our environment. Buildershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Builders Building Pre-puppetized Images with wmcs-image-createhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Building_Pre-puppetized_Images_with_wmcs-image-create Legacy Build Process for Debian Stretchhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Legacy_Build_Process_for_Debian_Stretch Building with bootstrap-vzhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Building_with_bootstrap-vz Local bootstrap-vz for stretchhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Local_bootstrap-vz_for_stretch How To Testhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#How_To_Test How To Deployhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#How_To_Deploy Deleting Unused Imageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Deleting_Unused_Images Restricted imageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Restricted_images How To Deactive Obsolete Imageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#How_To_Deactive_Obsolete_Images Internalshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Internals bootstrap-vz configuration fileshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#bootstrap-vz_configuration_files First Boothttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#First_Boot Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Troubleshooting Common Issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Common_Issues How To Inspect Disk Contentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#How_To_Inspect_Disk_Contents How to fix VM disk corruptionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#How_to_fix_VM_disk_corruption Building an image from an existing VMhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#Building_an_image_from_an_existing_VM See Alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_images#See_Also https://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors {{Fixme|[describes the Geowiki system as it runs today (April 2018). For reference on the old Python geowiki system, please see: Analytics/Archive/Geowiki]. TL:DRhttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#TL:DR Comparing Data with Previous Systemhttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Comparing_Data_with_Previous_System Percent Differencehttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Percent_Difference Editors in Countryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Editors_in_Country Editors on Projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Editors_on_Project Full Notes with Scriptshttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Full_Notes_with_Scripts Migration From Previous Geowiki Systemhttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Migration_From_Previous_Geowiki_System Accessing the old Geowiki datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Accessing_the_old_Geowiki_data Differences with the original datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Differences_with_the_original_data Querying the original datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Querying_the_original_data Missing archive datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Geoeditors#Missing_archive_data https://wikitech.wikimedia.org/wiki/Incidents/2018-04-23_wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-23_wdqs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-23_wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-23_wdqs#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-04-23_wdqs#Actionables https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33 == 2017-12-30 == 2017-12-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-30 2017-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-29 2017-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-28 2017-12-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-27 2017-12-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-26 2017-12-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-24 2017-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-23 2017-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-22 2017-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-21 2017-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-20 2017-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-19 2017-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-18 2017-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-16 2017-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-15 2017-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-14 2017-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-13 2017-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-12 2017-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-11 2017-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-10 2017-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-09 2017-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-08 2017-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-07 2017-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-06 2017-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-05 2017-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-04 2017-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-03 2017-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-02 2017-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-12-01 2017-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-30 2017-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-29 2017-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-28 2017-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-27 2017-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-25 2017-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-24 2017-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-23 2017-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-22 2017-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-21 2017-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-20 2017-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-19 2017-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-18 2017-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-17 2017-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-16 2017-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-15 2017-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-14 2017-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-13 2017-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-12 2017-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-11 2017-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-10 2017-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-09 2017-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-08 2017-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-07 2017-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-06 2017-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-04 2017-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-03 2017-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-02 2017-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-11-01 2017-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-31 2017-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-30 2017-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-29 2017-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-28 2017-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-27 2017-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-26 2017-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-25 2017-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-24 2017-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-23 2017-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-21 2017-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-20 2017-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-19 2017-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-18 2017-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-17 2017-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-16 2017-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-15 2017-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-14 2017-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-13 2017-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-12 2017-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-11 2017-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-10 2017-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-09 2017-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-08 2017-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-07 2017-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-06 2017-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-05 2017-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-04 2017-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-03 2017-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-02 2017-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-10-01 2017-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-30 2017-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-29 2017-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-28 2017-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-27 2017-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-26 2017-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-25 2017-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-24 2017-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-23 2017-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-22 2017-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-21 2017-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-20 2017-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-19 2017-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-18 2017-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-17 2017-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-16 2017-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-15 2017-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-14 2017-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-13 2017-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-12 2017-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-11 2017-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-10 2017-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-09 2017-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-08 2017-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-07 2017-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-06 2017-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-05 2017-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-04 2017-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-03 2017-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-09-01 2017-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-31 2017-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-30 2017-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-29 2017-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-28 2017-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-27 2017-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-26 2017-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-25 2017-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-24 2017-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-23 2017-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-22 2017-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-21 2017-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-19 2017-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-18 2017-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-17 2017-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-16 2017-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-15 2017-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-14 2017-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-13 2017-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-12 2017-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-11 2017-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-10 2017-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-09 2017-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-08 2017-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-07 2017-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-06 2017-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-05 2017-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-04 2017-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-03 2017-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-02 2017-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_33#2017-08-01 https://wikitech.wikimedia.org/wiki/Domains The table below might be out-of-date. The canonical listing is at ... https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments This page describes the different Cloud VPS OpenStack deployments we have. A deployment is a full set of OpenStack APIs and services that can be used to host virtual machines. eqiadhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments#eqiad eqiad1https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments#eqiad1 other servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments#other_servers codfwhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments#codfw codfw1dev deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments#codfw1dev_deployment See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployments#See_also https://wikitech.wikimedia.org/wiki/Projects Projects is a generically used term in Wikimedia's documentation. It may refer to: See alsohttps://wikitech.wikimedia.org/wiki/Projects#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle This page describes how Cloud VPS projects are supposed to be created and deleted, i.e, the lifecycle. Working with projectshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Working_with_projects Requestshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Requests Creating a new projecthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Creating_a_new_project Deleting a projecthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Deleting_a_project Manage project accesshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Manage_project_access Add accesshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Add_access Remove accesshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Remove_access Modifying project quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Modifying_project_quotas Modifying the quotas with the openstack CLIhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Modifying_the_quotas_with_the_openstack_CLI Database / Trove quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#Database_/_Trove_quotas swift / S3 / radosgw / object storagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#swift_/_S3_/_radosgw_/_object_storage Historyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#History See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects_lifecycle#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/05 === Week of May 7th === Week of May 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/05#Week_of_May_7th Week of May 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/05#Week_of_May_14th Week of May 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/05#Week_of_May_21st Week of May 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/05#Week_of_May_28th https://wikitech.wikimedia.org/wiki/Incidents/2018-05-22_MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-05-22_MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-05-22_MediaWiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-05-22_MediaWiki#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-05-22_MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata == WIP == WIPhttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#WIP Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#Summary Database issuehttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#Database_issue Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#Actionables Metahttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#Meta wb_terms tablehttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#wb_terms_table short termhttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#short_term mid-termhttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#mid-term long-termhttps://wikitech.wikimedia.org/wiki/Incidents/20180524-wikidata#long-term https://wikitech.wikimedia.org/wiki/Network_design The Wikimedia Foundation operates a network made of 2 main datacenters (Ashburn, Dallas), 5 caching sites (San Francisco, Amsterdam, Singapore, Marseille, São Paulo) and 2 networking sites (Dallas, Chicago). USAhttps://wikitech.wikimedia.org/wiki/Network_design#USA Europehttps://wikitech.wikimedia.org/wiki/Network_design#Europe Asia-Pacifichttps://wikitech.wikimedia.org/wiki/Network_design#Asia-Pacific See alsohttps://wikitech.wikimedia.org/wiki/Network_design#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployment_confidence_checklist This page contains a deployment confidence checklist for Cloud VPS deployments. General networking & neutronhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployment_confidence_checklist#General_networking_&_neutron Nova & APIshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployment_confidence_checklist#Nova_&_APIs Keystonehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployment_confidence_checklist#Keystone Glancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployment_confidence_checklist#Glance See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Deployment_confidence_checklist#See_also https://wikitech.wikimedia.org/wiki/Mwlog1001 mwlog1001.eqiad. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Logginghttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Logging Servershttps://wikitech.wikimedia.org/wiki/Category:Servers Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/keystone This page contains some notes on keystone, specifically how we deployed keystone for Cloud VPS. previous and current statushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/keystone#previous_and_current_status basic deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/keystone#basic_deployment creating a shared keystonehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/keystone#creating_a_shared_keystone https://wikitech.wikimedia.org/wiki/Phabricator/Disaster_Recovery === Disaster recovery plan for phabricator.wikimedia. Disaster recovery plan for phabricator.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Phabricator/Disaster_Recovery#Disaster_recovery_plan_for_phabricator.wikimedia.org High level overviewhttps://wikitech.wikimedia.org/wiki/Phabricator/Disaster_Recovery#High_level_overview See Alsohttps://wikitech.wikimedia.org/wiki/Phabricator/Disaster_Recovery#See_Also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/06 === Week of June 4th === Week of June 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/06#Week_of_June_4th Week of June 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/06#Week_of_June_11th Week of June 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/06#Week_of_June_18th Week of June 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/06#Week_of_June_25th https://wikitech.wikimedia.org/wiki/Incidents/2018-06-06_mx == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-06_mx#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-06_mx#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-06_mx#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-06_mx#Actionables https://wikitech.wikimedia.org/wiki/Maps/Keyspace_Setup This page contains information on how to do a bunch of tasks. It leaves to other pages information on what tasks to do. Prerequisiteshttps://wikitech.wikimedia.org/wiki/Maps/Keyspace_Setup#Prerequisites Removing datahttps://wikitech.wikimedia.org/wiki/Maps/Keyspace_Setup#Removing_data Creating a keyspacehttps://wikitech.wikimedia.org/wiki/Maps/Keyspace_Setup#Creating_a_keyspace Copying tiles from an existing keyspacehttps://wikitech.wikimedia.org/wiki/Maps/Keyspace_Setup#Copying_tiles_from_an_existing_keyspace https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34 == 2018-04-30 == 2018-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-30 2018-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-29 2018-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-28 2018-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-27 2018-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-26 2018-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-25 2018-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-24 2018-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-23 2018-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-22 2018-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-21 2018-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-20 2018-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-19 2018-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-18 2018-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-17 2018-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-16 2018-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-15 2018-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-13 2018-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-12 2018-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-11 2018-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-10 2018-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-09 2018-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-07 2018-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-06 2018-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-05 2018-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-04 2018-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-03 2018-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-04-02 2018-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-31 2018-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-30 2018-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-29 2018-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-28 2018-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-27 2018-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-26 2018-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-24 2018-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-23 2018-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-22 2018-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-21 2018-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-20 2018-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-19 2018-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-17 2018-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-16 2018-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-15 2018-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-14 2018-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-13 2018-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-12 2018-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-11 2018-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-10 2018-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-09 2018-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-08 2018-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-07 2018-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-06 2018-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-05 2018-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-04 2018-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-03 2018-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-02 2018-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-03-01 2018-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-28 2018-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-27 2018-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-26 2018-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-25 2018-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-24 2018-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-23 2018-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-22 2018-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-21 2018-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-20 2018-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-19 2018-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-18 2018-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-17 2018-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-16 2018-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-15 2018-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-14 2018-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-13 2018-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-12 2018-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-11 2018-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-10 2018-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-09 2018-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-08 2018-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-07 2018-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-06 2018-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-05 2018-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-04 2018-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-03 2018-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-02 2018-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-02-01 2018-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-31 2018-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-30 2018-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-29 2018-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-28 2018-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-26 2018-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-25 2018-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-24 2018-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-23 2018-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-22 2018-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-21 2018-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-20 2018-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-19 2018-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-18 2018-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-17 2018-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-16 2018-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-15 2018-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-12 2018-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-11 2018-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-10 2018-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-09 2018-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-08 2018-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-07 2018-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-06 2018-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-05 2018-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-04 2018-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-03 2018-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-02 2018-01-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_34#2018-01-01 https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook [Query Service|Wikidata Query Service] is the Wikimedia implementation of SPARQL server, based on Blazegraph engine, to service queries for Wikidata and other data sets. This "runbook" goal is to provide short instructions of what to do in case of issue with the service. Clustershttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Clusters Main Serviceshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Main_Services Main dashboardshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Main_dashboards Known limitationshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Known_limitations Further analysishttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Further_analysis Known Remediationshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Known_Remediations Resolving blazegraph deadlockhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Resolving_blazegraph_deadlock Remediationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Remediation Identifying which nodes are operationalhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Identifying_which_nodes_are_operational Identifying Abusive Traffichttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Identifying_Abusive_Traffic Webrequest Live Method (user agent, query string, IPs, autonomous system numbers etc)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Webrequest_Live_Method_(user_agent,_query_string,_IPs,_autonomous_system_numbers_etc) Turnilohttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Turnilo Supersethttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Superset Kafkacat method (user agent)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Kafkacat_method_(user_agent) Logstash Methodhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Logstash_Method Blocking Abusive Traffichttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Blocking_Abusive_Traffic Known issueshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Known_issues Update laghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Update_lag Blazegraph deadlockhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Blazegraph_deadlock Banning the user agenthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Banning_the_user_agent Cleanuphttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Cleanup Issues with Kafka / Recent Change pollershttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Issues_with_Kafka_/_Recent_Change_pollers Timeoutshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Timeouts Throttling Implementationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Throttling_Implementation Server de-synchronizationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Server_de-synchronization Logstash Spamminghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Logstash_Spamming WDQS Updater service crashing due to memory errorhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#WDQS_Updater_service_crashing_due_to_memory_error Overload due to high edit ratehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Overload_due_to_high_edit_rate Categories update laghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Categories_update_lag Free allocators decrease rapidlyhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook#Free_allocators_decrease_rapidly https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Runbook# https://wikitech.wikimedia.org/wiki/Incidents/2018-06-25_wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-25_wdqs#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-25_wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-25_wdqs#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-25_wdqs#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-25_wdqs#Actionables https://wikitech.wikimedia.org/wiki/Tool See m:Tools. https://wikitech.wikimedia.org/wiki/Incidents/2018-06-15_phabricator-vandalism == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-15_phabricator-vandalism#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-15_phabricator-vandalism#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-15_phabricator-vandalism#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-15_phabricator-vandalism#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-06-26_LoadBalancers == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-26_LoadBalancers#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-26_LoadBalancers#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-26_LoadBalancers#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-26_LoadBalancers#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-06-28_dumps https://dumps.wikimedia. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-28_dumps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-28_dumps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-28_dumps#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-28_dumps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-06-28_dumps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-07-04_mathoid Due to operator error there was a 4 min outage of the mathoid service in codfw Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-04_mathoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-04_mathoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-04_mathoid#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-04_mathoid#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-04_mathoid#Actionables https://wikitech.wikimedia.org/wiki/Wikilabels Wikilabels is one of stand-alone services that is being used gather data from users to build AI models for ORES and it's being maintained by [Scoring Platform team|Wikimedia Scoring Platform team]. It's currently hosted on Nova_Resource:wikilabels (Cloud VPS) Technical detailshttps://wikitech.wikimedia.org/wiki/Wikilabels#Technical_details Initialize a VMhttps://wikitech.wikimedia.org/wiki/Wikilabels#Initialize_a_VM Deployment guidehttps://wikitech.wikimedia.org/wiki/Wikilabels#Deployment_guide A new labeling campaignhttps://wikitech.wikimedia.org/wiki/Wikilabels#A_new_labeling_campaign Restarting the servicehttps://wikitech.wikimedia.org/wiki/Wikilabels#Restarting_the_service Dumping and restoring or Migrating the databasehttps://wikitech.wikimedia.org/wiki/Wikilabels#Dumping_and_restoring_or_Migrating_the_database Database credentialshttps://wikitech.wikimedia.org/wiki/Wikilabels#Database_credentials Dumping datahttps://wikitech.wikimedia.org/wiki/Wikilabels#Dumping_data Restoring datahttps://wikitech.wikimedia.org/wiki/Wikilabels#Restoring_data Incidentshttps://wikitech.wikimedia.org/wiki/Wikilabels#Incidents See alsohttps://wikitech.wikimedia.org/wiki/Wikilabels#See_also https://wikitech.wikimedia.org/wiki/Mwmaint1001 mwmaint1001 was the maintenance host for Eqiad. It replaced terbium in July 2018. Connectinghttps://wikitech.wikimedia.org/wiki/Mwmaint1001#Connecting Serviceshttps://wikitech.wikimedia.org/wiki/Mwmaint1001#Services See alsohttps://wikitech.wikimedia.org/wiki/Mwmaint1001#See_also https://wikitech.wikimedia.org/wiki/Maps/ClearTables == Setup == Setuphttps://wikitech.wikimedia.org/wiki/Maps/ClearTables#Setup https://wikitech.wikimedia.org/wiki/Technical_debt/Unused_config This page reports unused configuration variables in wmf-config, as generated by [in mediawiki/tools/code-utils.git]. Reminderhttps://wikitech.wikimedia.org/wiki/Technical_debt/Unused_config#Reminder Resultshttps://wikitech.wikimedia.org/wiki/Technical_debt/Unused_config#Results https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/07 === Week of July 2nd === Week of July 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/07#Week_of_July_2nd Week of July 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/07#Week_of_July_9th Week of July 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/07#Week_of_July_16th Week of July 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/07#Week_of_July_23rd Week of July 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/07#Week_of_July_30th https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Bootstrap This page contains technical documentation about bootstrapping Openstack for our Cloud VPS infrastructure. First stepshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Bootstrap#First_steps keystonehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Bootstrap#keystone novahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Bootstrap#nova neutronhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Bootstrap#neutron See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Bootstrap#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-07-05_Eventlogging-in-Hive ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-05_Eventlogging-in-Hive#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-05_Eventlogging-in-Hive#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-05_Eventlogging-in-Hive#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-05_Eventlogging-in-Hive#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-05_Eventlogging-in-Hive#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy = Introduction = Introductionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#Introduction Policy Statementshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#Policy_Statements Host Type and Networking Requirementshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#Host_Type_and_Networking_Requirements cloudvirt*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloudvirt* cloudnet*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloudnet* cloudcontrol*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloudcontrol* cloudmetrics*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloudmetrics* cloudservices*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloudservices* cloud[lab]web*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]web* cloud[lab]store*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]store* cloud[lab]store100[45]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]store100[45] cloud[lab]store1003https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]store1003 cloud[lab]store100[67]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]store100[67] cloud[lab]store100[89]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]store100[89] cloud[lab]db* and dbproxy*https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud[lab]db*_and_dbproxy* labsdb10[09|10|11]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#labsdb10[09|10|11] dbproxy10[09|10]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#dbproxy10[09|10] labsdb100[4567]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#labsdb100[4567] cloud*-devhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network_and_Policy#cloud*-dev https://wikitech.wikimedia.org/wiki/Management_Interfaces List of troubleshooting techniques and fixes for the most common IPMI and management interfaces issues. General adviceshttps://wikitech.wikimedia.org/wiki/Management_Interfaces#General_advices How to execute remote IPMI commandshttps://wikitech.wikimedia.org/wiki/Management_Interfaces#How_to_execute_remote_IPMI_commands Looking for racadm/hpiLO commands?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Looking_for_racadm/hpiLO_commands? Serial Consolehttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Serial_Console Troubleshooting Commandshttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Troubleshooting_Commands Does IPMI work locally?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Does_IPMI_work_locally? Does IPMI work remotely?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Does_IPMI_work_remotely? If it fails very quickly:https://wikitech.wikimedia.org/wiki/Management_Interfaces#If_it_fails_very_quickly: Is remote IPMI enabled?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Is_remote_IPMI_enabled? Are IPMI permissions set correctly?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Are_IPMI_permissions_set_correctly? Did you do a reset but still getting IPMI connection failed (when using the reimage cookbook)?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Did_you_do_a_reset_but_still_getting_IPMI_connection_failed_(when_using_the_reimage_cookbook)? Is there any overriding for next boot?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Is_there_any_overriding_for_next_boot? Does IPMI work but SSH to the management console doesn't?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Does_IPMI_work_but_SSH_to_the_management_console_doesn't? Is the management password wrong?https://wikitech.wikimedia.org/wiki/Management_Interfaces#Is_the_management_password_wrong? Fix Commandshttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Fix_Commands Set the IPMI passwordhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Set_the_IPMI_password Enable remote IPMI access (over LAN) without local host accesshttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Enable_remote_IPMI_access_(over_LAN)_without_local_host_access Dellhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Dell HPhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#HP Reset the management cardhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Reset_the_management_card From the SSH consolehttps://wikitech.wikimedia.org/wiki/Management_Interfaces#From_the_SSH_console From local IPMIhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#From_local_IPMI From remote IPMIhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#From_remote_IPMI Power drain the hosthttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Power_drain_the_host Change the mgmt passwordhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Change_the_mgmt_password cookbookhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#cookbook ipmitoolhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#ipmitool user slothttps://wikitech.wikimedia.org/wiki/Management_Interfaces#user_slot running ipmitool on multiple servershttps://wikitech.wikimedia.org/wiki/Management_Interfaces#running_ipmitool_on_multiple_servers racadm (Dell)https://wikitech.wikimedia.org/wiki/Management_Interfaces#racadm_(Dell) HP ILOhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#HP_ILO tunnel to web interface (on a HP)https://wikitech.wikimedia.org/wiki/Management_Interfaces#tunnel_to_web_interface_(on_a_HP) Local IPMIhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Local_IPMI Other useful ipmitool commandshttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Other_useful_ipmitool_commands Force reboothttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Force_reboot Force PXE boothttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Force_PXE_boot Show boot parameterhttps://wikitech.wikimedia.org/wiki/Management_Interfaces#Show_boot_parameter https://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_fundraising_undeliverable_mail root@ account was mercilessly spammed by bounces from full fr-tech@ box Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_fundraising_undeliverable_mail#Summary Timeline (UTC)https://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_fundraising_undeliverable_mail#Timeline_(UTC) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_fundraising_undeliverable_mail#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_fundraising_undeliverable_mail#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Summary Timeline Ahttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Timeline_A Follow-uphttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Follow-up Timeline Bhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Timeline_B Root causehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Root_cause Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-10_MediaWiki#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Virtualpageview_hourly The wmf.virtualpageview_hourly table (available on Hive) contains aggregated data about "virtual pageviews", i. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Virtualpageview_hourly#Current_Schema Changes and known problems since March 2018https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Virtualpageview_hourly#Changes_and_known_problems_since_March_2018 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Virtualpageview_hourly#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad Work is still in progress. Backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Background Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Summary Kafka considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Kafka_considerations Eventbus considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Eventbus_considerations Mirror Maker considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Mirror_Maker_considerations EventStreams considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#EventStreams_considerations Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Conclusions Kafkahttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Kafka Eventstreamshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Eventstreams Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-11_kafka-eqiad#Actionables https://wikitech.wikimedia.org/wiki/Research/Archive ==Services and applications== Services and applicationshttps://wikitech.wikimedia.org/wiki/Research/Archive#Services_and_applications Productizationhttps://wikitech.wikimedia.org/wiki/Research/Archive#Productization WIPhttps://wikitech.wikimedia.org/wiki/Research/Archive#WIP See alsohttps://wikitech.wikimedia.org/wiki/Research/Archive#See_also https://wikitech.wikimedia.org/wiki/Data_releases This page describes the process involved in a formal open data release by the Wikimedia Research team. While the process and guidelines described on this page are not prescriptive for other teams at the Wikimedia Foundation, we encourage anyone involved in publishing static datasets for research purposes to follow these guidelines (and help us improve them). Definitionhttps://wikitech.wikimedia.org/wiki/Data_releases#Definition Processhttps://wikitech.wikimedia.org/wiki/Data_releases#Process Conduct a privacy reviewhttps://wikitech.wikimedia.org/wiki/Data_releases#Conduct_a_privacy_review Determine the appropriate licensehttps://wikitech.wikimedia.org/wiki/Data_releases#Determine_the_appropriate_license Prepare the data for publicationhttps://wikitech.wikimedia.org/wiki/Data_releases#Prepare_the_data_for_publication Upload the dataset to a serverhttps://wikitech.wikimedia.org/wiki/Data_releases#Upload_the_dataset_to_a_server Create a metadata entry for the datasethttps://wikitech.wikimedia.org/wiki/Data_releases#Create_a_metadata_entry_for_the_dataset Additional documentationhttps://wikitech.wikimedia.org/wiki/Data_releases#Additional_documentation https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId This page describes a proposal to anonymize the appInstallId field while keeping a good part of its value. Nature of appInstallIdhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId#Nature_of_appInstallId Value of appInstallIdhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId#Value_of_appInstallId Threat modelhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId#Threat_model Proposed solutionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId#Proposed_solution Pseudonymization / obfuscation: effect of hasing + salting + rotatinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId#Pseudonymization_/_obfuscation:_effect_of_hasing_+_salting_+_rotating Other considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Event_Data_retention/AppInstallId#Other_considerations https://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning == General == Generalhttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#General Establishing an Upper Boundhttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Establishing_an_Upper_Bound Preserving the ability to decommission hostshttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Preserving_the_ability_to_decommission_hosts Runwayhttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Runway Working Spacehttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Working_Space RESTBasehttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#RESTBase Cluster Dispositionhttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Cluster_Disposition Constraintshttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Constraints FY18/19https://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#FY18/19 FY19/20https://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#FY19/20 Footnoteshttps://wikitech.wikimedia.org/wiki/Cassandra/CapacityPlanning#Footnotes https://wikitech.wikimedia.org/wiki/Microsites The microsites are static sites hosted on the Ganeti infrastructure. Operationhttps://wikitech.wikimedia.org/wiki/Microsites#Operation Micrositeshttps://wikitech.wikimedia.org/wiki/Microsites#Microsites Annual Reporthttps://wikitech.wikimedia.org/wiki/Microsites#Annual_Report Bugzilla Archivehttps://wikitech.wikimedia.org/wiki/Microsites#Bugzilla_Archive Designhttps://wikitech.wikimedia.org/wiki/Microsites#Design Researchhttps://wikitech.wikimedia.org/wiki/Microsites#Research Securityhttps://wikitech.wikimedia.org/wiki/Microsites#Security Transparency Reporthttps://wikitech.wikimedia.org/wiki/Microsites#Transparency_Report Wikidata Query Service (UIs)https://wikitech.wikimedia.org/wiki/Microsites#Wikidata_Query_Service_(UIs) Other static siteshttps://wikitech.wikimedia.org/wiki/Microsites#Other_static_sites External siteshttps://wikitech.wikimedia.org/wiki/Microsites#External_sites https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_reduced This page describe the mediawiki history reduced dataset. It lives in Analytic's Hadoop cluster and in druid public cluster, and is accessible via the Hive/Beeline external table wmf. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_reduced#Schema Important Fieldshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_reduced#Important_Fields Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_reduced#Changes_and_known_problems https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_history_reduced_algorithm This page describes the algorithm we devised to generate the mediawiki_history_reduced dataset, a dataset optimized for Druid to serve Data Platform/AQS requests. Reduction and filtering optimizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_history_reduced_algorithm#Reduction_and_filtering_optimization Augmentation with pre-computed new eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_history_reduced_algorithm#Augmentation_with_pre-computed_new_events https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_History_Snapshot_Check This page describes the validation step used to check mediawiki_user_history, mediawiki_page_history and mediawiki_history and mediawiki_history_reduced datasets. Jobs organizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_History_Snapshot_Check#Jobs_organization How do we check?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_History_Snapshot_Check#How_do_we_check? Main conceptshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_History_Snapshot_Check#Main_concepts Algorithmhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_History_Snapshot_Check#Algorithm What do we check?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Mediawiki_History_Snapshot_Check#What_do_we_check? https://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#Timeline 2018-07-13 Fridayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-13_Friday 2018-07-17 Tuesdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-17_Tuesday 2018-07-18 Wednesdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-18_Wednesday 2018-07-19 Thursdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-19_Thursday 2018-07-20 Fridayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-20_Friday 2018-07-21 Saturdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-21_Saturday 2018-07-24 Tuesdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#2018-07-24_Tuesday Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#Conclusions Before wmf.13 → group0https://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#Before_wmf.13_→_group0 wmf.13 → group0https://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#wmf.13_→_group0 wmf.13 → group1https://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#wmf.13_→_group1 Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-17_Train#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#Timeline 2018-07-30 Mondayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#2018-07-30_Monday 2018-07-26 Thursdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#2018-07-26_Thursday 2018-07-25 Wednesdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#2018-07-25_Wednesday 2018-07-24 Tuesdayhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#2018-07-24_Tuesday Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#Conclusions Before wmf.14 → group0https://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#Before_wmf.14_→_group0 wmf.14 → group1https://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#wmf.14_→_group1 wmf.14 → group2https://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#wmf.14_→_group2 Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-24_Train#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Summary Eventlogging backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Eventlogging_background Kafka backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Kafka_background Python specific considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Python_specific_considerations Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-28_eventlogging#Actionables https://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup Setting up a Kartotherian/Tilerator instance in the Beta Cluster presents some difficulties due to the limited amount of storage and memory available. This page documents the process. Launch new instancehttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Launch_new_instance Download map datahttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Download_map_data Set up the Postgres databasehttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Set_up_the_Postgres_database Import data into Postgreshttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Import_data_into_Postgres Set up Cassandra usershttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Set_up_Cassandra_users Create the map data keyspacehttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Create_the_map_data_keyspace Generate tileshttps://wikitech.wikimedia.org/wiki/Maps/Beta_Cluster_setup#Generate_tiles https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#What_happens_when_a_project_is_not_marked_as_active Further clueshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#Further_clues Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#Projects_and_Instances aborrero-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#aborrero-test account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#account-creation-assistance adminhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#admin admin-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#admin-monitoring aicaptchahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#aicaptcha analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#analytics andrewtestprojecthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#andrewtestproject automation-frameworkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#automation-framework bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#bastion botshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#bots bstorm-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#bstorm-test butterflyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#butterfly catgraphhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#catgraph chicotestprojecthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#chicotestproject ci-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#ci-staging clouddb-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#clouddb-services codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#codereview codesearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#codesearch collection-alt-rendererhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#collection-alt-renderer commonsarchivehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#commonsarchive commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#commtech community-labs-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#community-labs-monitoring contintcloudhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#contintcloud contributorshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#contributors cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#cvn cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#dashiki deep-learning-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#deep-learning-services deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#deployment-prep designhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#design discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#discourse discourse-wamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#discourse-wam discovery-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#discovery-stats downloadhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#download dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#dwl etcdhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#etcd etytreehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#etytree extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#fastcci general-k8shttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#general-k8s gerrithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#gerrit getstartedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#getstarted githttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#git glampipehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#glampipe globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#google-api-proxy grantreviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#grantreview hat-imagescalershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#hat-imagescalers hhvmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#hhvm houndhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#hound hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#huggle iiabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#iiab iiifls1https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#iiifls1 incubatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#incubator integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#integration ircdhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#ircd jupyterhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#jupyter kubernetes-testinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#kubernetes-testing languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#language library-upgraderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#library-upgrader lizenzhinweisgeneratorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#lizenzhinweisgenerator logginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#logging mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#maps maps-teamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#maps-team mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#math matrixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#matrix mcr-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mcr-dev mediahandler-testshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mediahandler-tests mediawiki-dockerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mediawiki-docker mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mediawiki-vagrant mobilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mobile monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#monitoring multimediahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#multimedia mw-api-testinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mw-api-testing mw-extension-idshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mw-extension-ids mwfileimporthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mwfileimport mwfuzzhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mwfuzz mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mwoffliner mwstakehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mwstake mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#mwv-apt newsletterhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#newsletter nonfreewikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#nonfreewiki observerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#observer ogvjs-integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#ogvjs-integration openocrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#openocr openrefinehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#openrefine openstackhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#openstack orchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#orch oreshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#ores ores-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#ores-staging orighttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#orig osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#osmit otrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#otrs packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#packaging pagemigrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#pagemigration partnermetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#partnermetrics pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#paws petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#petscan phabricatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#phabricator phlogistonhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#phlogiston phragilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#phragile piwikhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#piwik planethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#planet pluggableauthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#pluggableauth privpol-captchahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#privpol-captcha project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#project-proxy project-smtphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#project-smtp puppethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#puppet puppet-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#puppet-diffs puppet3-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#puppet3-diffs qnahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#qna quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#quarry queryrapihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#queryrapi rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#rcm rdfiodevhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#rdfiodev reading-listshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#reading-lists reading-web-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#reading-web-staging recommendation-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#recommendation-api redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#redirects reportcardhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#reportcard sciencesourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#sciencesource searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#search security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#security-tools sentryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#sentry serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#services services-testbedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#services-testbed shinkenhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#shinken shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#signwriting snugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#snuggle social-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#social-tools strikerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#striker suggestbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#suggestbot swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#swift t136871https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#t136871 telnethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#telnet test-twemproxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#test-twemproxy testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#testlabs thumborhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#thumbor toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#toolsbeta toolserver-legacyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#toolserver-legacy torhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#tor traffichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#traffic twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#twl utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#utrs videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#video visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#visualeditor wcdohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wcdo wdq-mmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wdq-mm webperfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#webperf wikiapiaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikiapiary wikibase-nearest-neighborshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikibase-nearest-neighbors wikibase-registryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikibase-registry wikibrainhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikibrain wikicitevishttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikicitevis wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidata-dev wikidata-federationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidata-federation wikidata-page-bannerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidata-page-banner wikidata-primary-sources-toolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidata-primary-sources-tool wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidata-query wikidataconceptshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidataconcepts wikidiff2-wmde-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidiff2-wmde-dev wikidocumentarieshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidocumentaries wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikidumpparse wikifactminehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikifactmine wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikilabels wikimania-supporthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikimania-support wikimetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikimetrics wikisource-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikisource-tools wikispeechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikispeech wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikistats wikistreamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikistream wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikitextexp wikitolearn-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wikitolearn-dev wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wildcat wlmjudginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wlmjudging wm-bothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wm-bot wmde-dashboardshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wmde-dashboards wmf-research-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wmf-research-tools wmflabsdotorghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wmflabsdotorg wpxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#wpx xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#xtools yandex-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#yandex-proxy See alsohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-07-31_Phabricator == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-31_Phabricator#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-31_Phabricator#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-31_Phabricator#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-07-31_Phabricator#Actionables https://wikitech.wikimedia.org/wiki/Netbox Netbox is used by Wikimedia as a tool for data center infrastructure management (DCIM) and IP address management (IPAM). It also serves as an integration point for switch and port management, DNS management, and other network operations. Web UIhttps://wikitech.wikimedia.org/wiki/Netbox#Web_UI APIhttps://wikitech.wikimedia.org/wiki/Netbox#API Staginghttps://wikitech.wikimedia.org/wiki/Netbox#Staging Production infrastructurehttps://wikitech.wikimedia.org/wiki/Netbox#Production_infrastructure Monitoringhttps://wikitech.wikimedia.org/wiki/Netbox#Monitoring Icingahttps://wikitech.wikimedia.org/wiki/Netbox#Icinga Frontendshttps://wikitech.wikimedia.org/wiki/Netbox#Frontends Databaseshttps://wikitech.wikimedia.org/wiki/Netbox#Databases Prometheushttps://wikitech.wikimedia.org/wiki/Netbox#Prometheus Logstashhttps://wikitech.wikimedia.org/wiki/Netbox#Logstash Failoverhttps://wikitech.wikimedia.org/wiki/Netbox#Failover Databasehttps://wikitech.wikimedia.org/wiki/Netbox#Database Restorehttps://wikitech.wikimedia.org/wiki/Netbox#Restore PostgresSQLhttps://wikitech.wikimedia.org/wiki/Netbox#PostgresSQL Dumps backupshttps://wikitech.wikimedia.org/wiki/Netbox#Dumps_backups Stop the Netbox services before restorehttps://wikitech.wikimedia.org/wiki/Netbox#Stop_the_Netbox_services_before_restore Restore the DB dumphttps://wikitech.wikimedia.org/wiki/Netbox#Restore_the_DB_dump Start Netbox services after a restorehttps://wikitech.wikimedia.org/wiki/Netbox#Start_Netbox_services_after_a_restore Sanitizing a database dumphttps://wikitech.wikimedia.org/wiki/Netbox#Sanitizing_a_database_dump Netbox Extrashttps://wikitech.wikimedia.org/wiki/Netbox#Netbox_Extras More detailshttps://wikitech.wikimedia.org/wiki/Netbox#More_details Netbox (and source of truth) principleshttps://wikitech.wikimedia.org/wiki/Netbox#Netbox_(and_source_of_truth)_principles Netbox featureshttps://wikitech.wikimedia.org/wiki/Netbox#Netbox_features Custom Linkshttps://wikitech.wikimedia.org/wiki/Netbox#Custom_Links Reportshttps://wikitech.wikimedia.org/wiki/Netbox#Reports Report Conventionshttps://wikitech.wikimedia.org/wiki/Netbox#Report_Conventions Report Alerthttps://wikitech.wikimedia.org/wiki/Netbox#Report_Alert Custom Scriptshttps://wikitech.wikimedia.org/wiki/Netbox#Custom_Scripts Extra Errors, Notes and Procedureshttps://wikitech.wikimedia.org/wiki/Netbox#Extra_Errors,_Notes_and_Procedures Would like to remove interfacehttps://wikitech.wikimedia.org/wiki/Netbox#Would_like_to_remove_interface Error removing interface after speed changehttps://wikitech.wikimedia.org/wiki/Netbox#Error_removing_interface_after_speed_change Jobs dispatchinghttps://wikitech.wikimedia.org/wiki/Netbox#Jobs_dispatching Custom Fieldshttps://wikitech.wikimedia.org/wiki/Netbox#Custom_Fields Data sourceshttps://wikitech.wikimedia.org/wiki/Netbox#Data_sources nbshellhttps://wikitech.wikimedia.org/wiki/Netbox#nbshell Tags/ConfigContexthttps://wikitech.wikimedia.org/wiki/Netbox#Tags/ConfigContext Housekeepinghttps://wikitech.wikimedia.org/wiki/Netbox#Housekeeping Validatorshttps://wikitech.wikimedia.org/wiki/Netbox#Validators Testing validatorshttps://wikitech.wikimedia.org/wiki/Netbox#Testing_validators Journalinghttps://wikitech.wikimedia.org/wiki/Netbox#Journaling Exportshttps://wikitech.wikimedia.org/wiki/Netbox#Exports DNShttps://wikitech.wikimedia.org/wiki/Netbox#DNS Puppethttps://wikitech.wikimedia.org/wiki/Netbox#Puppet Importshttps://wikitech.wikimedia.org/wiki/Netbox#Imports Ganeti synchttps://wikitech.wikimedia.org/wiki/Netbox#Ganeti_sync External scriptshttps://wikitech.wikimedia.org/wiki/Netbox#External_scripts Pynetboxhttps://wikitech.wikimedia.org/wiki/Netbox#Pynetbox Upgrading Netboxhttps://wikitech.wikimedia.org/wiki/Netbox#Upgrading_Netbox Overviewhttps://wikitech.wikimedia.org/wiki/Netbox#Overview Preparationhttps://wikitech.wikimedia.org/wiki/Netbox#Preparation Update WMF netbox repositoryhttps://wikitech.wikimedia.org/wiki/Netbox#Update_WMF_netbox_repository Build deploy repositoryhttps://wikitech.wikimedia.org/wiki/Netbox#Build_deploy_repository Deploy to Testing Serverhttps://wikitech.wikimedia.org/wiki/Netbox#Deploy_to_Testing_Server Simple Testinghttps://wikitech.wikimedia.org/wiki/Netbox#Simple_Testing Complex Testinghttps://wikitech.wikimedia.org/wiki/Netbox#Complex_Testing Porting and Testinghttps://wikitech.wikimedia.org/wiki/Netbox#Porting_and_Testing Deploy to Productionhttps://wikitech.wikimedia.org/wiki/Netbox#Deploy_to_Production Checklistshttps://wikitech.wikimedia.org/wiki/Netbox#Checklists Simple upgradehttps://wikitech.wikimedia.org/wiki/Netbox#Simple_upgrade Complex upgradehttps://wikitech.wikimedia.org/wiki/Netbox#Complex_upgrade Troubleshootinghttps://wikitech.wikimedia.org/wiki/Netbox#Troubleshooting CablePath matching query does not existhttps://wikitech.wikimedia.org/wiki/Netbox#CablePath_matching_query_does_not_exist Datasource sync: AttributeError: 'NoneType' object has no attribute 'sync'https://wikitech.wikimedia.org/wiki/Netbox#Datasource_sync:_AttributeError:_'NoneType'_object_has_no_attribute_'sync' Known issues Future improvementshttps://wikitech.wikimedia.org/wiki/Netbox#Known_issues_Future_improvements Improve our infrastructure modelinghttps://wikitech.wikimedia.org/wiki/Netbox#Improve_our_infrastructure_modeling Improve automation and reduce tech debthttps://wikitech.wikimedia.org/wiki/Netbox#Improve_automation_and_reduce_tech_debt Historyhttps://wikitech.wikimedia.org/wiki/Netbox#History See alsohttps://wikitech.wikimedia.org/wiki/Netbox#See_also External linkhttps://wikitech.wikimedia.org/wiki/Netbox#External_link https://wikitech.wikimedia.org/wiki/Incidents/2018-08-08_Network ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-08_Network#Summary Timeline (UTC)https://wikitech.wikimedia.org/wiki/Incidents/2018-08-08_Network#Timeline_(UTC) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-08_Network#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-08_Network#Actionables https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting/external_storage_failover # Old master: es1014 https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/08 === Week of August 6th === Week of August 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/08#Week_of_August_6th Week of August 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/08#Week_of_August_13th Week of August 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/08#Week_of_August_20th Week of August 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/08#Week_of_August_27th https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network This page explains how the CloudVPS network works, including the neutron Openstack component. Network topologyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Network_topology Datacenter networkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Datacenter_network Cloud racks vs WMF rackshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Cloud_racks_vs_WMF_racks Physical Connectionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Physical_Connection Networks by Server Typehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Networks_by_Server_Type cloudvirtshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloudvirts cloudnethttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloudnet cloudgwhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloudgw cephosdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cephosd cephmon / cephosdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cephmon_/_cephosd Network / Vlan usagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Network_/_Vlan_usage cloud-hosts (wmf production realm)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloud-hosts_(wmf_production_realm) cloud-private (cloud realm)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloud-private_(cloud_realm) cloud-instances (cloud realm)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloud-instances_(cloud_realm) cloud-storage (cloud realm)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloud-storage_(cloud_realm) cloud-instance-transport (cloud realm)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloud-instance-transport_(cloud_realm) cloud-gw-transport (cloud relam)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#cloud-gw-transport_(cloud_relam) Edge networkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Edge_network Virtual networkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Virtual_network Topology data examplehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Topology_data_example Eqiadhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Eqiad Codfwhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Codfw Ingress & Egresshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Ingress_&_Egress routing_source_iphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#routing_source_ip dmz_cidrhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#dmz_cidr Floating IPshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Floating_IPs traffic from instance to own floating IPhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#traffic_from_instance_to_own_floating_IP ingress & egress data examplehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#ingress_&_egress_data_example What Neutron is doinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#What_Neutron_is_doing Security policyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#Security_policy See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network#See_also https://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS In order to improve resiliency of recursive DNS, this setup leverages BGP and anycast. Limitation of a non-anycast setuphttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Limitation_of_a_non-anycast_setup Configurationhttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Configuration Server sidehttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Server_side check_cmdhttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#check_cmd Troubleshootinghttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Troubleshooting Know which server a client is redirected tohttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Know_which_server_a_client_is_redirected_to Ensure all servers can reach the VIPhttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Ensure_all_servers_can_reach_the_VIP Failure testshttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Failure_tests Single local recursor failurehttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Single_local_recursor_failure Double local recursor failurehttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Double_local_recursor_failure Limitationshttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Limitations Future evolutionhttps://wikitech.wikimedia.org/wiki/Anycast_recursive_DNS#Future_evolution https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DB This page describes the DB (database) usage by our Openstack deployments. Databaseshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DB#Databases GRANTShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DB#GRANTS Connection throttlinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DB#Connection_throttling See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DB#See_also https://wikitech.wikimedia.org/wiki/Adding_users_on_puppet Tutorial on adding a new production shell user via Puppet including initial setup of a local clone of operations/puppet. Preparationhttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Preparation Request Shell Accesshttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Request_Shell_Access Accountshttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Accounts Phabricatorhttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Phabricator LDAPhttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#LDAP Githttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Git Adding a userhttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Adding_a_user Edit data.yamlhttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Edit_data.yaml Committing changes and reviewhttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Committing_changes_and_review The Gerrit parthttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#The_Gerrit_part If something goes wronghttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#If_something_goes_wrong Merging and testing changes on Puppethttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Merging_and_testing_changes_on_Puppet Syncing your local repohttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Syncing_your_local_repo Using rebasehttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Using_rebase Using checkouthttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#Using_checkout See alsohttps://wikitech.wikimedia.org/wiki/Adding_users_on_puppet#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Summary Statshttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Stats Issueshttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Issues Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Timeline 2018-08-09https://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#2018-08-09 2018-08-17https://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#2018-08-17 2018-08-21https://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#2018-08-21 End of Day Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#End_of_Day_Summary 2018-08-22https://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#2018-08-22 2018-08-23https://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#2018-08-23 Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Links_to_relevant_documentation Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-08-21_Train#Actionables https://wikitech.wikimedia.org/wiki/Fundraising/tech/payments1004 = Using payments1004 for integration tests = Using payments1004 for integration testshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/payments1004#Using_payments1004_for_integration_tests Accesshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/payments1004#Access Override DNShttps://wikitech.wikimedia.org/wiki/Fundraising/tech/payments1004#Override_DNS https://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions We have different tools to find performance regressions and we have a automated alerts that will fire if they suspect there is a regression. Alerts are fired from https://alerts. You got a performance alert, what's the next step?https://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#You_got_a_performance_alert,_what's_the_next_step? Synthetic testinghttps://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#Synthetic_testing Backgroundhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#Background Where to starthttps://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#Where_to_start Tips and trickshttps://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#Tips_and_tricks Real user measurementhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#Real_user_measurement Useful dashboardshttps://wikitech.wikimedia.org/wiki/Performance/Guides/Regressions#Useful_dashboards https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/09 === Week of September 3rd === Week of September 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/09#Week_of_September_3rd Week of September 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/09#Week_of_September_10th Week of September 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/09#Week_of_September_17th Week of September 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/09#Week_of_September_24th https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/NotErrorLogging == Eventlogging is not well suited to do error logging == Eventlogging is not well suited to do error logginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/NotErrorLogging#Eventlogging_is_not_well_suited_to_do_error_logging https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_Migration Clearly a lot of this can be automated. Once we've done a few projects without errors we can mash all this into one big super-script Stepshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_Migration#Steps Special Concerns for Kubernetes Nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_Migration#Special_Concerns_for_Kubernetes_Nodes Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_Migration#Common_issues https://wikitech.wikimedia.org/wiki/Mwdebug == Bare metal == Bare metalhttps://wikitech.wikimedia.org/wiki/Mwdebug#Bare_metal Connectinghttps://wikitech.wikimedia.org/wiki/Mwdebug#Connecting MediaWiki on Kuberneteshttps://wikitech.wikimedia.org/wiki/Mwdebug#MediaWiki_on_Kubernetes Serviceshttps://wikitech.wikimedia.org/wiki/Mwdebug#Services Historyhttps://wikitech.wikimedia.org/wiki/Mwdebug#History https://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats Onboarding chats are a series of sessions to help new hires understand our not complex infrastructure. Session 1: Requests Flows Overviewhttps://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats#Session_1:_Requests_Flows_Overview Relatedhttps://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats#Related Session 2: Dive into MediaWiki and Restbasehttps://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats#Session_2:_Dive_into_MediaWiki_and_Restbase Session 3: Monitoringhttps://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats#Session_3:_Monitoring Session 4: Puppethttps://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats#Session_4:_Puppet See Alsohttps://wikitech.wikimedia.org/wiki/Ops_Onboarding_Chats#See_Also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Pod_tracing This article describes some procedures in cases we need to trace a pod when is misbehaving. Case 1: Unknown Tool hammering an APIhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Pod_tracing#Case_1:_Unknown_Tool_hammering_an_API https://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks |label2=installed on Cookbook Operationshttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Cookbook_Operations List available Cookbookshttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#List_available_Cookbooks Run a single Cookbookhttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Run_a_single_Cookbook Logshttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Logs Developmenthttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Development Documentationhttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Documentation Test before merginghttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Test_before_merging Deploymenthttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Deployment Renaming/Deleting a cookbookhttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Renaming/Deleting_a_cookbook Creating your local environmenthttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Creating_your_local_environment Pre-requisiteshttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Pre-requisites Installationhttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Installation Additional steps for WMCS cookbookshttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Additional_steps_for_WMCS_cookbooks Also seehttps://wikitech.wikimedia.org/wiki/Spicerack/Cookbooks#Also_see https://wikitech.wikimedia.org/wiki/News/Trusty_deprecation This page keeps track of our ongoing effort towards Ubuntu Trusty deprecation before April 2019. Tell me exactly what I need to dohttps://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Tell_me_exactly_what_I_need_to_do Cloud VPS project maintainershttps://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Cloud_VPS_project_maintainers Toolforge tool maintainershttps://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Toolforge_tool_maintainers Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Why_are_we_doing_this? Timelines. What will change? What has changed already?https://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Timelines._What_will_change?_What_has_changed_already? Cloud VPS projectshttps://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Cloud_VPS_projects Toolforgehttps://wikitech.wikimedia.org/wiki/News/Trusty_deprecation#Toolforge https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization == Problem == Problemhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Problem Use cases for User Agent collectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Use_cases_for_User_Agent_collection Fingerprinting: backgroundhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Fingerprinting:_background Sanitizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Sanitization Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Caveats Aggregationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Aggregation UA in EventLogging vs HTTP headershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#UA_in_EventLogging_vs_HTTP_headers Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#References Further readinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/EventLogging/User_agent_sanitization#Further_reading https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto Presto is an SQL engine which you can use to query data in the Data Lake. We currently run Presto in read-only mode. Usehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto#Use SQL quirkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto#SQL_quirks Presto on Supersethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto#Presto_on_Superset Backgroundhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto#Background Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto#Administration https://wikitech.wikimedia.org/wiki/Incidents/2018-09-18_train Covers deployment of 1.32-wmf. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-09-18_train#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-09-18_train#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-09-18_train#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-09-18_train#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-09-18_train#Actionables https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry This page contains administrative documentation for the Quarry service. Architecturehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Architecture Web interfacehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Web_interface Workershttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Workers Databasehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Database Querieshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Queries Deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Deployment Admin operationshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Admin_operations Get runners current workhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Get_runners_current_work Stuck queryhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Stuck_query Clear running or queued querieshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Clear_running_or_queued_queries Maintenance mode warninghttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Maintenance_mode_warning Block a userhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#Block_a_user See alsohttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Quarry#See_also https://wikitech.wikimedia.org/wiki/MariaDB/request_new_database You need to provide: https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki/Configuration The Dashiki dashboarding system depends on pages on meta.wikimedia. Annotationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki/Configuration#Annotations Dashboardshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki/Configuration#Dashboards Tabs Layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki/Configuration#Tabs_Layout Compare Layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki/Configuration#Compare_Layout Metric by Project Layouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dashiki/Configuration#Metric_by_Project_Layout https://wikitech.wikimedia.org/wiki/NFS-Ganesha NFS-Ganesha is an NFS fileserver that runs in user mode on most UNIX/Linux systems and supported NFS v3, v4, and v4.1 protocols. Releaseshttps://wikitech.wikimedia.org/wiki/NFS-Ganesha#Releases Packageshttps://wikitech.wikimedia.org/wiki/NFS-Ganesha#Packages https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35 == 2018-08-31 == 2018-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-31 2018-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-30 2018-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-29 2018-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-28 2018-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-27 2018-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-26 2018-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-24 2018-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-23 2018-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-22 2018-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-21 2018-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-20 2018-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-17 2018-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-16 2018-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-15 2018-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-14 2018-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-13 2018-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-12 2018-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-10 2018-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-09 2018-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-08 2018-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-07 2018-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-06 2018-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-05 2018-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-04 2018-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-03 2018-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-02 2018-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-08-01 2018-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-31 2018-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-30 2018-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-29 2018-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-28 2018-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-27 2018-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-26 2018-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-25 2018-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-24 2018-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-23 2018-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-22 2018-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-21 2018-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-20 2018-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-19 2018-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-18 2018-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-17 2018-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-16 2018-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-14 2018-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-13 2018-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-12 2018-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-11 2018-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-10 2018-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-09 2018-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-08 2018-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-07 2018-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-06 2018-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-05 2018-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-04 2018-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-03 2018-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-02 2018-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-07-01 2018-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-30 2018-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-29 2018-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-28 2018-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-27 2018-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-26 2018-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-25 2018-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-24 2018-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-22 2018-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-21 2018-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-20 2018-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-19 2018-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-18 2018-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-17 2018-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-16 2018-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-15 2018-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-14 2018-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-13 2018-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-12 2018-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-11 2018-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-10 2018-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-08 2018-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-07 2018-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-06 2018-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-05 2018-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-04 2018-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-03 2018-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-02 2018-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-06-01 2018-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-31 2018-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-30 2018-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-29 2018-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-28 2018-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-26 2018-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-25 2018-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-24 2018-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-23 2018-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-22 2018-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-21 2018-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-20 2018-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-19 2018-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-18 2018-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-17 2018-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-16 2018-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-15 2018-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-14 2018-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-13 2018-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-12 2018-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-11 2018-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-10 2018-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-09 2018-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-08 2018-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-07 2018-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-05 2018-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-04 2018-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-03 2018-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-02 2018-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_35#2018-05-01 https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2 == 2016-12-27 == 2016-12-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-27 2016-12-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-26 2016-12-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-24 2016-12-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-23 2016-12-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-22 2016-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-21 2016-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-19 2016-12-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-16 2016-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-15 2016-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-14 2016-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-13 2016-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-09 2016-12-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-08 2016-12-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-07 2016-12-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-06 2016-12-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-05 2016-12-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-04 2016-12-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-03 2016-12-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-02 2016-12-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-12-01 2016-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-30 2016-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-29 2016-11-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-28 2016-11-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-26 2016-11-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-24 2016-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-23 2016-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-22 2016-11-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-21 2016-11-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-19 2016-11-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-18 2016-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-17 2016-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-16 2016-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-15 2016-11-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-14 2016-11-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-12 2016-11-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-11 2016-11-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-10 2016-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-09 2016-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-08 2016-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-07 2016-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-04 2016-11-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-03 2016-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-02 2016-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-11-01 2016-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-31 2016-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-27 2016-10-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-25 2016-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-24 2016-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-21 2016-10-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-20 2016-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-14 2016-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-13 2016-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-12 2016-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-11 2016-10-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-10 2016-10-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-07 2016-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-06 2016-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-05 2016-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-04 2016-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-03 2016-10-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-10-01 2016-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-29 2016-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-28 2016-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-27 2016-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-26 2016-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-24 2016-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-23 2016-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-22 2016-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-21 2016-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-20 2016-09-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-19 2016-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-17 2016-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-16 2016-09-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-15 2016-09-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-14 2016-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-13 2016-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-12 2016-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-11 2016-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-09 2016-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-08 2016-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-07 2016-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-06 2016-09-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-05 2016-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-02 2016-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-09-01 2016-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-31 2016-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-30 2016-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-29 2016-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-27 2016-08-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-26 2016-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-25 2016-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-24 2016-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-23 2016-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-22 2016-08-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-18 2016-08-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-17 2016-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-16 2016-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-15 2016-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-13 2016-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-12 2016-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-10 2016-08-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-09 2016-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-08 2016-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-07 2016-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-06 2016-08-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-05 2016-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-04 2016-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-08-01 2016-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-29 2016-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-28 2016-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-27 2016-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-26 2016-07-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-25 2016-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-23 2016-07-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-22 2016-07-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-21 2016-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-20 2016-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-18 2016-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-16 2016-07-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-15 2016-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-14 2016-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-13 2016-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-12 2016-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-11 2016-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-09 2016-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-08 2016-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-07 2016-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-06 2016-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-05 2016-07-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-04 2016-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-03 2016-07-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-07-02 2016-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-30 2016-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-28 2016-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-27 2016-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-24 2016-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-23 2016-06-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-17 2016-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-14 2016-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-13 2016-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-10 2016-06-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-09 2016-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-08 2016-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-07 2016-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-06 2016-06-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-04 2016-06-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-03 2016-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-02 2016-06-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-06-01 2016-05-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-31 2016-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-30 2016-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-28 2016-05-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-27 2016-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-26 2016-05-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-25 2016-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-24 2016-05-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-23 2016-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-20 2016-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-19 2016-05-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-18 2016-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-13 2016-05-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-12 2016-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-11 2016-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-10 2016-05-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-09 2016-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-06 2016-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-05 2016-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-04 2016-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-03 2016-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-05-02 2016-04-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-30 2016-04-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-29 2016-04-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-28 2016-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-27 2016-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-26 2016-04-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-25 2016-04-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-24 2016-04-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-22 2016-04-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-21 2016-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-20 2016-04-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-17 2016-04-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-16 2016-04-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-13 2016-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-12 2016-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-11 2016-04-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-08 2016-04-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-07 2016-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-05 2016-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-04 2016-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-03 2016-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-02 2016-04-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-04-01 2016-03-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-31 2016-03-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-30 2016-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-29 2016-03-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-26 2016-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-25 2016-03-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-24 2016-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-23 2016-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-22 2016-03-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-21 2016-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-19 2016-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-18 2016-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-17 2016-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-16 2016-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-15 2016-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-14 2016-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-11 2016-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-10 2016-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-09 2016-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-08 2016-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-07 2016-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-06 2016-03-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-04 2016-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-03 2016-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-02 2016-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-03-01 2016-02-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-29 2016-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-28 2016-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-26 2016-02-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-25 2016-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-24 2016-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-23 2016-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-22 2016-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-20 2016-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-19 2016-02-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-18 2016-02-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-17 2016-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-16 2016-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-15 2016-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-14 2016-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-13 2016-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-12 2016-02-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-11 2016-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-10 2016-02-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-09 2016-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-08 2016-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-06 2016-02-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-05 2016-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-04 2016-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-03 2016-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-02 2016-02-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-02-01 2016-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-31 2016-01-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-30 2016-01-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-29 2016-01-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-28 2016-01-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-27 2016-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-26 2016-01-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-25 2016-01-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-24 2016-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-22 2016-01-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-21 2016-01-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-20 2016-01-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-19 2016-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-17 2016-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-16 2016-01-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-15 2016-01-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-14 2016-01-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-13 2016-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-12 2016-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-11 2016-01-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-07 2016-01-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-06 2016-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-05 2016-01-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-04 2016-01-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-02 2016-01-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_2#2016-01-01 https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3 == 2017-12-27 == 2017-12-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-27 2017-12-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-25 2017-12-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-24 2017-12-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-23 2017-12-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-22 2017-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-21 2017-12-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-20 2017-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-19 2017-12-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-18 2017-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-13 2017-12-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-12 2017-12-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-11 2017-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-09 2017-12-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-08 2017-12-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-07 2017-12-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-06 2017-12-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-05 2017-12-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-04 2017-12-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-03 2017-12-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-12-01 2017-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-30 2017-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-29 2017-11-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-28 2017-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-27 2017-11-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-24 2017-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-23 2017-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-22 2017-11-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-21 2017-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-20 2017-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-16 2017-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-15 2017-11-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-13 2017-11-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-10 2017-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-09 2017-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-08 2017-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-07 2017-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-06 2017-11-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-03 2017-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-02 2017-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-11-01 2017-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-31 2017-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-30 2017-10-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-28 2017-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-27 2017-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-26 2017-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-24 2017-10-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-23 2017-10-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-20 2017-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-19 2017-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-18 2017-10-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-17 2017-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-16 2017-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-14 2017-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-13 2017-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-11 2017-10-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-10 2017-10-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-09 2017-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-06 2017-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-05 2017-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-04 2017-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-03 2017-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-10-02 2017-09-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-30 2017-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-29 2017-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-28 2017-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-27 2017-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-26 2017-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-25 2017-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-24 2017-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-22 2017-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-21 2017-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-20 2017-09-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-19 2017-09-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-18 2017-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-17 2017-09-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-14 2017-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-13 2017-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-12 2017-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-11 2017-09-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-10 2017-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-09 2017-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-07 2017-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-06 2017-09-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-05 2017-09-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-04 2017-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-09-02 2017-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-31 2017-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-30 2017-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-29 2017-08-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-28 2017-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-25 2017-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-24 2017-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-22 2017-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-21 2017-08-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-18 2017-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-16 2017-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-15 2017-08-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-14 2017-08-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-11 2017-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-07 2017-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-06 2017-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-04 2017-08-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-03 2017-08-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-02 2017-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-08-01 2017-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-28 2017-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-26 2017-07-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-25 2017-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-24 2017-07-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-21 2017-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-20 2017-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-19 2017-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-18 2017-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-17 2017-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-14 2017-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-13 2017-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-12 2017-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-11 2017-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-09 2017-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-07 2017-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-06 2017-07-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-04 2017-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-07-03 2017-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-30 2017-06-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-29 2017-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-28 2017-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-27 2017-06-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-26 2017-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-24 2017-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-23 2017-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-22 2017-06-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-21 2017-06-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-20 2017-06-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-19 2017-06-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-18 2017-06-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-16 2017-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-15 2017-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-14 2017-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-13 2017-06-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-12 2017-06-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-09 2017-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-07 2017-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-06 2017-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-05 2017-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-02 2017-06-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-06-01 2017-05-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-31 2017-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-30 2017-05-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-29 2017-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-26 2017-05-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-25 2017-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-24 2017-05-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-23 2017-05-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-22 2017-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-21 2017-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-20 2017-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-19 2017-05-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-15 2017-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-13 2017-05-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-12 2017-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-11 2017-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-10 2017-05-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-09 2017-05-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-08 2017-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-06 2017-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-05 2017-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-04 2017-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-03 2017-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-02 2017-05-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-05-01 2017-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-27 2017-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-26 2017-04-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-25 2017-04-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-22 2017-04-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-21 2017-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-20 2017-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-19 2017-04-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-18 2017-04-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-14 2017-04-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-13 2017-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-12 2017-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-11 2017-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-10 2017-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-06 2017-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-05 2017-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-04 2017-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-03 2017-04-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-04-01 2017-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-29 2017-03-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-28 2017-03-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-27 2017-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-25 2017-03-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-24 2017-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-23 2017-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-22 2017-03-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-21 2017-03-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-20 2017-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-17 2017-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-16 2017-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-15 2017-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-14 2017-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-13 2017-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-10 2017-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-09 2017-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-08 2017-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-07 2017-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-06 2017-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-02 2017-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-03-01 2017-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-28 2017-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-27 2017-02-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-25 2017-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-24 2017-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-23 2017-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-22 2017-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-20 2017-02-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-17 2017-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-16 2017-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-15 2017-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-14 2017-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-13 2017-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-10 2017-02-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-09 2017-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-08 2017-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-07 2017-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-06 2017-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-04 2017-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-03 2017-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-02 2017-02-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-02-01 2017-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-31 2017-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-26 2017-01-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-24 2017-01-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-23 2017-01-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-21 2017-01-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-20 2017-01-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-19 2017-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-18 2017-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-17 2017-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-16 2017-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-12 2017-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-11 2017-01-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-10 2017-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-08 2017-01-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-07 2017-01-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-06 2017-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-05 2017-01-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-04 2017-01-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_3#2017-01-02 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36 == 2018-12-31 == 2018-12-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-31 2018-12-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-30 2018-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-29 2018-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-28 2018-12-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-27 2018-12-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-26 2018-12-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-24 2018-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-23 2018-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-22 2018-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-21 2018-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-20 2018-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-19 2018-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-18 2018-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-17 2018-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-16 2018-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-15 2018-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-14 2018-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-13 2018-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-12 2018-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-11 2018-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-10 2018-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-09 2018-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-08 2018-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-07 2018-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-06 2018-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-05 2018-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-04 2018-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-03 2018-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-02 2018-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-12-01 2018-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-30 2018-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-29 2018-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-28 2018-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-27 2018-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-26 2018-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-25 2018-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-23 2018-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-22 2018-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-21 2018-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-20 2018-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-19 2018-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-18 2018-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-17 2018-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-16 2018-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-15 2018-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-14 2018-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-13 2018-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-12 2018-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-10 2018-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-09 2018-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-08 2018-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-07 2018-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-06 2018-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-05 2018-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-04 2018-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-03 2018-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-02 2018-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-11-01 2018-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-31 2018-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-30 2018-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-29 2018-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-28 2018-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-27 2018-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-26 2018-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-25 2018-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-24 2018-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-23 2018-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-22 2018-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-21 2018-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-20 2018-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-19 2018-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-18 2018-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-17 2018-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-16 2018-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-15 2018-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-14 2018-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-13 2018-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-12 2018-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-11 2018-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-10 2018-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-09 2018-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-08 2018-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-07 2018-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-06 2018-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-05 2018-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-04 2018-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-03 2018-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-02 2018-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-10-01 2018-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-30 2018-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-29 2018-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-28 2018-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-27 2018-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-26 2018-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-25 2018-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-24 2018-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-23 2018-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-22 2018-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-21 2018-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-20 2018-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-19 2018-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-18 2018-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-17 2018-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-15 2018-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-14 2018-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-13 2018-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-12 2018-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-11 2018-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-10 2018-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-08 2018-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-07 2018-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-06 2018-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-05 2018-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-04 2018-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-03 2018-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-02 2018-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_36#2018-09-01 https://wikitech.wikimedia.org/wiki/Incidents/2018-10-01_DeleteLocalPasswords == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-01_DeleteLocalPasswords#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-01_DeleteLocalPasswords#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-01_DeleteLocalPasswords#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-01_DeleteLocalPasswords#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-01_DeleteLocalPasswords#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-10-02_maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-02_maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-02_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-02_maps#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-02_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-02_maps#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes This page holds notes and ideas regarding the Stretch Buster migration of Toolforge, specially related to k8s. See News/2020 Kubernetes cluster migration for how this all ended up! 2018-10-04https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2018-10-04 Timelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#Timeline Thinks to take into accounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#Thinks_to_take_into_account Networkinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#Networking 2019-06-01https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-06-01 etcdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#etcd k8s masterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#k8s_master k8s worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#k8s_worker_nodes k8s API proxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#k8s_API_proxy 2019-06-27https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-06-27 agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#agenda next stepshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#next_steps 2019-07-04https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-07-04 2019-07-16https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-07-16 2019-07-30https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-07-30 2019-08-14https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-08-14 2019-09-23https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-09-23 2019-10-10https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/2020_Kubernetes_cluster_rebuild_plan_notes#2019-10-10 https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/10 === Week of October 1st === Week of October 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/10#Week_of_October_1st Week of October 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/10#Week_of_October_8th Week of October 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/10#Week_of_October_15th Week of October 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/10#Week_of_October_22nd Week of October 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/10#Week_of_October_29th https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Skill_matrix This is an attempt to identify who knows what about which Cloud Services subject areas. Started: October 2018. https://wikitech.wikimedia.org/wiki/DebMonitor DebMonitor is a Debian package tracker website and tool developed at the Wikimedia Foundation and used to track installed and upgradable packages across the fleet. It has multiple components. DebMonitor websitehttps://wikitech.wikimedia.org/wiki/DebMonitor#DebMonitor_website DebMonitor clienthttps://wikitech.wikimedia.org/wiki/DebMonitor#DebMonitor_client Common commandshttps://wikitech.wikimedia.org/wiki/DebMonitor#Common_commands Manually remove a host from DebMonitorhttps://wikitech.wikimedia.org/wiki/DebMonitor#Manually_remove_a_host_from_DebMonitor Manually remove an image from DebMonitorhttps://wikitech.wikimedia.org/wiki/DebMonitor#Manually_remove_an_image_from_DebMonitor https://wikitech.wikimedia.org/wiki/Spicerack Spicerack is a Python library to orchestrate tasks in the Wikimedia Foundation production environment. It comes with an easy API and a cookbook entry point script that allows to write simple Cookbooks to automate and orchestrate tasks. Documentationhttps://wikitech.wikimedia.org/wiki/Spicerack#Documentation How to contributehttps://wikitech.wikimedia.org/wiki/Spicerack#How_to_contribute Bug fixes and small feature updateshttps://wikitech.wikimedia.org/wiki/Spicerack#Bug_fixes_and_small_feature_updates Adding new module or change in core behaviourhttps://wikitech.wikimedia.org/wiki/Spicerack#Adding_new_module_or_change_in_core_behaviour The ideal proposal would includehttps://wikitech.wikimedia.org/wiki/Spicerack#The_ideal_proposal_would_include Alternativelyhttps://wikitech.wikimedia.org/wiki/Spicerack#Alternatively Automation and Tooling office hourshttps://wikitech.wikimedia.org/wiki/Spicerack#Automation_and_Tooling_office_hours Test newly released Spicerack featureshttps://wikitech.wikimedia.org/wiki/Spicerack#Test_newly_released_Spicerack_features https://wikitech.wikimedia.org/wiki/Updating_netboot_image_with_newer_kernel This text describes the necessary steps to update a Debian netboot image with a more recent kernel (e.g. Backport Buster 5.10 kernel to Busterhttps://wikitech.wikimedia.org/wiki/Updating_netboot_image_with_newer_kernel#Backport_Buster_5.10_kernel_to_Buster WMF-specific instructions for this below:https://wikitech.wikimedia.org/wiki/Updating_netboot_image_with_newer_kernel#WMF-specific_instructions_for_this_below: Updating production point releasehttps://wikitech.wikimedia.org/wiki/Updating_netboot_image_with_newer_kernel#Updating_production_point_release https://wikitech.wikimedia.org/wiki/Fundraising/tech/access Fundraising cluster access, for CiviCRM and other services, generally follows the same best practices as production shell access, including requirements of C-Level approval and a 3 business day waiting period to both allow SRE to schedule the work and to ensure there is sufficient time for any concerns to be raised. This access is highly sensitive and the SRE team is diligent about maintaining security. How to request accesshttps://wikitech.wikimedia.org/wiki/Fundraising/tech/access#How_to_request_access https://wikitech.wikimedia.org/wiki/Incidents/2018-10-15_eqsin-power == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-15_eqsin-power#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-15_eqsin-power#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-15_eqsin-power#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-15_eqsin-power#Actionables https://wikitech.wikimedia.org/wiki/WMDE [Deutschland|Wikimedia Deutschland] (WMDE) is a [chapters|chapter] organization in the Wikimedia movement. In addition to a wide variety of services and support offered to German language projects they employ an engineering staff who are the primary maintainers of [and Wikidata]. About Ushttps://wikitech.wikimedia.org/wiki/WMDE#About_Us Contacthttps://wikitech.wikimedia.org/wiki/WMDE#Contact People organizationhttps://wikitech.wikimedia.org/wiki/WMDE#People_organization Work Organizationhttps://wikitech.wikimedia.org/wiki/WMDE#Work_Organization Product Umbrellashttps://wikitech.wikimedia.org/wiki/WMDE#Product_Umbrellas Wikidata (tech docs)https://wikitech.wikimedia.org/wiki/WMDE#Wikidata_(tech_docs) Technical Wishes ([Technical Wishes|meta page])https://wikitech.wikimedia.org/wiki/WMDE#Technical_Wishes_([Technical_Wishes|meta_page]) Fundraisinghttps://wikitech.wikimedia.org/wiki/WMDE#Fundraising Mischttps://wikitech.wikimedia.org/wiki/WMDE#Misc Infrastructurehttps://wikitech.wikimedia.org/wiki/WMDE#Infrastructure Table of Contenthttps://wikitech.wikimedia.org/wiki/WMDE#Table_of_Content https://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#Timeline 10th Oct 2018https://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#10th_Oct_2018 11th Oct 2018https://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#11th_Oct_2018 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_eqiad_parsercache_empty_post-switchover#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_Replication_gap_on_s8_eqiad_hosts == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_Replication_gap_on_s8_eqiad_hosts#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_Replication_gap_on_s8_eqiad_hosts#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_Replication_gap_on_s8_eqiad_hosts#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_Replication_gap_on_s8_eqiad_hosts#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-16_Replication_gap_on_s8_eqiad_hosts#Actionables https://wikitech.wikimedia.org/wiki/Bast2002 bast2002 is the main bastion for Codfw. It replaced bast2001. Serviceshttps://wikitech.wikimedia.org/wiki/Bast2002#Services https://wikitech.wikimedia.org/wiki/Cloudweb1003 cloudweb1003 and cloudweb1004 host Horizon and toolsadmin (Striker). Connectinghttps://wikitech.wikimedia.org/wiki/Cloudweb1003#Connecting Maintenancehttps://wikitech.wikimedia.org/wiki/Cloudweb1003#Maintenance https://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research There is an effort underway to introduce continous delivery to WMF, Continuous conceptshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Continuous_concepts Continuous integrationhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Continuous_integration Continuous deliveryhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Continuous_delivery Continuous deploymenthttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Continuous_deployment CD vs CDhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#CD_vs_CD Pipelines, gateshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Pipelines,_gates Current statushttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Current_status Known problems with current statushttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Known_problems_with_current_status Desired statushttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Desired_status SRE teamhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#SRE_team Release engineering teamhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Release_engineering_team Service developers (community and WMF)https://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Service_developers_(community_and_WMF) Overview of planned solutionhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Overview_of_planned_solution Suggestion for a continuous delivery processhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Suggestion_for_a_continuous_delivery_process Roles and systemshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Roles_and_systems Process descriptionhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Process_description Process as a UML sequence diagramhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Process_as_a_UML_sequence_diagram Discussionhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/research#Discussion https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera This page contains information on how hiera data is managed in Cloud VPS, which is a bit different from the main production hiera/puppet workflow. Precedence of hiera keyshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#Precedence_of_hiera_keys Puppet enc systemhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#Puppet_enc_system ENC APIhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#ENC_API Horizon UIhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#Horizon_UI clihttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#cli puppet-enchttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#puppet-enc Terraformhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#Terraform Wikitech integrationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#Wikitech_integration See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#See_also Referenceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Hiera#References https://wikitech.wikimedia.org/wiki/Incidents/2018-10-24_WDQS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-24_WDQS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-24_WDQS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-24_WDQS#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-24_WDQS#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-24_WDQS#Actionables https://wikitech.wikimedia.org/wiki/WMDE/TOC = Table of Contents - Without Redirects = Table of Contents - Without Redirectshttps://wikitech.wikimedia.org/wiki/WMDE/TOC#Table_of_Contents_-_Without_Redirects Table of Contents - With Redirectshttps://wikitech.wikimedia.org/wiki/WMDE/TOC#Table_of_Contents_-_With_Redirects https://wikitech.wikimedia.org/wiki/WMDE/Wikidata This page is intended to serve as a central hub for documentation related to the production deployment, infrastructure and maintenance of Wikidata. Table of Contentshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata#Table_of_Contents See alsohttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata#See_also https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling == Current & Future == Current & Futurehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Current_&_Future WDQShttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#WDQS Abuse filterhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Abuse_filter Entity size / serializationhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Entity_size_/_serialization Revision table?https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Revision_table? Dump generationhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Dump_generation Recent Changeshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Recent_Changes Pasthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Past wb_termshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#wb_terms CacheAwarePropertyInfoStorehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#CacheAwarePropertyInfoStore Rate of entity Id acquisitionhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Rate_of_entity_Id_acquisition Change dispatchinghttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Scaling#Change_dispatching https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository Toolforge has an internal apt repository managed with aptly. The repository exists on the tools-services nodes. Deployment components and architecturehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#Deployment_components_and_architecture Servershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#Servers Addressing, DNS and proxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#Addressing,_DNS_and_proxy Puppethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#Puppet Admin operationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#Admin_operations managing aptly repohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#managing_aptly_repo healthhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#health failoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#failover Historyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#History See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Apt_repository#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor This page contains some notes on the puppet refactor we are doing for Toolforge, specifically some agreements in how we will be organizing the puppet code. Profiles and roles explanationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#Profiles_and_roles_explanation profile::toolforge::basehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#profile::toolforge::base profile::toolforge::grid::basehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#profile::toolforge::grid::base profile::toolforge::infrastructurehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#profile::toolforge::infrastructure Refactor exampleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#Refactor_examples option 1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#option_1 option 2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#option_2 option 3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/puppet_refactor#option_3 https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects {| class="wikitable sortable" See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects#See_also https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching == Varnish Cache == Varnish Cachehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Varnish_Cache Purging a single page (URL)https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Purging_a_single_page_(URL) Purging a list of pageshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Purging_a_list_of_pages Parser Cachehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Parser_Cache Purging a selection of numeric IDshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Purging_a_selection_of_numeric_IDs Selectively reject mass parser cache valueshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Selectively_reject_mass_parser_cache_values Actively remove parser cache entrieshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Actively_remove_parser_cache_entries Memcachedhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Memcached Shared Cachehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Shared_Cache WikiPageEntityRevisionLookuphttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#WikiPageEntityRevisionLookup CacheAwarePropertyInfoStorehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#CacheAwarePropertyInfoStore Misc Cachehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#Misc_Cache wikibase.repo.formatter.*https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#wikibase.repo.formatter.* wikidatawiki:wikibase-PropertyOrderProviderhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Caching#wikidatawiki:wikibase-PropertyOrderProvider https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL ==DB locations== DB locationshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#DB_locations Wikidata specific tableshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#Wikidata_specific_tables Repo tableshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#Repo_tables Change dispatch related tables:https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#Change_dispatch_related_tables: Secondary terms indexhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#Secondary_terms_index Other:https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#Other: Client tableshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SQL#Client_tables https://wikitech.wikimedia.org/wiki/Gerrit/test_instance A Gerrit test instance is hosted at gerrit.devtools. Setting up an accounthttps://wikitech.wikimedia.org/wiki/Gerrit/test_instance#Setting_up_an_account Submitting your changeshttps://wikitech.wikimedia.org/wiki/Gerrit/test_instance#Submitting_your_changes Cloning repo and URLhttps://wikitech.wikimedia.org/wiki/Gerrit/test_instance#Cloning_repo_and_URL Commit and push changeshttps://wikitech.wikimedia.org/wiki/Gerrit/test_instance#Commit_and_push_changes Create your own Gerrit test instancehttps://wikitech.wikimedia.org/wiki/Gerrit/test_instance#Create_your_own_Gerrit_test_instance See alsohttps://wikitech.wikimedia.org/wiki/Gerrit/test_instance#See_also https://wikitech.wikimedia.org/wiki/Stat1007 The stat1007 server is an Analytics Cluster client node for accessing Analytics MariaDB databases or Hadoop. Successor to stat1005. Usagehttps://wikitech.wikimedia.org/wiki/Stat1007#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1007#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1007#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1007#Notes https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#Overview Occasional stuck changeshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#Occasional_stuck_changes Controlhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#Control Stop dispatchinghttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#Stop_dispatching Monitoringhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#Monitoring How it actually works?https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#How_it_actually_works? Data Storagehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#Data_Storage The workflow using an examplehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Dispatching#The_workflow_using_an_example https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/SSL_certificates This page contains information on SSL certificates for Toolforge. Usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/SSL_certificates#Usage *.toolforge.org / *.tools.wmflabs.orghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/SSL_certificates#*.toolforge.org_/_*.tools.wmflabs.org See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/SSL_certificates#See_also https://wikitech.wikimedia.org/wiki/Incidents/20181104-s8-replication == Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20181104-s8-replication#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20181104-s8-replication#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20181104-s8-replication#Conclusions Links to relevant documentationshttps://wikitech.wikimedia.org/wiki/Incidents/20181104-s8-replication#Links_to_relevant_documentations Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20181104-s8-replication#Actionables https://wikitech.wikimedia.org/wiki/Maps/Runbook == Intro == Introhttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Intro Componentshttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Components Main dashboardshttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Main_dashboards Known limitationshttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Known_limitations Known issueshttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Known_issues Reimport in progresshttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Reimport_in_progress Tilerator Crashedhttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Tilerator_Crashed Services error at startuphttps://wikitech.wikimedia.org/wiki/Maps/Runbook#Services_error_at_startup See alsohttps://wikitech.wikimedia.org/wiki/Maps/Runbook#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-11-06_maps ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-06_maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-06_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-06_maps#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-06_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-06_maps#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge-sync-meeting = Toolforge sync: plans = Toolforge sync: planshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge-sync-meeting#Toolforge_sync:_plans plans & TODOshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge-sync-meeting#plans_&_TODOs speculative timelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge-sync-meeting#speculative_timeline info on concrete nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge-sync-meeting#info_on_concrete_nodes https://wikitech.wikimedia.org/wiki/Incidents/2018-10-25_train-1.33.0-wmf.1 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-25_train-1.33.0-wmf.1#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-25_train-1.33.0-wmf.1#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-25_train-1.33.0-wmf.1#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-10-25_train-1.33.0-wmf.1#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/11 === Week of November 5th === Week of November 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/11#Week_of_November_5th Week of November 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/11#Week_of_November_12th Week of November 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/11#Week_of_November_19th Week of November 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/11#Week_of_November_26th https://wikitech.wikimedia.org/wiki/Incidents/2018-11-07_TwoColConflict == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-07_TwoColConflict#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-07_TwoColConflict#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-07_TwoColConflict#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-07_TwoColConflict#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-07_TwoColConflict#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model This page holds information on the ideal model for Neutron. This model have 2 requisites: Requisites and use caseshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#Requisites_and_use_cases access to instanceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#access_to_instances networking connectionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#networking_connections LVShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#LVS Ideal modelhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#Ideal_model Things that are good in the current modelhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#Things_that_are_good_in_the_current_model Things to improve in the current modelhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#Things_to_improve_in_the_current_model dmz_cidr considerationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#dmz_cidr_considerations supporting serviceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#supporting_services Planshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#Plans See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model#See_also https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Deployment == How to determine the deployed Wikidata version == How to determine the deployed Wikidata versionhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Deployment#How_to_determine_the_deployed_Wikidata_version How to deploy codehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Deployment#How_to_deploy_code Configuration changeshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Deployment#Configuration_changes Schema changeshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Deployment#Schema_changes Update cron jobshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Deployment#Update_cron_jobs https://wikitech.wikimedia.org/wiki/Icinga1001 icinga1001 is the currently active production Icinga server and the equivalent of icinga2001 in codfw. Together they replaced einsteinium and tegmen which replaced neon. Serviceshttps://wikitech.wikimedia.org/wiki/Icinga1001#Services Also seehttps://wikitech.wikimedia.org/wiki/Icinga1001#Also_see https://wikitech.wikimedia.org/wiki/Icinga2001 icinga2001 is the currently passive production Icinga server and the equivalent of icinga1001 in eqiad. Together they replaced einsteinium and tegmen which replaced neon. Serviceshttps://wikitech.wikimedia.org/wiki/Icinga2001#Services Also seehttps://wikitech.wikimedia.org/wiki/Icinga2001#Also_see https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Neutron_LVS This page contains information on running LVS in our CloudVPS environment using Neutron. Experimental setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Neutron_LVS#Experimental_setup Conclusionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Neutron_LVS#Conclusions https://wikitech.wikimedia.org/wiki/Debian_packaging Wikimedia uses Debian for its infrastructure. Libraries, modules and software are usually provided as a Debian package which is then uploaded to our APT repository. Rebuilding a packagehttps://wikitech.wikimedia.org/wiki/Debian_packaging#Rebuilding_a_package Test with piupartshttps://wikitech.wikimedia.org/wiki/Debian_packaging#Test_with_piuparts Upload to Wikimedia Repohttps://wikitech.wikimedia.org/wiki/Debian_packaging#Upload_to_Wikimedia_Repo Upload to a component directoryhttps://wikitech.wikimedia.org/wiki/Debian_packaging#Upload_to_a_component_directory Create a Debian patchhttps://wikitech.wikimedia.org/wiki/Debian_packaging#Create_a_Debian_patch Browse current package sourcehttps://wikitech.wikimedia.org/wiki/Debian_packaging#Browse_current_package_source Retrieving old-style source packages using dgethttps://wikitech.wikimedia.org/wiki/Debian_packaging#Retrieving_old-style_source_packages_using_dget Getting source from Debianhttps://wikitech.wikimedia.org/wiki/Debian_packaging#Getting_source_from_Debian Troubleshootinghttps://wikitech.wikimedia.org/wiki/Debian_packaging#Troubleshooting Dependency issues with debhelper when backportinghttps://wikitech.wikimedia.org/wiki/Debian_packaging#Dependency_issues_with_debhelper_when_backporting See alsohttps://wikitech.wikimedia.org/wiki/Debian_packaging#See_also https://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Actionables Logginghttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Logging Notificationshttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Notifications Passwordshttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Passwords Two factorhttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Two_factor Otherhttps://wikitech.wikimedia.org/wiki/Incidents/20161112-OurMine#Other https://wikitech.wikimedia.org/wiki/People1001 people1001 was a virtual machine running on Ganeti. It hosted the service People. Connectinghttps://wikitech.wikimedia.org/wiki/People1001#Connecting https://wikitech.wikimedia.org/wiki/Incidents/2018-11-29_ores == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-29_ores#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-29_ores#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-29_ores#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-29_ores#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-11-29_ores#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model/meeting-2018-11-29 = CloudVPS ideal model = CloudVPS ideal modelhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model/meeting-2018-11-29#CloudVPS_ideal_model topicshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Neutron_ideal_model/meeting-2018-11-29#topics https://wikitech.wikimedia.org/wiki/Logstash/SRE_onboard = Shipping logs to Logstash via Kafka = Shipping logs to Logstash via Kafkahttps://wikitech.wikimedia.org/wiki/Logstash/SRE_onboard#Shipping_logs_to_Logstash_via_Kafka Sysloghttps://wikitech.wikimedia.org/wiki/Logstash/SRE_onboard#Syslog Structured logginghttps://wikitech.wikimedia.org/wiki/Logstash/SRE_onboard#Structured_logging Kafka and JSONhttps://wikitech.wikimedia.org/wiki/Logstash/SRE_onboard#Kafka_and_JSON UDP logginghttps://wikitech.wikimedia.org/wiki/Logstash/SRE_onboard#UDP_logging https://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Conclusions Toolforge configuration is spread between ops/puppet.git, Wikitech and Horizonhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Toolforge_configuration_is_spread_between_ops/puppet.git,_Wikitech_and_Horizon Lack of knowledge (and documentation) about tools-checker-01https://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Lack_of_knowledge_(and_documentation)_about_tools-checker-01 Usage of "tools.eqiad.wmflabs" and "tools.wmflabs.org" interchangeablyhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Usage_of_"tools.eqiad.wmflabs"_and_"tools.wmflabs.org"_interchangeably Mysterious networking issueshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Mysterious_networking_issues Human errorhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Human_error Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-04_Toolforge-Kubernetes#Actionables https://wikitech.wikimedia.org/wiki/Core Core in Wikimedia technology may refer to: Networkinghttps://wikitech.wikimedia.org/wiki/Core#Networking Databaseshttps://wikitech.wikimedia.org/wiki/Core#Databases Softwarehttps://wikitech.wikimedia.org/wiki/Core#Software See alsohttps://wikitech.wikimedia.org/wiki/Core#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history wmf.mediawiki_wikitext_history is a dataset available in the Data Lake that provides the full content of all revisions, past and present, from Wikimedia wikis (except Wikidata). Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history#Schema Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history#Changes_and_known_problems Pipelinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history#Pipeline https://wikitech.wikimedia.org/wiki/Grafana1001 grafana1001 is a virtual machine that runs in Ganeti. It can be controlled from ganeti1003 and runs on ganeti01. Serviceshttps://wikitech.wikimedia.org/wiki/Grafana1001#Services VM Infohttps://wikitech.wikimedia.org/wiki/Grafana1001#VM_Info https://wikitech.wikimedia.org/wiki/OSM_Tileserver This page is for the Cloud VPS project to implement an OpenStreetMap TileServer to serve the same basic data as OSM themselves (synced from them). This is orthogonal to (or in some other sense, a prerequisite for) other OSM efforts going on in Cloud Services for related overlays and databases. Resourceshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#Resources Technology stackhttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#Technology_stack Tile refreshinghttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#Tile_refreshing DSN/Web proxieshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#DSN/Web_proxies Questionshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#Questions Decisionshttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#Decisions See alsohttps://wikitech.wikimedia.org/wiki/OSM_Tileserver#See_also https://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Summary Statshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Stats Issueshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Issues Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Timeline 2018-12-11https://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#2018-12-11 End of Day Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#End_of_Day_Summary 2018-12-12https://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#2018-12-12 2018-12-13https://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#2018-12-13 2018-12-18https://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#2018-12-18 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-12_Train-1.33.0-wmf.8#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#Summary How was this noticed?https://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#How_was_this_noticed? Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#Impact Detailed explanation of the issuehttps://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#Detailed_explanation_of_the_issue Timeline (all timestamps are stated on UTC)https://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#Timeline_(all_timestamps_are_stated_on_UTC) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20181212-icinga-down#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Public_Data_Lake The data we are talking about in this document includes: edits, corrections, uploads, editor history, pageviews.   We will call this usage data `analytics data` in the rest of the document. Value Propositionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Public_Data_Lake#Value_Proposition Technical solutionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Public_Data_Lake#Technical_solution The dataset and dataflowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Public_Data_Lake#The_dataset_and_dataflow The query engine and user accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Public_Data_Lake#The_query_engine_and_user_access WMF-Cloud architecture of SQL enginehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Public_Data_Lake#WMF-Cloud_architecture_of_SQL_engine https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud == Limitations of other public access systems like Analytics API and Quarry == Limitations of other public access systems like Analytics API and Quarryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#Limitations_of_other_public_access_systems_like_Analytics_API_and_Quarry More details on distributed-computation state-of-the-art techniqueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#More_details_on_distributed-computation_state-of-the-art_techniques Parallel computationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#Parallel_computation Columnar file formatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#Columnar_file_formats More details on analytics query engines and file formatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#More_details_on_analytics_query_engines_and_file_formats Query engineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#Query_engines File formats for hadoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/SQL_Engine_on_Cloud#File_formats_for_hadoop https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/12 === Week of December 3rd === Week of December 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/12#Week_of_December_3rd Week of December 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/12#Week_of_December_10th Week of December 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/12#Week_of_December_17th Week of December 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/12#Week_of_December_24th https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Projects/Potentially_unmaintained The following projects appear to have a lack of maintenance. Some are based on the progress shown on the Trusty deprecation tickets in Phabricator, September-December 2018, and some are based on quota requests closed for inactivity. https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service This page provides a brief overview of Server-side Rendering ServiceSource code of the service. Observabilityhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Observability Detailshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Details Overviewhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Overview Technologyhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Technology Deploymenthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Deployment Architecturehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Architecture Initial deployment & load detailshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Initial_deployment_&_load_details Availability objectives and accepted operational errorshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Availability_objectives_and_accepted_operational_errors Debugging and Testing Productionhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#Debugging_and_Testing_Production Referenceshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service#References https://wikitech.wikimedia.org/wiki/Analytics/Archive/Team/Office_Hours The Analytics Engineering Team will have office hours on the second Monday of every month. Join us in . Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019#By_month https://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Summary Statshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Stats Issueshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Issues Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Timeline 2018-12-13https://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#2018-12-13 2018-12-18https://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#2018-12-18 End of Day Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#End_of_Day_Summary 2018-12-19https://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#2018-12-19 2018-12-20https://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#2018-12-20 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2018-12-18_train-1.33.0-wmf.9#Actionables https://wikitech.wikimedia.org/wiki/Proton [is a service that converts the Wikipedia articles into PDF. It uses [https://github. Source Codehttps://wikitech.wikimedia.org/wiki/Proton#Source_Code Monitoringhttps://wikitech.wikimedia.org/wiki/Proton#Monitoring Deploying changeshttps://wikitech.wikimedia.org/wiki/Proton#Deploying_changes Updating Puppeteer & Chromiumhttps://wikitech.wikimedia.org/wiki/Proton#Updating_Puppeteer_&_Chromium Puppeteer updateshttps://wikitech.wikimedia.org/wiki/Proton#Puppeteer_updates Chromium updateshttps://wikitech.wikimedia.org/wiki/Proton#Chromium_updates Puppeteer configurationhttps://wikitech.wikimedia.org/wiki/Proton#Puppeteer_configuration Data flowhttps://wikitech.wikimedia.org/wiki/Proton#Data_flow https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation This page details information about deprecating and removing hosts running Ubuntu Trusty (14.04) as an operating system from the Toolforge infrastructure. What is changing?https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#What_should_I_do? SSH to the Stretch bastionhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#SSH_to_the_Stretch_bastion Move a grid engine webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Move_a_grid_engine_webservice Move a continuous jobhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Move_a_continuous_job Move a cron jobhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Move_a_cron_job What are the primary changes with moving to Stretch?https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#What_are_the_primary_changes_with_moving_to_Stretch? Language runtime and library versionshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Language_runtime_and_library_versions Concurrency limitshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Concurrency_limits Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Solutions_to_common_problems Rebuild virtualenv for python usershttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Rebuild_virtualenv_for_python_users Example 1: Upgrading a Trusty grid engine based tool to the Stretch gridhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Example_1:_Upgrading_a_Trusty_grid_engine_based_tool_to_the_Stretch_grid Example 2: Upgrading a uWSGI webservice into a Kubernetes containerhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Example_2:_Upgrading_a_uWSGI_webservice_into_a_Kubernetes_container Example 3: Upgrading a Kubernetes uWSGI webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Example_3:_Upgrading_a_Kubernetes_uWSGI_webservice PyYAML fails to install in Debian Stretch Python3 virtualenvhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#PyYAML_fails_to_install_in_Debian_Stretch_Python3_virtualenv BotPassword or OAuth grant does not work from new job gridhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#BotPassword_or_OAuth_grant_does_not_work_from_new_job_grid Lighttpd crashes on startup with message "parser failed somehow near here: (EOL)"https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Lighttpd_crashes_on_startup_with_message_"parser_failed_somehow_near_here:_(EOL)" 'webservice stop' says service is not running, but 'webservice start' says service is runninghttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#'webservice_stop'_says_service_is_not_running,_but_'webservice_start'_says_service_is_running Python: redis.exceptions.ResponseError: value is not an integer or out of rangehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Python:_redis.exceptions.ResponseError:_value_is_not_an_integer_or_out_of_range Delete a toolhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Delete_a_tool Python 'oursql' package fails to compilehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Python_'oursql'_package_fails_to_compile SSH to login-stretch.tools.wmflabs.org fails with 'Permission denied (publickey)'https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#SSH_to_login-stretch.tools.wmflabs.org_fails_with_'Permission_denied_(publickey)' SSH to login-stretch.tools.wmflabs.org fails with 'Permission denied (publickey,hostbased)'https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#SSH_to_login-stretch.tools.wmflabs.org_fails_with_'Permission_denied_(publickey,hostbased)' "Unable to run job: Error reading answer list from qmaster"https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#"Unable_to_run_job:_Error_reading_answer_list_from_qmaster" Monitoring toolshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Monitoring_tools Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#Why_are_we_doing_this? See alsohttps://wikitech.wikimedia.org/wiki/News/Toolforge_Trusty_deprecation#See_also https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Module_source __TOC__ View sourcehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Module_source#View_source Find dependencieshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Module_source#Find_dependencies External linkshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Module_source#External_links https://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook This is the runbook for deploying and monitoring webperf services. Hostshttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Hosts navtiminghttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#navtiming Metahttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Meta Monitor navtiminghttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Monitor_navtiming Application logshttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Application_logs Raw eventshttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Raw_events Event validationhttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Event_validation Deploy navtiminghttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Deploy_navtiming Restart navtiminghttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Restart_navtiming Check that Prometheus is runninghttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Check_that_Prometheus_is_running statsvhttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#statsv How it workshttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#How_it_works Logshttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Logs Restart statsvhttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Restart_statsv perfsitehttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#perfsite Deploy the sitehttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Deploy_the_site Former serviceshttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#Former_services coal and coal-webhttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#coal_and_coal-web See alsohttps://wikitech.wikimedia.org/wiki/Performance.wikimedia.org/Runbook#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/01 === Week of December 31st === Week of December 31sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/01#Week_of_December_31st Week of January 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/01#Week_of_January_7th Week of January 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/01#Week_of_January_14th Week of January 21sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/01#Week_of_January_21st Week of January 28thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/01#Week_of_January_28th https://wikitech.wikimedia.org/wiki/Arc_Lamp This is the internal runbook for deploying and monitoring Arc Lamp. Arc Lamp collects stack traces from all MediaWiki production traffic, using [and publishes daily aggregated flame graphs and trace logs to https://performance. Servicehttps://wikitech.wikimedia.org/wiki/Arc_Lamp#Service Provisionhttps://wikitech.wikimedia.org/wiki/Arc_Lamp#Provision Monitoringhttps://wikitech.wikimedia.org/wiki/Arc_Lamp#Monitoring Host migrationhttps://wikitech.wikimedia.org/wiki/Arc_Lamp#Host_migration See alsohttps://wikitech.wikimedia.org/wiki/Arc_Lamp#See_also External linkshttps://wikitech.wikimedia.org/wiki/Arc_Lamp#External_links https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4 == 2018-12-31 == 2018-12-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-31 2018-12-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-22 2018-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-21 2018-12-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-20 2018-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-19 2018-12-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-18 2018-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-17 2018-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-14 2018-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-13 2018-12-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-12 2018-12-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-11 2018-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-09 2018-12-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-05 2018-12-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-04 2018-12-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-12-03 2018-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-30 2018-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-29 2018-11-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-28 2018-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-27 2018-11-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-26 2018-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-23 2018-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-22 2018-11-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-21 2018-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-20 2018-11-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-19 2018-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-17 2018-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-16 2018-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-15 2018-11-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-14 2018-11-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-13 2018-11-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-12 2018-11-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-11 2018-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-09 2018-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-08 2018-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-07 2018-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-06 2018-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-04 2018-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-02 2018-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-11-01 2018-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-31 2018-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-30 2018-10-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-29 2018-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-26 2018-10-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-25 2018-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-24 2018-10-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-23 2018-10-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-22 2018-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-21 2018-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-19 2018-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-18 2018-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-16 2018-10-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-15 2018-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-13 2018-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-12 2018-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-11 2018-10-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-10 2018-10-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-09 2018-10-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-08 2018-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-06 2018-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-05 2018-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-04 2018-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-03 2018-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-02 2018-10-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-10-01 2018-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-29 2018-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-28 2018-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-27 2018-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-26 2018-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-25 2018-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-24 2018-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-23 2018-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-22 2018-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-21 2018-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-20 2018-09-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-19 2018-09-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-18 2018-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-17 2018-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-16 2018-09-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-14 2018-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-13 2018-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-12 2018-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-11 2018-09-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-10 2018-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-09 2018-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-08 2018-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-07 2018-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-06 2018-09-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-05 2018-09-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-04 2018-09-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-03 2018-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-02 2018-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-09-01 2018-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-31 2018-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-30 2018-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-29 2018-08-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-28 2018-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-27 2018-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-25 2018-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-24 2018-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-23 2018-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-22 2018-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-21 2018-08-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-20 2018-08-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-18 2018-08-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-17 2018-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-16 2018-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-15 2018-08-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-14 2018-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-13 2018-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-12 2018-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-10 2018-08-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-09 2018-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-08 2018-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-07 2018-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-06 2018-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-04 2018-08-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-02 2018-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-08-01 2018-07-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-31 2018-07-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-30 2018-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-29 2018-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-28 2018-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-27 2018-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-26 2018-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-24 2018-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-23 2018-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-19 2018-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-17 2018-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-16 2018-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-14 2018-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-13 2018-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-12 2018-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-11 2018-07-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-10 2018-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-09 2018-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-08 2018-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-07 2018-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-06 2018-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-05 2018-07-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-04 2018-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-03 2018-07-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-07-02 2018-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-30 2018-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-28 2018-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-27 2018-06-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-26 2018-06-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-25 2018-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-23 2018-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-22 2018-06-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-21 2018-06-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-20 2018-06-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-19 2018-06-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-18 2018-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-15 2018-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-14 2018-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-13 2018-06-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-12 2018-06-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-11 2018-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-10 2018-06-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-09 2018-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-08 2018-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-07 2018-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-06 2018-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-05 2018-06-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-04 2018-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-02 2018-06-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-06-01 2018-05-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-31 2018-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-30 2018-05-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-29 2018-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-28 2018-05-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-27 2018-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-26 2018-05-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-25 2018-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-24 2018-05-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-23 2018-05-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-22 2018-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-21 2018-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-20 2018-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-19 2018-05-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-18 2018-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-17 2018-05-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-16 2018-05-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-15 2018-05-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-14 2018-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-11 2018-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-10 2018-05-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-09 2018-05-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-08 2018-05-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-07 2018-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-06 2018-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-05 2018-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-04 2018-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-03 2018-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-02 2018-05-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-05-01 2018-04-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-30 2018-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-27 2018-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-26 2018-04-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-25 2018-04-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-24 2018-04-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-23 2018-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-20 2018-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-19 2018-04-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-18 2018-04-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-17 2018-04-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-16 2018-04-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-13 2018-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-12 2018-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-11 2018-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-10 2018-04-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-09 2018-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-06 2018-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-05 2018-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-04 2018-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-03 2018-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-04-02 2018-03-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-31 2018-03-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-30 2018-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-29 2018-03-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-28 2018-03-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-27 2018-03-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-26 2018-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-23 2018-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-22 2018-03-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-21 2018-03-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-20 2018-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-19 2018-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-18 2018-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-16 2018-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-15 2018-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-14 2018-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-13 2018-03-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-12 2018-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-10 2018-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-09 2018-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-08 2018-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-07 2018-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-06 2018-03-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-05 2018-03-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-04 2018-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-02 2018-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-03-01 2018-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-28 2018-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-27 2018-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-26 2018-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-24 2018-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-23 2018-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-22 2018-02-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-21 2018-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-20 2018-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-19 2018-02-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-18 2018-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-16 2018-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-15 2018-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-14 2018-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-13 2018-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-12 2018-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-10 2018-02-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-09 2018-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-08 2018-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-07 2018-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-06 2018-02-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-05 2018-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-04 2018-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-03 2018-02-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-02-01 2018-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-31 2018-01-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-30 2018-01-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-29 2018-01-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-24 2018-01-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-23 2018-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-22 2018-01-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-20 2018-01-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-19 2018-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-18 2018-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-17 2018-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-16 2018-01-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-15 2018-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-12 2018-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-11 2018-01-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-10 2018-01-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-09 2018-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-08 2018-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-05 2018-01-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-03 2018-01-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_4#2018-01-01 https://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci This page attempts to describe the Wikimedia Foundation Continuous Integration system, as of early 2019. Originally written by Lars Wirzenius from the Release Engineering team. Overviewhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Overview Gerrit - git and code reviewhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Gerrit_-_git_and_code_review Zuul - gating and process managementhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Zuul_-_gating_and_process_management Gearmanhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Gearman Jenkinshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Jenkins Second git server?https://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Second_git_server? The integration/config git repositoryhttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#The_integration/config_git_repository Linkshttps://wikitech.wikimedia.org/wiki/Streamlined_Service_Delivery_Design/current-ci#Links https://wikitech.wikimedia.org/wiki/Shell_Request/Binod_Basnet Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Toolschecker is a Flask application that runs various active checks on Toolforge and Cloud VPS infrastructure in response to HTTP requests. Each check is exposed as a separate URL on the checker. Servershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#Servers Checkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#Checks /dns/privatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/dns/private /etcd/k8shttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/etcd/k8s /ldaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/ldap /nfs/dumpshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/nfs/dumps /nfs/homehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/nfs/home /redishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/redis /selfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker#/self https://wikitech.wikimedia.org/wiki/Blubber/Tutorial https://wikitech.wikimedia.org/wiki/Blubber/Download https://wikitech.wikimedia.org/wiki/Blubber/Idea https://wikitech.wikimedia.org/wiki/Blubber/Examples https://wikitech.wikimedia.org/wiki/Blubber/Tutorial/HelloWorldRedux https://wikitech.wikimedia.org/wiki/Blubber/Tutorial/HelloNode https://wikitech.wikimedia.org/wiki/Blubber/Tutorial/HelloWorld https://wikitech.wikimedia.org/wiki/Blubber/Pipeline https://wikitech.wikimedia.org/wiki/Incidents/2019-01-10_WDQS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-10_WDQS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-10_WDQS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-10_WDQS#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-10_WDQS#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-10_WDQS#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week Ops week duty rotation is a way for the [Platform Engineering] team to have a designated responsible party for monitoring the applications and jobs that run on our infrastructure, as well as to handle unplanned, maintenance work that arises during a sprint. By having a single person responsible for much of this work, it allows the rest of the team to focus on planned work. Ops week assignmenthttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Ops_week_assignment Hand offhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Hand_off Communicationhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Communication Emailhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Email IRC and the Server Admin Log (SAL)https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#IRC_and_the_Server_Admin_Log_(SAL) Working in off hourshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Working_in_off_hours Ops week dutieshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Ops_week_duties Things to do at some point during the weekhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Things_to_do_at_some_point_during_the_week Monitor Dashboardshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Monitor_Dashboards Have any users left the Foundation?https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Have_any_users_left_the_Foundation? Full removal of files and Hive databases and tableshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Full_removal_of_files_and_Hive_databases_and_tables Archival of user fileshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Archival_of_user_files Things to do every Tuesdayhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Things_to_do_every_Tuesday The Data Engineering deployment train 🚂https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#The_Data_Engineering_deployment_train_🚂 Things to check every dayhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Things_to_check_every_day Have new wikis been created?https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Have_new_wikis_been_created? Adding new wikis to the sqoop listhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Adding_new_wikis_to_the_sqoop_list Adding new wikis to the pageview allow listhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Adding_new_wikis_to_the_pageview_allow_list Have any alarms been triggered?https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Have_any_alarms_been_triggered? Airflowhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Airflow Canary Event Alertshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Canary_Event_Alerts Some common reasons canary_events DAG might fail:https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Some_common_reasons_canary_events_DAG_might_fail: Anomaly detection alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Anomaly_detection_alarms Failed systemd/journald based jobshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Failed_systemd/journald_based_jobs HDFS alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#HDFS_alarms Sqoop failureshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Sqoop_failures Data loss alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Data_loss_alarms Mediawiki Denormalize checker alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Mediawiki_Denormalize_checker_alarms Reportupdater failureshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Reportupdater_failures Druid indexation job failshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Druid_indexation_job_fails Deletion script alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Deletion_script_alarms Refine failure reporthttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Refine_failure_report Mediawiki page content change enrich alarmshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Mediawiki_page_content_change_enrich_alarms Debug Java applications in troublehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Debug_Java_applications_in_trouble Useful administration resourceshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Useful_administration_resources Useful Kerberos commandshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Useful_Kerberos_commands Restart daemonshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Restart_daemons Airflow - backfilling and rerunning taskshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Ops_week#Airflow_-_backfilling_and_rerunning_tasks https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dealing_with_data_loss_alarms We monitor webrequest-dataloss for a given webrequest_source and hour using 2 mechanisms: Check dataloss False positiveshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dealing_with_data_loss_alarms#Check_dataloss_False_positives Incomplete Recordshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dealing_with_data_loss_alarms#Incomplete_Records Rerunning a failed webrequest jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Dealing_with_data_loss_alarms#Rerunning_a_failed_webrequest_job https://wikitech.wikimedia.org/wiki/Prometheus/statsd_k8s = Introduction / motivation = Introduction / motivationhttps://wikitech.wikimedia.org/wiki/Prometheus/statsd_k8s#Introduction_/_motivation Choosing metric names and tagshttps://wikitech.wikimedia.org/wiki/Prometheus/statsd_k8s#Choosing_metric_names_and_tags Global aggregation considerationshttps://wikitech.wikimedia.org/wiki/Prometheus/statsd_k8s#Global_aggregation_considerations Example mappingshttps://wikitech.wikimedia.org/wiki/Prometheus/statsd_k8s#Example_mappings https://wikitech.wikimedia.org/wiki/SRE_Offboarding This page only details SRE-specificic steps, the offboarding for non-SRE users is listed at https://office.wikimedia. Phabricator tickethttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Phabricator_ticket Review access to internal IRC channelshttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Review_access_to_internal_IRC_channels Remove from ops mailing lists (ops and ops-private)https://wikitech.wikimedia.org/wiki/SRE_Offboarding#Remove_from_ops_mailing_lists_(ops_and_ops-private) Remove from Exim aliases from private.githttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Remove_from_Exim_aliases_from_private.git Remove VictorOps userhttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Remove_VictorOps_user Remove Icinga userhttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Remove_Icinga_user Remove from pwstorehttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Remove_from_pwstore Remove from Google group for private groupshttps://wikitech.wikimedia.org/wiki/SRE_Offboarding#Remove_from_Google_group_for_private_groups Review access to network devices (and potentially remove access)https://wikitech.wikimedia.org/wiki/SRE_Offboarding#Review_access_to_network_devices_(and_potentially_remove_access) https://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Summary Timeline (all times are in UTC):https://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Timeline_(all_times_are_in_UTC): Hosts that went downhttps://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Hosts_that_went_down Services impactedhttps://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Services_impacted Next stepshttps://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Next_steps Operations loghttps://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Operations_log Action itemshttps://wikitech.wikimedia.org/wiki/Incidents/20190115-PDU-fuses-blown#Action_items https://wikitech.wikimedia.org/wiki/Acme-chief Acme-chief is an application resulting from the Wikimedia Hackathon 2018 that is to be used to centrally request configured TLS certificates from ACME servers, then make the public and private parts available to authorised API users. Monitoringhttps://wikitech.wikimedia.org/wiki/Acme-chief#Monitoring Production environmenthttps://wikitech.wikimedia.org/wiki/Acme-chief#Production_environment Replacing the active instancehttps://wikitech.wikimedia.org/wiki/Acme-chief#Replacing_the_active_instance See alsohttps://wikitech.wikimedia.org/wiki/Acme-chief#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers In [we decided to move away as much as possible from cron jobs since we were struggling to alarm when a job failed. Most of our recurrent jobs are running on an-coord1001 (analytics cluster coordinator), and the majority of them are systemd timers. Anatomy of a Systemd timerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Anatomy_of_a_Systemd_timer ExecStart and difference with bashhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#ExecStart_and_difference_with_bash Calculating OnCalendar intervalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Calculating_OnCalendar_interval Operationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Operations List all timers running on the hosthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#List_all_timers_running_on_the_host List command timers are actually runninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#List_command_timers_are_actually_running Check which user runs a timerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Check_which_user_runs_a_timer Disable a Systemd timerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Disable_a_Systemd_timer Shut off / Reset Icinga alert already firedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Shut_off_/_Reset_Icinga_alert_already_fired Check logs for a systemd timerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Check_logs_for_a_systemd_timer Failed service procedure (ops week)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Failed_service_procedure_(ops_week) Checking logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Checking_logs Resetting service status to normalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Managing_systemd_timers#Resetting_service_status_to_normal https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry This page describes the Docker registry setup in the Toolforge platform. Deployment components and architecturehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Deployment_components_and_architecture Servershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Servers DNS, addressing and SSLhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#DNS,_addressing_and_SSL Registry contenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Registry_content Puppethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Puppet System administrationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#System_administration Healthhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Health Registry failoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Registry_failover Updating SSL certificatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Updating_SSL_certificate Other operationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Other_operations Uploading custom docker images from an external registryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Uploading_custom_docker_images_from_an_external_registry Uploading custom docker images from a git repositoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Uploading_custom_docker_images_from_a_git_repository Delete old imageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#Delete_old_images See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Docker-registry#See_also https://wikitech.wikimedia.org/wiki/Incidents/2019-01-17_RESTBase-Parsoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-17_RESTBase-Parsoid#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-17_RESTBase-Parsoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-17_RESTBase-Parsoid#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-17_RESTBase-Parsoid#Actionables https://wikitech.wikimedia.org/wiki/Technical_debt ===Sub pages=== Sub pageshttps://wikitech.wikimedia.org/wiki/Technical_debt#Sub_pages https://wikitech.wikimedia.org/wiki/WMDE/Cognate The Cognate DB runs on the extension1 cluster. Use sql to get to the cognate tableshttps://wikitech.wikimedia.org/wiki/WMDE/Cognate#Use_sql_to_get_to_the_cognate_tables Check if a site has been added to Cognate systemhttps://wikitech.wikimedia.org/wiki/WMDE/Cognate#Check_if_a_site_has_been_added_to_Cognate_system Adding a site to the Cognate system manuallyhttps://wikitech.wikimedia.org/wiki/WMDE/Cognate#Adding_a_site_to_the_Cognate_system_manually Catching up cognate after a period of x1 read only time (when writes were still happening on wiki)https://wikitech.wikimedia.org/wiki/WMDE/Cognate#Catching_up_cognate_after_a_period_of_x1_read_only_time_(when_writes_were_still_happening_on_wiki) https://wikitech.wikimedia.org/wiki/Security/logging = Security Logging Use Cases/Work = Security Logging Use Cases/Workhttps://wikitech.wikimedia.org/wiki/Security/logging#Security_Logging_Use_Cases/Work 01/22/2019https://wikitech.wikimedia.org/wiki/Security/logging#01/22/2019 https://wikitech.wikimedia.org/wiki/Phabricator/Meeting_Notes/2019-01-23 == Phabricator Upgrade Planning Meeting - 2019/01/23 == Phabricator Upgrade Planning Meeting - 2019/01/23https://wikitech.wikimedia.org/wiki/Phabricator/Meeting_Notes/2019-01-23#Phabricator_Upgrade_Planning_Meeting_-_2019/01/23 Raw meeting noteshttps://wikitech.wikimedia.org/wiki/Phabricator/Meeting_Notes/2019-01-23#Raw_meeting_notes collection of related tickets (and notes)https://wikitech.wikimedia.org/wiki/Phabricator/Meeting_Notes/2019-01-23#collection_of_related_tickets_(and_notes) https://wikitech.wikimedia.org/wiki/Incidents/2019-01-22_maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-22_maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-22_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-22_maps#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-01-22_maps#Actionables https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37 ==2019-04-30== 2019-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-30 2019-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-29 2019-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-28 2019-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-27 2019-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-26 2019-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-25 2019-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-24 2019-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-23 2019-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-22 2019-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-21 2019-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-20 2019-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-19 2019-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-18 2019-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-17 2019-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-16 2019-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-15 2019-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-14 2019-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-13 2019-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-12 2019-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-11 2019-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-10 2019-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-09 2019-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-08 2019-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-07 2019-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-06 2019-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-05 2019-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-04 2019-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-03 2019-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-02 2019-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-04-01 2019-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-31 2019-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-30 2019-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-29 2019-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-28 2019-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-27 2019-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-26 2019-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-25 2019-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-24 2019-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-23 2019-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-22 2019-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-21 2019-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-20 2019-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-19 2019-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-18 2019-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-17 2019-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-16 2019-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-15 2019-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-14 2019-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-13 2019-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-12 2019-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-11 2019-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-10 2019-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-08 2019-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-07 2019-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-06 2019-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-05 2019-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-04 2019-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-03 2019-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-02 2019-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-03-01 2019-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-28 2019-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-27 2019-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-26 2019-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-25 2019-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-24 2019-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-22 2019-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-21 2019-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-20 2019-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-19 2019-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-18 2019-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-17 2019-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-16 2019-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-15 2019-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-14 2019-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-13 2019-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-12 2019-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-11 2019-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-10 2019-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-09 2019-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-08 2019-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-07 2019-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-06 2019-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-05 2019-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-04 2019-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-03 2019-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-02 2019-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-02-01 2019-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-31 2019-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-30 2019-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-29 2019-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-28 2019-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-27 2019-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-26 2019-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-25 2019-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-24 2019-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-23 2019-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-22 2019-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-21 2019-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-20 2019-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-19 2019-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-18 2019-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-17 2019-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-16 2019-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-15 2019-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-14 2019-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-13 2019-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-12 2019-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-11 2019-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-10 2019-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-09 2019-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-08 2019-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-07 2019-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-06 2019-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-05 2019-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-04 2019-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-03 2019-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#2019-01-02 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_37#Other_archives https://wikitech.wikimedia.org/wiki/SRE/Dc-operations This landing page will serve as an index for DC Ops team specific Wikitech pages. In addition to this landing page, Data Center Operations maintains a landing page in Phabricator. SLAshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations#SLAs Other Infohttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations#Other_Info Runbookshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations#Runbooks https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook This workbook should be applied in the following manner: Part 1: All SRE Teamshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Part_1:_All_SRE_Teams All Hardwarehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#All_Hardware Hardware Failure Log Gatheringhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Hardware_Failure_Log_Gathering Any System with OS runninghttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Any_System_with_OS_running Dell Systemshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Dell_Systems HP Systemshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#HP_Systems iLom Command Failureshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#iLom_Command_Failures Power Supply Failureshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Power_Supply_Failures HDD & SSD Failureshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#HDD_&_SSD_Failures Determining type of disk raidhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Determining_type_of_disk_raid Software Raid Information Gatheringhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Software_Raid_Information_Gathering Hardware Raid Information Gatheringhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Hardware_Raid_Information_Gathering Dell Hardware Raid Information Gatheringhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Dell_Hardware_Raid_Information_Gathering HP Hardware Raid Information Gatheringhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#HP_Hardware_Raid_Information_Gathering All Other Failureshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#All_Other_Failures Gathering Support Logs for Warranty Replacementhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Gathering_Support_Logs_for_Warranty_Replacement Dell Support Assist Reporthttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Dell_Support_Assist_Report HPhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#HP Part 2: DC Operations Team Stepshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Part_2:_DC_Operations_Team_Steps Memory Failureshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Memory_Failures Warranty Support w/ Vendorhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Warranty_Support_w/_Vendor Dellhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Dell Part 3: All SRE Teamshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Part_3:_All_SRE_Teams Getting your server backhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Hardware_Troubleshooting_Runbook#Getting_your_server_back https://wikitech.wikimedia.org/wiki/Systemd_resource_control This page shares a mechanism for doing server resource control for users using systemd. How it workshttps://wikitech.wikimedia.org/wiki/Systemd_resource_control#How_it_works checking the configurationhttps://wikitech.wikimedia.org/wiki/Systemd_resource_control#checking_the_configuration Configurationhttps://wikitech.wikimedia.org/wiki/Systemd_resource_control#Configuration Puppet exampleshttps://wikitech.wikimedia.org/wiki/Systemd_resource_control#Puppet_examples https://wikitech.wikimedia.org/wiki/Grafana/Best_practices This page describes best practices for Grafana dashboards at Wikimedia. This page was previously maintained as part of Performance Team guides and SRE Observability guidelines. High-level approachhttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#High-level_approach The USE Methodhttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#The_USE_Method Four golden signals (4GS)https://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Four_golden_signals_(4GS) Dashboard layouthttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Dashboard_layout Legendhttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Legend Dashboard settingshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Dashboard_settings General settingshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#General_settings Annotationshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Annotations Manual annotationshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Manual_annotations MediaWiki deploymentshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#MediaWiki_deployments Graph panelshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Graph_panels Keep your graph focusedhttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Keep_your_graph_focused Draw modehttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Draw_mode Graph recommended settingshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Graph_recommended_settings Graph with many metricshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Graph_with_many_metrics Alert ruleshttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#Alert_rules See alsohttps://wikitech.wikimedia.org/wiki/Grafana/Best_practices#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies Around the end of 2018 we added support for project families (all wikipedias, all wiktionaries, all wikivoyages...) to a number of contributor-related metrics in Wikistats 2. Analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Analysis Definition of project familieshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Definition_of_project_families Obtention of Wikistats 2 datahttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Obtention_of_Wikistats_2_data The Nostalgia Wikipedia casehttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#The_Nostalgia_Wikipedia_case Editshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Edits Average of new articles per dayhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Average_of_new_articles_per_day Present-day variationhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Present-day_variation Total article counthttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Total_article_count Calculations and additional info of interesthttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/VettingPerProjectFamilies#Calculations_and_additional_info_of_interest https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline HiveToDruid is a Spark/Scala job which is part of the WMF's analytics data pipeline. It allows to easily load Hive tables to Druid. How to configurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#How_to_configure Dimensionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Dimensions Metricshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Metrics Transformshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Transforms Time measure bucketshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Time_measure_buckets Struct, Map or Array fieldshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Struct,_Map_or_Array_fields How to run programaticallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#How_to_run_programatically How to run from the command linehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#How_to_run_from_the_command_line If you need to delete data and start againhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#If_you_need_to_delete_data_and_start_again How to run from Puppethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#How_to_run_from_Puppet Expected resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Expected_results Limitations/gotchashttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#Limitations/gotchas See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive_to_Druid_Ingestion_Pipeline#See_also https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Python_coding See the newer page for the latest practices. Formattinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Python_coding#Formatting Configuration Datahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Python_coding#Configuration_Data https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/02 === Week of February 4th === Week of February 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/02#Week_of_February_4th Week of February 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/02#Week_of_February_11th Week of February 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/02#Week_of_February_18th Week of February 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/02#Week_of_February_25th https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/ShellScript_coding This is a proposal to start the conversation for now. Also see Wikimedia_Cloud_Services_team/Python_coding. Google Shell Style Guidehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/ShellScript_coding#Google_Shell_Style_Guide Linterhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/ShellScript_coding#Linter https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist A list of items that we should think about before deploying new services/components/changes in production. Support Lifecyclehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Support_Lifecycle Service Levelhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Service_Level Infrastructure componentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Infrastructure_components Resource Limitshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Resource_Limits Performance Testshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Performance_Tests User Facinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#User_Facing Building Blockshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Building_Blocks Documentationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Documentation User Documentationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#User_Documentation Admin Documentationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Admin_Documentation Monitoringhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Monitoring Servershttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Servers Critical Service Componentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Critical_Service_Components Blackbox Monitoringhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Blackbox_Monitoring Whitebox Monitoringhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Whitebox_Monitoring Backupshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#Backups See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#See_also External Resourceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Readiness_Checklist#External_Resources https://wikitech.wikimedia.org/wiki/Blogposts Propose topics we could blog about, and spread love and knowledge. Upcoming postshttps://wikitech.wikimedia.org/wiki/Blogposts#Upcoming_posts See alsohttps://wikitech.wikimedia.org/wiki/Blogposts#See_also https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy = Current problem = Current problemhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Current_problem Possible solutionshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Possible_solutions Vertical scaling [lag,capacity]https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Vertical_scaling_[lag,capacity] Optimizations [lag]https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Optimizations_[lag] Increase parallelismhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Increase_parallelism Rework the update processhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Rework_the_update_process Backpressure propagation [lag]https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Backpressure_propagation_[lag] Horizontal scaling via sharding [lag,capacity]https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Horizontal_scaling_via_sharding_[lag,capacity] Find a storage solution that can do sharding nativelyhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Find_a_storage_solution_that_can_do_sharding_natively Find ways/criteria to split the data into multiple distinct groupshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Find_ways/criteria_to_split_the_data_into_multiple_distinct_groups Split direct vs fully reified statements version of the graphhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Split_direct_vs_fully_reified_statements_version_of_the_graph Split data horizontally (shard per entity)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/ScalingStrategy#Split_data_horizontally_(shard_per_entity) https://wikitech.wikimedia.org/wiki/Incidents/2019-02-11_varnish == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-11_varnish#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-11_varnish#Timeline Explanationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-11_varnish#Explanation Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-11_varnish#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-11_varnish#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-02-08_logstash-mediawiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-08_logstash-mediawiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-08_logstash-mediawiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-08_logstash-mediawiki#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-08_logstash-mediawiki#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-08_logstash-mediawiki#Actionables https://wikitech.wikimedia.org/wiki/Security_update When you notice a security report on one of the following lists you should first check debmonitor to see if we are affected and if we are follow the process here Phabricator tickethttps://wikitech.wikimedia.org/wiki/Security_update#Phabricator_ticket Check for reported regressionshttps://wikitech.wikimedia.org/wiki/Security_update#Check_for_reported_regressions Review: Review the fixhttps://wikitech.wikimedia.org/wiki/Security_update#Review:_Review_the_fix Review: Review the packagehttps://wikitech.wikimedia.org/wiki/Security_update#Review:_Review_the_package Build a spec file and deployhttps://wikitech.wikimedia.org/wiki/Security_update#Build_a_spec_file_and_deploy https://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_cloudvps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_cloudvps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_cloudvps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_cloudvps#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_cloudvps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_cloudvps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_PAWS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_PAWS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_PAWS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_PAWS#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_PAWS#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-13_PAWS#Actionables https://wikitech.wikimedia.org/wiki/Deployment_pipeline 600px|frameless|center|middle Deploymenthttps://wikitech.wikimedia.org/wiki/Category:Deployment Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals Enhancement proposals are a combination of [man proposal|straw dog proposal], design document, and discussion to work out non-trivial changes to Cloud Services platforms and services. https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks === Problem Statement === Problem Statementhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Problem_Statement Proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Proposal Technical Impacthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Technical_Impact Timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Timeline Votinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Voting Decisionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Decision RAID configurationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#RAID_configuration Dell servershttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Dell_servers HP servers (Gen8)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#HP_servers_(Gen8) HP servers (Gen9)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#HP_servers_(Gen9) Resourceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/SpareDisks#Resources https://wikitech.wikimedia.org/wiki/Incidents/2019-02-14_labsdb1005 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-14_labsdb1005#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-14_labsdb1005#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-14_labsdb1005#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-14_labsdb1005#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-14_labsdb1005#Actionables https://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel This is the runbook for making Fresnel releases and deploying changes to the Fresnel Jenkins jobs. Metahttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#Meta Releasehttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#Release Deployhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#Deploy Update Dockerfilehttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#Update_Dockerfile Update Jenkins jobhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#Update_Jenkins_job Deploy Jenkins jobhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#Deploy_Jenkins_job See alsohttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Fresnel#See_also https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement ONgoing reFormulation of Incident Response Efforts (ONFIRE) The problemhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement#The_problem Paging & Incident Response Working Grouphttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement#Paging_&_Incident_Response_Working_Group https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source This page describes how we fetch Openstack source code and install it to our machines. From Debian packageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#From_Debian_packages Version matrixhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#Version_matrix Server vs Client packageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#Server_vs_Client_packages puppet code organizationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#puppet_code_organization importing packages into our repreprohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#importing_packages_into_our_reprepro From source codehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#From_source_code See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_source#See_also https://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019) == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Background Goalhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Goal Test setuphttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Test_setup Test scenarioshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Test_scenarios Tested URLshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Tested_URLs Indiahttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#India Desktophttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Desktop Mobilehttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Mobile Swedenhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Sweden Metricshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Metrics Resulthttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Result Slow connection (3g) mobile in Indiahttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Slow_connection_(3g)_mobile_in_India Cable connection desktop in Indiahttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Cable_connection_desktop_in_India Slow connection (3g) mobile in Swedenhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Slow_connection_(3g)_mobile_in_Sweden Cable connection desktop in Swedenhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Cable_connection_desktop_in_Sweden Summaryhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Summary Raw resultshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Raw_results Sweden First Visual Changehttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Sweden_First_Visual_Change Page weight and requests desktop Swedenhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Page_weight_and_requests_desktop_Sweden Page weight and requests mobile Swedenhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Page_weight_and_requests_mobile_Sweden Measuring the login step Swedenhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Measuring_the_login_step_Sweden India First Visual Changehttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#India_First_Visual_Change Page weight and requests desktop Indiahttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Page_weight_and_requests_desktop_India Page weight and requests mobile Indiahttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Page_weight_and_requests_mobile_India Measuring the login step Indiahttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Measuring_the_login_step_India Scriptshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Synthetic_Measurement_Experiment_(2019)#Scripts https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Resizing_instances Resizing an OpenStack instance is a variation on the process of migrating an instance from one cloudvirt to another. In addition to the normal things that happen during a migration, the resize also changes the flavor of the newly migrated instance. Resize processhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Resizing_instances#Resize_process https://wikitech.wikimedia.org/wiki/Incidents/2019-02-20_irc-outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-20_irc-outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-20_irc-outage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-20_irc-outage#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-20_irc-outage#Actionables https://wikitech.wikimedia.org/wiki/Event_Platform The Wikimedia Event Platform exists to enable software and systems engineers to build loosely coupled software systems with event driven architectures. Systems built this way can be easily distributed and decoupled, allowing for inherent horizontal scalability and versatility with respect to yet-unknown use cases. Platform Architecture Diagramhttps://wikitech.wikimedia.org/wiki/Event_Platform#Platform_Architecture_Diagram Philosophy and data modelhttps://wikitech.wikimedia.org/wiki/Event_Platform#Philosophy_and_data_model Event Platform generic conceptshttps://wikitech.wikimedia.org/wiki/Event_Platform#Event_Platform_generic_concepts Background readinghttps://wikitech.wikimedia.org/wiki/Event_Platform#Background_reading Historyhttps://wikitech.wikimedia.org/wiki/Event_Platform#History Referenceshttps://wikitech.wikimedia.org/wiki/Event_Platform#References https://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches This is a runbook for testing and staging Puppet patches on servers in the Beta Cluster. Metahttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches#Meta Writing a patchhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches#Writing_a_patch Testing a patchhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches#Testing_a_patch Staging a patchhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches#Staging_a_patch Puppet compilerhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches#Puppet_compiler Beta Cluster testinghttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/Puppet_patches#Beta_Cluster_testing https://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change = What is a database schema change and why might I need one? = What is a database schema change and why might I need one?https://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change#What_is_a_database_schema_change_and_why_might_I_need_one? What is a schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change#What_is_a_schema_change What is *not* a schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change#What_is_*not*_a_schema_change How long does a schema change takehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change#How_long_does_a_schema_change_take Are you ready to request a database schema change?https://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change#Are_you_ready_to_request_a_database_schema_change? https://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/workflow = Workflow for requesting a database schema change = Workflow for requesting a database schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/workflow#Workflow_for_requesting_a_database_schema_change How to request a database schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/workflow#How_to_request_a_database_schema_change Want specific examples and more background information on making database schema changes?https://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/workflow#Want_specific_examples_and_more_background_information_on_making_database_schema_changes? https://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples = Background information and examples of database schema changes = Background information and examples of database schema changeshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Background_information_and_examples_of_database_schema_changes Examples of schema changeshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Examples_of_schema_changes Relatively easy schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Relatively_easy_schema_change Examples of already done schema changeshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Examples_of_already_done_schema_changes Example of an easy schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Example_of_an_easy_schema_change Example of a difficult schema changehttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Example_of_a_difficult_schema_change Wikimedia project tagshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Wikimedia_project_tags MediaWiki project tagshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#MediaWiki_project_tags Advice on schema changeshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Advice_on_schema_changes Potential dangers of schema changeshttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#Potential_dangers_of_schema_changes See alsohttps://wikitech.wikimedia.org/wiki/What_is_a_database_schema_change/examples#See_also https://wikitech.wikimedia.org/wiki/Security/Debdeploy (These are obsolete docs, recent documentation can be found at Security/Production_updates https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Virt_capacity == Assessing current usage == Assessing current usagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Virt_capacity#Assessing_current_usage How much is enough?https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Virt_capacity#How_much_is_enough? Idle capacity, aka Lifeboatshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Virt_capacity#Idle_capacity,_aka_Lifeboats What happens if a cloudvirt is overloaded?https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Virt_capacity#What_happens_if_a_cloudvirt_is_overloaded? https://wikitech.wikimedia.org/wiki/Incidents/2019-03-01_proton == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-01_proton#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-01_proton#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-01_proton#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-01_proton#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-01_proton#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-02-28_eventbus_extension_and_logstash == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-28_eventbus_extension_and_logstash#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-28_eventbus_extension_and_logstash#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-28_eventbus_extension_and_logstash#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-02-28_eventbus_extension_and_logstash#Actionables https://wikitech.wikimedia.org/wiki/Dumps Documentation about Dumps is stored in a few different wikis: Daily checkshttps://wikitech.wikimedia.org/wiki/Dumps#Daily_checks Dumps typeshttps://wikitech.wikimedia.org/wiki/Dumps#Dumps_types Servicehttps://wikitech.wikimedia.org/wiki/Dumps#Service Hardwarehttps://wikitech.wikimedia.org/wiki/Dumps#Hardware Adding new dumpshttps://wikitech.wikimedia.org/wiki/Dumps#Adding_new_dumps Not an SLO but...https://wikitech.wikimedia.org/wiki/Dumps#Not_an_SLO_but... Testing changes to the dumps or new scriptshttps://wikitech.wikimedia.org/wiki/Dumps#Testing_changes_to_the_dumps_or_new_scripts Dealing with problemshttps://wikitech.wikimedia.org/wiki/Dumps#Dealing_with_problems Mirrorshttps://wikitech.wikimedia.org/wiki/Dumps#Mirrors Source codehttps://wikitech.wikimedia.org/wiki/Dumps#Source_code https://wikitech.wikimedia.org/wiki/Dumps/WikidataDumps This page is about the Wikidata entity dumps. For information about the xml/sql dumps, please see Dumps/XML-SQL Dumps. Dumpshttps://wikitech.wikimedia.org/wiki/Category:Dumps https://wikitech.wikimedia.org/wiki/Dumps/CategoriesRDF This doc is about the dumps of categories in rdf format. For information about the xml/sql dumps including the category-related tables, please see Dumps/XML-SQL Dumps. Dumpshttps://wikitech.wikimedia.org/wiki/Category:Dumps https://wikitech.wikimedia.org/wiki/Dumps/OtherMisc This page documents various dumpsets that are produced daily or weekly, not part of the generation of the xml/sql dumps. https://wikitech.wikimedia.org/wiki/WebPageReplay/Runbook This is the runbook for deploying new versions of WebPageReplay/Browsertime/Firefox/Chrome. Metahttps://wikitech.wikimedia.org/wiki/WebPageReplay/Runbook#Meta Update to new versionhttps://wikitech.wikimedia.org/wiki/WebPageReplay/Runbook#Update_to_new_version Deploy first timehttps://wikitech.wikimedia.org/wiki/WebPageReplay/Runbook#Deploy_first_time Debug missing metricshttps://wikitech.wikimedia.org/wiki/WebPageReplay/Runbook#Debug_missing_metrics https://wikitech.wikimedia.org/wiki/Fresnel Fresnel is an automated tool for creating and comparing performance reports about web pages. It is used at Wikimedia Foundation to provide continuous feedback about the client-side performance of MediaWiki. Find resulthttps://wikitech.wikimedia.org/wiki/Fresnel#Find_result Rerunhttps://wikitech.wikimedia.org/wiki/Fresnel#Rerun Scenario comparisonshttps://wikitech.wikimedia.org/wiki/Fresnel#Scenario_comparisons Recordinghttps://wikitech.wikimedia.org/wiki/Fresnel#Recording Comparison tablehttps://wikitech.wikimedia.org/wiki/Fresnel#Comparison_table Artefactshttps://wikitech.wikimedia.org/wiki/Fresnel#Artefacts Find artefactshttps://wikitech.wikimedia.org/wiki/Fresnel#Find_artefacts Performance Timelinehttps://wikitech.wikimedia.org/wiki/Fresnel#Performance_Timeline Screenshotshttps://wikitech.wikimedia.org/wiki/Fresnel#Screenshots Run Fresnel locallyhttps://wikitech.wikimedia.org/wiki/Fresnel#Run_Fresnel_locally How it all workshttps://wikitech.wikimedia.org/wiki/Fresnel#How_it_all_works Quick MediaWikihttps://wikitech.wikimedia.org/wiki/Fresnel#Quick_MediaWiki Code stewardhttps://wikitech.wikimedia.org/wiki/Fresnel#Code_steward See alsohttps://wikitech.wikimedia.org/wiki/Fresnel#See_also https://wikitech.wikimedia.org/wiki/Incidents/20190308-maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20190308-maps#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20190308-maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20190308-maps#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/20190308-maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20190308-maps#Actionables https://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy This policy regulates Linux distribution updates for the Wikimedia production cluster and related infrastructure. In a nutshell, we use Debian and deprecate versions three years after release and remove them completely from our infrastructure by four years after their release. Current effective sunset dates for each distro (rounded to quarters)https://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Current_effective_sunset_dates_for_each_distro_(rounded_to_quarters) Policyhttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Policy Backgroundhttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Background Need for a policyhttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Need_for_a_policy Debian release cadencehttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Debian_release_cadence Support stages for Debian releaseshttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Support_stages_for_Debian_releases Timeline of previous distribution deprecationshttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Timeline_of_previous_distribution_deprecations See alsohttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#See_also Footnoteshttps://wikitech.wikimedia.org/wiki/Operating_system_upgrade_policy#Footnotes https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing This page contains information on testing puppet code related to Cloud VPS hardware servers inside VM instances, specially openstack puppet code. This is, testing in virtual machines the puppet code meant for the hardware. General instructionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing#General_instructions Workflowhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing#Workflow Configuration for cloudnet servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing#Configuration_for_cloudnet_servers Configuration for cloudvirt servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing#Configuration_for_cloudvirt_servers Configuration for cloudcontrol servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing#Configuration_for_cloudcontrol_servers Configuration for labmon servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Puppet_testing#Configuration_for_labmon_servers https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/03 === Week of March 4th === Week of March 4thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/03#Week_of_March_4th Week of March 11thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/03#Week_of_March_11th Week of March 18thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/03#Week_of_March_18th Week of March 25thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/03#Week_of_March_25th https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/PropertySuggester_update Occasionally, the data for the legacy [suggester] needs to be updated from the latest JSON dumps. One-time setuphttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/PropertySuggester_update#One-time_setup Each updatehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/PropertySuggester_update#Each_update https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth Last updated March 2020 Data & Writinghttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Data_&_Writing Edit ratehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Edit_rate Revision counthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Revision_count Wikidatahttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Wikidata Commonshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Commons Entity sizehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Entity_size Average sizehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Average_size Max sizehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Max_size Number of Entities by typehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Number_of_Entities_by_type Itemshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Items Propertieshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Properties Lexemeshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Lexemes MediaInfohttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#MediaInfo DB Tables sizehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#DB_Tables_size Misc storagehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Misc_storage WikibaseQualityConstraints check datahttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#WikibaseQualityConstraints_check_data Usage & Readinghttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Usage_&_Reading Wikidata.org / Repohttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#Wikidata.org_/_Repo 3rd party federated wikishttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#3rd_party_federated_wikis 3rd party WDQS updatershttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#3rd_party_WDQS_updaters WDQShttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Growth#WDQS https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/TOC = Table of Contents - Without Redirects = Table of Contents - Without Redirectshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/TOC#Table_of_Contents_-_Without_Redirects Table of Contents - With Redirectshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/TOC#Table_of_Contents_-_With_Redirects https://wikitech.wikimedia.org/wiki/Logstash/Interface We try to avoid application sending logs directly to logstash and instead have them pass through one of below logging supported interfaces. Rsysloghttps://wikitech.wikimedia.org/wiki/Logstash/Interface#Rsyslog UNIX Socket (/dev/log)https://wikitech.wikimedia.org/wiki/Logstash/Interface#UNIX_Socket_(/dev/log) UDP listenerhttps://wikitech.wikimedia.org/wiki/Logstash/Interface#UDP_listener Mediawikihttps://wikitech.wikimedia.org/wiki/Logstash/Interface#Mediawiki Network deviceshttps://wikitech.wikimedia.org/wiki/Logstash/Interface#Network_devices Systemd Journal (stdout/stderr)https://wikitech.wikimedia.org/wiki/Logstash/Interface#Systemd_Journal_(stdout/stderr) Python example implementationhttps://wikitech.wikimedia.org/wiki/Logstash/Interface#Python_example_implementation Configuring rsyslog to forward your logshttps://wikitech.wikimedia.org/wiki/Logstash/Interface#Configuring_rsyslog_to_forward_your_logs Tailing Log Fileshttps://wikitech.wikimedia.org/wiki/Logstash/Interface#Tailing_Log_Files https://wikitech.wikimedia.org/wiki/SSH/monitoring === Runbook for 'SSH unreachable' alerts === Runbook for 'SSH unreachable' alertshttps://wikitech.wikimedia.org/wiki/SSH/monitoring#Runbook_for_'SSH_unreachable'_alerts https://wikitech.wikimedia.org/wiki/Minikube minikube is a tool that runs a single-node Kubernetes cluster in a virtual machine on your laptop. Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes https://wikitech.wikimedia.org/wiki/Kubernetes/Packages/kubernetes-client kubernetes-client - Kubernetes client tools is the Debian package containing the Kubernetes client kubectl. Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes https://wikitech.wikimedia.org/wiki/Kubernetes/Packages/kubernetes-master kubernetes-master is the Debian package containing the Kubernetes services for a master host. Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes https://wikitech.wikimedia.org/wiki/Helm Helm is a package manager for Kubernetes. Packaginghttps://wikitech.wikimedia.org/wiki/Helm#Packaging Testing a new versionhttps://wikitech.wikimedia.org/wiki/Helm#Testing_a_new_version Importing a new versionhttps://wikitech.wikimedia.org/wiki/Helm#Importing_a_new_version Building a new versionhttps://wikitech.wikimedia.org/wiki/Helm#Building_a_new_version Publish a new versionhttps://wikitech.wikimedia.org/wiki/Helm#Publish_a_new_version Update CI imagehttps://wikitech.wikimedia.org/wiki/Helm#Update_CI_image Resourceshttps://wikitech.wikimedia.org/wiki/Helm#Resources https://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero These are directions for deploying zotero, a Node.js service. Locate build candidatehttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Locate_build_candidate Add change via gerrithttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Add_change_via_gerrit Log into deployment serverhttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Log_into_deployment_server Staging serverhttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Staging_server Production serverhttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Production_server eqiad querieshttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#eqiad_queries Verifyhttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Verify Logshttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Logs Monitoringhttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Monitoring Rolling back changeshttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Rolling_back_changes Rolling restarthttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Rolling_restart Rolling back in an emergencyhttps://wikitech.wikimedia.org/wiki/Zotero/Deploying_zotero#Rolling_back_in_an_emergency https://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid These are directions for deploying citoid, a nodejs service. More detailed but more general directions for nodejs services are at Migrating_from_scap-helm#Code_deployment/configuration_changes. Locate build candidatehttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Locate_build_candidate Add change via gerrithttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Add_change_via_gerrit Pipeline bothttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Pipeline_bot Manually (deprecated)https://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Manually_(deprecated) Navigating the serverhttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Navigating_the_server Staginghttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Staging Productionhttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Production Testing behind restbasehttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Testing_behind_restbase Graphing and Logshttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Graphing_and_Logs Probehttps://wikitech.wikimedia.org/wiki/Citoid/Deploying_citoid#Probe https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Securely_Erasing_Media Please note that the default Debian Live Image does not include hdparm. Securely Erasing Hard Disk Driveshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Securely_Erasing_Media#Securely_Erasing_Hard_Disk_Drives wipehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Securely_Erasing_Media#wipe Securely Erasing Solid State Diskshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Securely_Erasing_Media#Securely_Erasing_Solid_State_Disks gpartedhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Securely_Erasing_Media#gparted hdparmhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Securely_Erasing_Media#hdparm https://wikitech.wikimedia.org/wiki/Incidents/2019-03-13_MW_API_App_Servers_and_EventGate STILL A DRAFT waiting for phab to be back... Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-13_MW_API_App_Servers_and_EventGate#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-13_MW_API_App_Servers_and_EventGate#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-13_MW_API_App_Servers_and_EventGate#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-13_MW_API_App_Servers_and_EventGate#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-13_MW_API_App_Servers_and_EventGate#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-03-20_ORES ORES in CODFW stopped processing requests. The result was sustained overload errors and a growing backlog of requests to process. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-20_ORES#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-20_ORES#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-20_ORES#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-20_ORES#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-20_ORES#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20190321-acmechief == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20190321-acmechief#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20190321-acmechief#Timeline Affected servershttps://wikitech.wikimedia.org/wiki/Incidents/20190321-acmechief#Affected_servers https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB ToolsDB is a multi-tenant MariaDB database service for use by Toolforge tools and maintainers. This page is primarily for WMCS admins for database and server operations on the ToolsDB database cluster that is currently operating in the tools Cloud VPS project. Architecturehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Architecture Finding the right hostnameshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Finding_the_right_hostnames Checking the replication statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Checking_the_replication_status Failing over to the replica hosthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Failing_over_to_the_replica_host Set the primary to read-onlyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Set_the_primary_to_read-only Change the DNS entry to point users to the replicahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Change_the_DNS_entry_to_point_users_to_the_replica Promote the replica to primaryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Promote_the_replica_to_primary Change the old primary to become the new replicahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Change_the_old_primary_to_become_the_new_replica Creating a new replica hosthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Creating_a_new_replica_host Create the new replica hosthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Create_the_new_replica_host Refresh the Puppet certificates for the new hosthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Refresh_the_Puppet_certificates_for_the_new_host Create a new empty Cinder volumehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Create_a_new_empty_Cinder_volume Create a Cinder snapshot of the primary data volumehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Create_a_Cinder_snapshot_of_the_primary_data_volume Create a temporary volume for data transferhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Create_a_temporary_volume_for_data_transfer Copy all the contents from the snapshot to the new data volumehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Copy_all_the_contents_from_the_snapshot_to_the_new_data_volume Start the replicationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Start_the_replication Verify that replication is working correctlyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Verify_that_replication_is_working_correctly Unmount, unattach and delete the temporary volumehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Unmount,_unattach_and_delete_the_temporary_volume Upgrading to a newer MariaDB versionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Upgrading_to_a_newer_MariaDB_version Re-importing data after replication failureshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Re-importing_data_after_replication_failures https://wikitech.wikimedia.org/wiki/A/B_testing In the Wikimedia platform, the impact of many new features are tested using controlled experiments. Many more should be. Infrastructurehttps://wikitech.wikimedia.org/wiki/A/B_testing#Infrastructure Bucketinghttps://wikitech.wikimedia.org/wiki/A/B_testing#Bucketing Sample size / power analysishttps://wikitech.wikimedia.org/wiki/A/B_testing#Sample_size_/_power_analysis General advicehttps://wikitech.wikimedia.org/wiki/A/B_testing#General_advice A/B testing on wikihttps://wikitech.wikimedia.org/wiki/A/B_testing#A/B_testing_on_wiki Softwarehttps://wikitech.wikimedia.org/wiki/A/B_testing#Software https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate EventGate is an HTTP service for ingestion of events, written in Node.js. Purposehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Purpose Servicehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Service Implementationhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Implementation Operationhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Operation Wikimedia EventGatehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Wikimedia_EventGate Producer types: Guaranteed and Hastyhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Producer_types:_Guaranteed_and_Hasty EventGate clustershttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#EventGate_clusters eventgate-mainhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#eventgate-main eventgate-analyticshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#eventgate-analytics eventgate-analytics-externalhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#eventgate-analytics-external eventgate-logging-externalhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#eventgate-logging-external Event Stream Confighttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Event_Stream_Config Validation Errorshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Validation_Errors Local developmenthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#Local_development eventgate-wikimedia-dev.jshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#eventgate-wikimedia-dev.js External linkshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate#External_links https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration EventGate is deployed using the WMF Helm & Kubernetes deployment pipeline. This page will describe how to build and deploy EventGate services as well as document how to administer and debug EventGate in beta and production. Mediawiki Vagrant developmenthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Mediawiki_Vagrant_development Beta / deployment-prephttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Beta_/_deployment-prep Productionhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Production Deployment Pipeline Overviewhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Deployment_Pipeline_Overview Current services (as of 2020-03)https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Current_services_(as_of_2020-03) EventGate / eventgate-wikimedia Code Changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#EventGate_/_eventgate-wikimedia_Code_Change EventGate repository changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#EventGate_repository_change eventgate-wikimedia repository changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#eventgate-wikimedia_repository_change eventgate-wikimedia schema repository changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#eventgate-wikimedia_schema_repository_change eventgate service values config changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#eventgate_service_values_config_change eventgate chart changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#eventgate_chart_change EventStreamConfig changehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#EventStreamConfig_change Troubleshooting in productionhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Troubleshooting_in_production curl a staging cluster deploymenthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#curl_a_staging_cluster_deployment curl a specific podhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#curl_a_specific_pod Get detailed status of Helm releasehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Get_detailed_status_of_Helm_release Upgrade a Helm releasehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Upgrade_a_Helm_release Rollback to a previous Helm chart versionhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Rollback_to_a_previous_Helm_chart_version Targeting a specific release with Helmfile (e.g. canary)https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Targeting_a_specific_release_with_Helmfile_(e.g._canary) Temporarily increasing log levelhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Temporarily_increasing_log_level List k8s pods and their k8s host nodeshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#List_k8s_pods_and_their_k8s_host_nodes Roll restart all podshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Roll_restart_all_pods Delete a specific k8s podhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Delete_a_specific_k8s_pod Delete all k8s pods in a clusterhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Delete_all_k8s_pods_in_a_cluster Tail stdout/logs from eventgate containers in all podshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Tail_stdout/logs_from_eventgate_containers_in_all_pods Tail sdtout/logs on all podshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Tail_sdtout/logs_on_all_pods Tail stdout/logs on a specific k8s pod containerhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Tail_stdout/logs_on_a_specific_k8s_pod_container Get a shell on a specific k8s pod containerhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Get_a_shell_on_a_specific_k8s_pod_container strace on a process in a specific pod containerhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#strace_on_a_process_in_a_specific_pod_container Get a root shell on a specific k8s pod containerhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Get_a_root_shell_on_a_specific_k8s_pod_container Profiling nodejshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Profiling_nodejs Generating a flamegraph with perfhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Generating_a_flamegraph_with_perf Viewing v8 profiler outputhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Viewing_v8_profiler_output Helm Chart Developmenthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Helm_Chart_Development EventGate Helm development environment setuphttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#EventGate_Helm_development_environment_setup Networking for macOS usershttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Networking_for_macOS_users Benchmarkinghttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Benchmarking https://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-27_gerrit#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-03-28_commons#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch Work in Progress!!! Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20190327-elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Wikidata_Identifier_Landscape Code Repository: https://github.com/wikimedia/analytics-wmde-WD-WD_identifierLandscape Overviewhttps://wikitech.wikimedia.org/wiki/Wikidata_Identifier_Landscape#Overview The Update Enginehttps://wikitech.wikimedia.org/wiki/Wikidata_Identifier_Landscape#The_Update_Engine Public Datasetshttps://wikitech.wikimedia.org/wiki/Wikidata_Identifier_Landscape#Public_Datasets The Dashboard (CloudVPS Component)https://wikitech.wikimedia.org/wiki/Wikidata_Identifier_Landscape#The_Dashboard_(CloudVPS_Component) https://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Summary Backgroundhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Background Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Timeline Considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Considerations Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-02_0401KafkaJumbo#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra The cloudinfra project is a very special project intended to hold infrastructure relating to running the rest of Cloud VPS. Access to it is restricted under Help:Access policies. Instanceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#Instances ntphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#ntp mx-outhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#mx-out cloud-puppetmasterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#cloud-puppetmaster cloudinfra-dbhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#cloudinfra-db cloudinfra-internal-puppetmasterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#cloudinfra-internal-puppetmaster enchttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#enc DNShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#DNS codfw1devhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudinfra#codfw1dev https://wikitech.wikimedia.org/wiki/WebPageTest/Runbook This is the runbook for deploying new versions of WebPageTest. Metahttps://wikitech.wikimedia.org/wiki/WebPageTest/Runbook#Meta Update the WebPageTest agenthttps://wikitech.wikimedia.org/wiki/WebPageTest/Runbook#Update_the_WebPageTest_agent https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/04 === Week of April 1st === Week of April 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/04#Week_of_April_1st Week of April 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/04#Week_of_April_8th Week of April 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/04#Week_of_April_15th Week of April 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/04#Week_of_April_22nd Week of April 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/04#Week_of_April_29th https://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-07_Zotero#Actionables https://wikitech.wikimedia.org/wiki/Rsyslog rsyslog is the default Debian logging daemon and what's deployed fleet-wide at Wikimedia Foundation. Packaginghttps://wikitech.wikimedia.org/wiki/Rsyslog#Packaging Brancheshttps://wikitech.wikimedia.org/wiki/Rsyslog#Branches Buildhttps://wikitech.wikimedia.org/wiki/Rsyslog#Build Troubleshootinghttps://wikitech.wikimedia.org/wiki/Rsyslog#Troubleshooting rsyslog "stuck"https://wikitech.wikimedia.org/wiki/Rsyslog#rsyslog_"stuck" https://wikitech.wikimedia.org/wiki/WMDE_New_Editors_and_Banner_Campaigns_Dashboard == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/WMDE_New_Editors_and_Banner_Campaigns_Dashboard#Introduction Overviewhttps://wikitech.wikimedia.org/wiki/WMDE_New_Editors_and_Banner_Campaigns_Dashboard#Overview The Update Enginehttps://wikitech.wikimedia.org/wiki/WMDE_New_Editors_and_Banner_Campaigns_Dashboard#The_Update_Engine Public Datasetshttps://wikitech.wikimedia.org/wiki/WMDE_New_Editors_and_Banner_Campaigns_Dashboard#Public_Datasets The Dashboard (CloudVPS Component)https://wikitech.wikimedia.org/wiki/WMDE_New_Editors_and_Banner_Campaigns_Dashboard#The_Dashboard_(CloudVPS_Component) https://wikitech.wikimedia.org/wiki/Cache_TLS_termination TLS in the caching cluster is terminated by nginx. It performs the following roles: TLS terminationhttps://wikitech.wikimedia.org/wiki/Cache_TLS_termination#TLS_termination HSTShttps://wikitech.wikimedia.org/wiki/Cache_TLS_termination#HSTS OCSP staplinghttps://wikitech.wikimedia.org/wiki/Cache_TLS_termination#OCSP_stapling https://wikitech.wikimedia.org/wiki/Maps-migration This page describes lesson learn and steps for Migrating Maps servers. Introhttps://wikitech.wikimedia.org/wiki/Maps-migration#Intro Steps taken for stretch migrationhttps://wikitech.wikimedia.org/wiki/Maps-migration#Steps_taken_for_stretch_migration Things to note for cassandrahttps://wikitech.wikimedia.org/wiki/Maps-migration#Things_to_note_for_cassandra https://wikitech.wikimedia.org/wiki/Decom_script A real life example how to decom a host using the latest method, a Spicerack cookbook which replaced "wmf-decommission-host". https://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-13_elasticsearch#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-15_maps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-16_varnish#Actionables https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space You are probably here because Icinga mentioned this link during a DISK space alert. Short term fixhttps://wikitech.wikimedia.org/wiki/Monitoring/Disk_space#Short_term_fix Prometheushttps://wikitech.wikimedia.org/wiki/Monitoring/Disk_space#Prometheus Cloud NFShttps://wikitech.wikimedia.org/wiki/Monitoring/Disk_space#Cloud_NFS Extending an LVM volume (e.g. backup hosts)https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space#Extending_an_LVM_volume_(e.g._backup_hosts) https://wikitech.wikimedia.org/wiki/Runbook A runbook is a set of instructions for a human what to do. More specifically what to do when a certain monitoring alert triggers. service-name:porthttps://wikitech.wikimedia.org/wiki/Runbook#service-name:port apt:80https://wikitech.wikimedia.org/wiki/Runbook#apt:80 grafana:443https://wikitech.wikimedia.org/wiki/Runbook#grafana:443 graphite:443https://wikitech.wikimedia.org/wiki/Runbook#graphite:443 helm-charts:443https://wikitech.wikimedia.org/wiki/Runbook#helm-charts:443 jobrunner:443https://wikitech.wikimedia.org/wiki/Runbook#jobrunner:443 librenms:443https://wikitech.wikimedia.org/wiki/Runbook#librenms:443 netbox:443https://wikitech.wikimedia.org/wiki/Runbook#netbox:443 puppetboard:443https://wikitech.wikimedia.org/wiki/Runbook#puppetboard:443 puppetdb-api:8090https://wikitech.wikimedia.org/wiki/Runbook#puppetdb-api:8090 releases:443https://wikitech.wikimedia.org/wiki/Runbook#releases:443 thanos-query:443https://wikitech.wikimedia.org/wiki/Runbook#thanos-query:443 upload-https:443https://wikitech.wikimedia.org/wiki/Runbook#upload-https:443 videoscaler:443https://wikitech.wikimedia.org/wiki/Runbook#videoscaler:443 tools-k8s-haproxy-3:30000https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 tools-k8s-haproxy-4:30000https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-4:30000 gerrit1003:443https://wikitech.wikimedia.org/wiki/Runbook#gerrit1003:443 https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident == Definitions == Definitionshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Definitions Alerthttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Alert Pagehttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Page Incidenthttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Incident Major incidenthttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Major_incident Incident Coordinatorhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Incident_Coordinator Guidelineshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Definition_of_an_incident#Guidelines https://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-17_Jobqueue#Actionables https://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting Load testing of the elasticsearch clusters is done by recording real production GET requests during peak hours and playing it back against the hot-spare cluster at accelerated rates. The performance of elasticsearch depends heavily on how much of it's data is available in the kernel disk cache, and how much has to be pulled up from disk in real time. Overviewhttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Overview Recording traffichttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Recording_traffic Transfering recorded fileshttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Transfering_recorded_files Replaying recorded fileshttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Replaying_recorded_files Evaluating Performancehttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Evaluating_Performance Scriptshttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Scripts Caveatshttps://wikitech.wikimedia.org/wiki/Search/ElasticSearch/LoadTesting#Caveats https://wikitech.wikimedia.org/wiki/Phab1001 phab1001 was a production Phabricator server. It has been replaced by phab1004 in November 2022. Connectinghttps://wikitech.wikimedia.org/wiki/Phab1001#Connecting https://wikitech.wikimedia.org/wiki/Phab1003 phab1003 was a temporary Phabricator server. Connectinghttps://wikitech.wikimedia.org/wiki/Phab1003#Connecting https://wikitech.wikimedia.org/wiki/Monitoring/Long_running_screens An Icinga check for "long running screen or tmux" processes was added in [was: "We should flag/alert long-running screen sessions, these are usually a sign of work which was forgotten or should rather be puppetised or launched by cron" Monitoringhttps://wikitech.wikimedia.org/wiki/Category:Monitoring Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-23_varnish#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-04-25_prometheus#Actionables https://wikitech.wikimedia.org/wiki/Install_server An install server consists of TFTP], webproxy ([(software)|Squid]) and [[apt.wikimedia. How to create an install serverhttps://wikitech.wikimedia.org/wiki/Install_server#How_to_create_an_install_server Monitoringhttps://wikitech.wikimedia.org/wiki/Install_server#Monitoring https://wikitech.wikimedia.org/wiki/Monitoring/atftpd atftpd is a [server. It is running on install server]s. What you can dohttps://wikitech.wikimedia.org/wiki/Monitoring/atftpd#What_you_can_do Where are files?https://wikitech.wikimedia.org/wiki/Monitoring/atftpd#Where_are_files? How bad is it if this is down?https://wikitech.wikimedia.org/wiki/Monitoring/atftpd#How_bad_is_it_if_this_is_down? https://wikitech.wikimedia.org/wiki/Monitoring/check_rp_filter_disabled Check rp_filter disabled is an Icinga check running on LVS servers via NRPE. Why has this been addedhttps://wikitech.wikimedia.org/wiki/Monitoring/check_rp_filter_disabled#Why_has_this_been_added What to dohttps://wikitech.wikimedia.org/wiki/Monitoring/check_rp_filter_disabled#What_to_do https://wikitech.wikimedia.org/wiki/NRPE NRPE stands for Nagios Remote Plugin Executor. Monitoringhttps://wikitech.wikimedia.org/wiki/Category:Monitoring https://wikitech.wikimedia.org/wiki/Docker-registry/Runbook ==On-call guide== On-call guidehttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#On-call_guide Swift is down or content has gone corrupthttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Swift_is_down_or_content_has_gone_corrupt Redis is downhttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Redis_is_down Registry is down in one DC, how to failover to the passive?https://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Registry_is_down_in_one_DC,_how_to_failover_to_the_passive? Cannot pull some layer/image or looks corrupt how to debug problems?https://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Cannot_pull_some_layer/image_or_looks_corrupt_how_to_debug_problems? Check swift replicationhttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Check_swift_replication Replication seems synced but users/monitoring reports problems pulling imageshttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Replication_seems_synced_but_users/monitoring_reports_problems_pulling_images FAQhttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#FAQ I need to delete a tag of a published imagehttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#I_need_to_delete_a_tag_of_a_published_image I need to delete an image from the registryhttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#I_need_to_delete_an_image_from_the_registry How to perform garbage collectionhttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#How_to_perform_garbage_collection How to backup the backend swift containerhttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#How_to_backup_the_backend_swift_container Known problemshttps://wikitech.wikimedia.org/wiki/Docker-registry/Runbook#Known_problems https://wikitech.wikimedia.org/wiki/Monitoring/check_ferm check_ferm is an Icinga check that ensures the ferm service is running. Things to dohttps://wikitech.wikimedia.org/wiki/Monitoring/check_ferm#Things_to_do https://wikitech.wikimedia.org/wiki/Monitoring/check_conntrack check_conntrack is an Icinga check that ensures that the nf_conntrack table is not full. Things to dohttps://wikitech.wikimedia.org/wiki/Monitoring/check_conntrack#Things_to_do https://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge This page explains the basics of how Toolforge works, and introduces core concepts that Toolforge users should understand. Key concepts: tools, tool accounts, and maintainershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Key_concepts:_tools,_tool_accounts,_and_maintainers Components of Toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Components_of_Toolforge Bastion hostshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Bastion_hosts Storage (NFS)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Storage_(NFS) Kubernetes clusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Kubernetes_cluster Databaseshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Databases Shared services and resourceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Shared_services_and_resources Tools for tool maintainershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Tools_for_tool_maintainers Next stepshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Next_steps https://wikitech.wikimedia.org/wiki/Canary canary in Wikimedia technology may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-03_varnish#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Timeline Incident 1https://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Incident_1 Incident 2https://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Incident_2 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-06_zuul#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-07_opcache#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-09_puppet#Actionables https://wikitech.wikimedia.org/wiki/Monitoring/Memory === Memory correctable errors -EDAC- === Memory correctable errors -EDAC-https://wikitech.wikimedia.org/wiki/Monitoring/Memory#Memory_correctable_errors_-EDAC- https://wikitech.wikimedia.org/wiki/Mirrors == mirrors.wikimedia. mirrors.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Mirrors#mirrors.wikimedia.org Technical Infohttps://wikitech.wikimedia.org/wiki/Mirrors#Technical_Info Implementation Infohttps://wikitech.wikimedia.org/wiki/Mirrors#Implementation_Info Monitoring and debugginghttps://wikitech.wikimedia.org/wiki/Mirrors#Monitoring_and_debugging Contacting Wikimedia Maintainershttps://wikitech.wikimedia.org/wiki/Mirrors#Contacting_Wikimedia_Maintainers Contacting Upstream Maintainershttps://wikitech.wikimedia.org/wiki/Mirrors#Contacting_Upstream_Maintainers https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state The "systemd unit state" Icinga checks test if there are any failed [units. Units commonly include, but are not limited to, services (. See alsohttps://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/05 === Week of May 6th === Week of May 6thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/05#Week_of_May_6th Week of May 13thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/05#Week_of_May_13th Week of May 20thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/05#Week_of_May_20th Week of May 27thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/05#Week_of_May_27th https://wikitech.wikimedia.org/wiki/Monitoring/bad_directory_owner The Icinga check called 'bad directory owner' checks if certain files are owned by the wrong user and need manual cleanup. Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Deployment_server The Deployment server is from where we deploy software using Scap and Scap3. Servicehttps://wikitech.wikimedia.org/wiki/Deployment_server#Service Connectinghttps://wikitech.wikimedia.org/wiki/Deployment_server#Connecting Runbookshttps://wikitech.wikimedia.org/wiki/Deployment_server#Runbooks Create a deployment server in Cloud VPShttps://wikitech.wikimedia.org/wiki/Deployment_server#Create_a_deployment_server_in_Cloud_VPS Historyhttps://wikitech.wikimedia.org/wiki/Deployment_server#History See alsohttps://wikitech.wikimedia.org/wiki/Deployment_server#See_also https://wikitech.wikimedia.org/wiki/Wikidata_Percent_Usage_Dashboard == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Wikidata_Percent_Usage_Dashboard#Introduction Dashboard operationhttps://wikitech.wikimedia.org/wiki/Wikidata_Percent_Usage_Dashboard#Dashboard_operation Dashboard functionalityhttps://wikitech.wikimedia.org/wiki/Wikidata_Percent_Usage_Dashboard#Dashboard_functionality Noteshttps://wikitech.wikimedia.org/wiki/Wikidata_Percent_Usage_Dashboard#Notes https://wikitech.wikimedia.org/wiki/RPKI ==What is RPKI== What is RPKIhttps://wikitech.wikimedia.org/wiki/RPKI#What_is_RPKI Wikimedia servershttps://wikitech.wikimedia.org/wiki/RPKI#Wikimedia_servers Signinghttps://wikitech.wikimedia.org/wiki/RPKI#Signing Prefixeshttps://wikitech.wikimedia.org/wiki/RPKI#Prefixes Monitoringhttps://wikitech.wikimedia.org/wiki/RPKI#Monitoring Validationhttps://wikitech.wikimedia.org/wiki/RPKI#Validation Current statushttps://wikitech.wikimedia.org/wiki/RPKI#Current_status Packaginghttps://wikitech.wikimedia.org/wiki/RPKI#Packaging Router confighttps://wikitech.wikimedia.org/wiki/RPKI#Router_config How-tohttps://wikitech.wikimedia.org/wiki/RPKI#How-to Identify if an issue is due to invalid RPKIhttps://wikitech.wikimedia.org/wiki/RPKI#Identify_if_an_issue_is_due_to_invalid_RPKI Perform a manual RPKI validationhttps://wikitech.wikimedia.org/wiki/RPKI#Perform_a_manual_RPKI_validation Example output for a prefixlen mismatchhttps://wikitech.wikimedia.org/wiki/RPKI#Example_output_for_a_prefixlen_mismatch Example output for an ASN mismatchhttps://wikitech.wikimedia.org/wiki/RPKI#Example_output_for_an_ASN_mismatch Disable validationhttps://wikitech.wikimedia.org/wiki/RPKI#Disable_validation Set a static override (exception)https://wikitech.wikimedia.org/wiki/RPKI#Set_a_static_override_(exception) RPKI to router porthttps://wikitech.wikimedia.org/wiki/RPKI#RPKI_to_router_port Processhttps://wikitech.wikimedia.org/wiki/RPKI#Process Prometheus alertshttps://wikitech.wikimedia.org/wiki/RPKI#Prometheus_alerts Valid ROAs decreasinghttps://wikitech.wikimedia.org/wiki/RPKI#Valid_ROAs_decreasing RSYNC statushttps://wikitech.wikimedia.org/wiki/RPKI#RSYNC_status RRDP statushttps://wikitech.wikimedia.org/wiki/RPKI#RRDP_status RTR Connections drophttps://wikitech.wikimedia.org/wiki/RPKI#RTR_Connections_drop Possible future workhttps://wikitech.wikimedia.org/wiki/RPKI#Possible_future_work Resourceshttps://wikitech.wikimedia.org/wiki/RPKI#Resources https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Edit_hourly The wmf.edit_hourly table (available in Hive) contains edit data, aggregated hourly over a predefined set of dimensions. Current schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Edit_hourly#Current_schema Technical detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Edit_hourly#Technical_details Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Edit_hourly#Changes_and_known_problems See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Edit_hourly#See_also https://wikitech.wikimedia.org/wiki/Backport_windows/Deployers/Script The following Bash script automates the steps in Backport windows/Deployers#SSH Connections and Error Logs: Set up before deploying: Deploymenthttps://wikitech.wikimedia.org/wiki/Category:Deployment https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ Many OpenStack services communicate with one another via rabbitmq. For example: Operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Operations Operation: depool a rabbitmq nodehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Operation:_depool_a_rabbitmq_node Operation: new rabbitmq userhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Operation:_new_rabbitmq_user HA setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#HA_setup Resetting the HA setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Resetting_the_HA_setup Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Troubleshooting Listshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Lists Logshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Logs Check local server healthhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Check_local_server_health Checking cluster healthhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Checking_cluster_health Viewing stuck/suspicious processeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Viewing_stuck/suspicious_processes Viewing unacknowledged messageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Viewing_unacknowledged_messages Recovering from split-brain partitioned nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Recovering_from_split-brain_partitioned_nodes Failed to consume message - access to vhost refusedhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/RabbitMQ#Failed_to_consume_message_-_access_to_vhost_refused https://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Where_did_we_get_lucky? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-21_RESTBase#Actionables https://wikitech.wikimedia.org/wiki/Monitoring/unmerged_changes The "Unmerged changes on repository ..." alert is an Icinga check that tests whether there are pending unmerged changes on a git repository. Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Zotero Zotero is a Node.js service which is run alongside the Citoid service. Updatinghttps://wikitech.wikimedia.org/wiki/Zotero#Updating Deploymenthttps://wikitech.wikimedia.org/wiki/Zotero#Deployment https://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-05-29_NFS-keystone#Actionables https://wikitech.wikimedia.org/wiki/Icinga/Runbooks == How to add a runbook to an Icinga alert == How to add a runbook to an Icinga alerthttps://wikitech.wikimedia.org/wiki/Icinga/Runbooks#How_to_add_a_runbook_to_an_Icinga_alert https://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019 ==Kafka main raid performance testing 2019== Kafka main raid performance testing 2019https://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#Kafka_main_raid_performance_testing_2019 raid10 linux md 256K chunk sizehttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#raid10_linux_md_256K_chunk_size raid10 linux md 512K chunk sizehttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#raid10_linux_md_512K_chunk_size raid10 linux md 1024K chunk sizehttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#raid10_linux_md_1024K_chunk_size raid10 linux md 4096K chunk sizehttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#raid10_linux_md_4096K_chunk_size raid10 linux md 512k chunk size with TRIMhttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#raid10_linux_md_512k_chunk_size_with_TRIM raid10 512K stripe size hardware vs softwarehttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#raid10_512K_stripe_size_hardware_vs_software Conclusionshttps://wikitech.wikimedia.org/wiki/Kafka/Kafka-main-raid-performance-testing-2019#Conclusions https://wikitech.wikimedia.org/wiki/OAuth OAuth is a protocol that lets applications impersonate users in limited ways, after getting permission from those users. The public Wikimedia wikis use OAuth (provided by [to allow users to offload editing tasks to external applications (usually, but not always, applications on [[Toolforge]). Conceptshttps://wikitech.wikimedia.org/wiki/OAuth#Concepts Datahttps://wikitech.wikimedia.org/wiki/OAuth#Data Securityhttps://wikitech.wikimedia.org/wiki/OAuth#Security Managementhttps://wikitech.wikimedia.org/wiki/OAuth#Management Logginghttps://wikitech.wikimedia.org/wiki/OAuth#Logging Debugginghttps://wikitech.wikimedia.org/wiki/OAuth#Debugging Show the contents of an OAuth 2 bearer tokenhttps://wikitech.wikimedia.org/wiki/OAuth#Show_the_contents_of_an_OAuth_2_bearer_token https://wikitech.wikimedia.org/wiki/Incidents/20190603-maps ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20190603-maps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-06-03_eqiad-port-saturation == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-03_eqiad-port-saturation#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-03_eqiad-port-saturation#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-03_eqiad-port-saturation#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-03_eqiad-port-saturation#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-03_eqiad-port-saturation#Actionables https://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas The [table|Actor table] was introduced to MediaWiki by [and related work on the Actor migration] project. This page is about related changes that have been made to the [[Portal:Data_Services#Wiki_Replicas|Wiki Replica views to be compatible with the MediaWiki operational database schema. What changed?https://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#What_changed? What should I do?https://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#What_should_I_do? The best solutionhttps://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#The_best_solution What about a quick solution if the refactor is too time consuming at the momenthttps://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#What_about_a_quick_solution_if_the_refactor_is_too_time_consuming_at_the_moment The actor table seems really slow--so does commenthttps://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#The_actor_table_seems_really_slow--so_does_comment Advanced use cases of specialized viewshttps://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#Advanced_use_cases_of_specialized_views See alsohttps://wikitech.wikimedia.org/wiki/News/Actor_storage_changes_on_the_Wiki_Replicas#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack This is how you install devstack for designate inside a Cloud VPS instance running Debian Stretch. https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics The terms media counts, media requests and media views refer to different ways of measuring the number of times that images, videos and sounds from Wikimedia Commons are viewed or played. This page describes the three approaches. Media countshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Media_counts Media requestshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Media_requests Project as a dimensionhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Project_as_a_dimension Study of signal/noisehttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Study_of_signal/noise Steps to put in productionhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Steps_to_put_in_production Oozie jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Oozie_job Endpoints in AQShttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Endpoints_in_AQS Cassandra loadinghttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Cassandra_loading Wikistats UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Wikistats_UI Media viewshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Media_metrics#Media_views https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage Years after the rebranding project we are still using domains with labs in them: *.wmflabs. Problem statementhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Problem_statement Things to namehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Things_to_name Candidate domainshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Candidate_domains Resolutionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Resolution DNS naminghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#DNS_naming HA / Load balancinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#HA_/_Load_balancing Proposalshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Proposals Arturohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Arturo Brandonhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Brandon SRE offsite proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#SRE_offsite_proposal https://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Timeline What actually happenedhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#What_actually_happened Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-04_blubberoid#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-06_wikibase#Actionables https://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/20190606-CirrusSearch-MoreLike#Actionables https://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream ==Notes about replacing (parts of) mwbzutils with python's bitstream module== Notes about replacing (parts of) mwbzutils with python's bitstream modulehttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#Notes_about_replacing_(parts_of)_mwbzutils_with_python's_bitstream_module Speed of bitstream modulehttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#Speed_of_bitstream_module Bzip2 block boundary determinationhttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#Bzip2_block_boundary_determination Avoiding edge cases in decompressionhttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#Avoiding_edge_cases_in_decompression Flexibility of python's bz2 modulehttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#Flexibility_of_python's_bz2_module CRC calculation of bz2 files written from arbitrary blockshttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#CRC_calculation_of_bz2_files_written_from_arbitrary_blocks See alsohttps://wikitech.wikimedia.org/wiki/Dumps/Drafts/Using_bitstream#See_also https://wikitech.wikimedia.org/wiki/Application_servers/Runbook __TOC__ Load-balancing pooling and depoolinghttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Load-balancing_pooling_and_depooling From cuminhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#From_cumin From the host itselfhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#From_the_host_itself Useful dashboardshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Useful_dashboards Apachehttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Apache Testing confighttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Testing_config Deploying confighttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Deploying_config Apache logshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Apache_logs Memcached and Mcrouterhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Memcached_and_Mcrouter MySQLhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#MySQL Envoyhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Envoy PHP 7https://wikitech.wikimedia.org/wiki/Application_servers/Runbook#PHP_7 Logging from PHPhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Logging_from_PHP Dashboardshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Dashboards Debugging procedures and toolshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Debugging_procedures_and_tools php7admhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#php7adm Low-level debugginghttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Low-level_debugging Response to common alertshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Response_to_common_alerts Average latency exceededhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Average_latency_exceeded PHP7 renderinghttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#PHP7_rendering PHP7 Too Busy, not enough idle workershttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#PHP7_Too_Busy,_not_enough_idle_workers Videoscalershttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Videoscalers scap proxy and canaryhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#scap_proxy_and_canary Proxyhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Proxy Canaryhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Canary Service Opshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Service_Ops Adding a new server into productionhttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Adding_a_new_server_into_production Spreading application servers out across rows and rackshttps://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Spreading_application_servers_out_across_rows_and_racks Removing old appservers from production (decom)https://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Removing_old_appservers_from_production_(decom) https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/06 ===Week of June 3rd=== Week of June 3rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/06#Week_of_June_3rd Week of June 10thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/06#Week_of_June_10th Week of June 17thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/06#Week_of_June_17th Week of June 24thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/06#Week_of_June_24th https://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-11_maps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Where_did_we_get_lucky? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-13_wdqs#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Template The deployments calendar is generated via a python script called [in the [[gitlab:repos/releng/release/|repos/releng/release] repo. https://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-16_AQS#Actionables https://wikitech.wikimedia.org/wiki/Graphite2003 == Connecting == Connectinghttps://wikitech.wikimedia.org/wiki/Graphite2003#Connecting https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue Hue is a web interface for the Hadoop cluster, most notably for running Hive queries. Our Hue instance is at https://hue. Accesshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue#Access Hive query errors with Kerberoshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue#Hive_query_errors_with_Kerberos Package and release a new version of Huehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue#Package_and_release_a_new_version_of_Hue Noteshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue#Notes https://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-24_wdqs#Actionables https://wikitech.wikimedia.org/wiki/URI_path_normalization == Problem == Problemhttps://wikitech.wikimedia.org/wiki/URI_path_normalization#Problem Theoryhttps://wikitech.wikimedia.org/wiki/URI_path_normalization#Theory Implementationhttps://wikitech.wikimedia.org/wiki/URI_path_normalization#Implementation See alsohttps://wikitech.wikimedia.org/wiki/URI_path_normalization#See_also https://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue/Administration Information about Hue can be found in the parent wiki page Analytics/Cluster/Hue. The Analytics team uses Hue as handy UI to check the status of the Hadoop jobs, since it offers a nice integration with Oozie and Hive. Syncing new Hue accountshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue/Administration#Syncing_new_Hue_accounts Restarting Huehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue/Administration#Restarting_Hue Python processeshttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Hue/Administration#Python_processes https://wikitech.wikimedia.org/wiki/Transfer.py transfer.py is a Python 3 script intended to move large files or directory trees between WMF production hosts in an efficient way, initially thought for database maintenance, but which can be used to move arbitrary files. Contexthttps://wikitech.wikimedia.org/wiki/Transfer.py#Context Technical detailshttps://wikitech.wikimedia.org/wiki/Transfer.py#Technical_details Dependencieshttps://wikitech.wikimedia.org/wiki/Transfer.py#Dependencies Usagehttps://wikitech.wikimedia.org/wiki/Transfer.py#Usage Obtaininghttps://wikitech.wikimedia.org/wiki/Transfer.py#Obtaining What's New? (GSoC-2020)https://wikitech.wikimedia.org/wiki/Transfer.py#What's_New?_(GSoC-2020) Wishlist and known issueshttps://wikitech.wikimedia.org/wiki/Transfer.py#Wishlist_and_known_issues See alsohttps://wikitech.wikimedia.org/wiki/Transfer.py#See_also https://wikitech.wikimedia.org/wiki/Backup-mariadb backup-mariadb (previously backup_mariadb.py) is a Python 3 script that allows generating MariaDB backups of different formats (right now mydumper and xtrabackup (mariabackup) are implemented, but can be easily extended with others. Usagehttps://wikitech.wikimedia.org/wiki/Backup-mariadb#Usage See alsohttps://wikitech.wikimedia.org/wiki/Backup-mariadb#See_also https://wikitech.wikimedia.org/wiki/SessionStorage Session storage provides application servers with shared access to user session data, making this service critical to site functionality for logged in users. It utilizes [a RESTful opaque key/value storage abstraction on top of Apache Cassandra, deployed in an active/active configuration in both the eqiad] and [[Codfw data center|codfw data-centers. Production Environmenthttps://wikitech.wikimedia.org/wiki/SessionStorage#Production_Environment Service endpointshttps://wikitech.wikimedia.org/wiki/SessionStorage#Service_endpoints Discoveryhttps://wikitech.wikimedia.org/wiki/SessionStorage#Discovery eqiadhttps://wikitech.wikimedia.org/wiki/SessionStorage#eqiad codfwhttps://wikitech.wikimedia.org/wiki/SessionStorage#codfw staginghttps://wikitech.wikimedia.org/wiki/SessionStorage#staging Prometheus metricshttps://wikitech.wikimedia.org/wiki/SessionStorage#Prometheus_metrics Readinesshttps://wikitech.wikimedia.org/wiki/SessionStorage#Readiness Cassandrahttps://wikitech.wikimedia.org/wiki/SessionStorage#Cassandra Monitoring and debugginghttps://wikitech.wikimedia.org/wiki/SessionStorage#Monitoring_and_debugging Common Taskshttps://wikitech.wikimedia.org/wiki/SessionStorage#Common_Tasks Deploymenthttps://wikitech.wikimedia.org/wiki/SessionStorage#Deployment k8shttps://wikitech.wikimedia.org/wiki/SessionStorage#k8s Deployment-prephttps://wikitech.wikimedia.org/wiki/SessionStorage#Deployment-prep Sample Hiera Confighttps://wikitech.wikimedia.org/wiki/SessionStorage#Sample_Hiera_Config Pool and Depoolhttps://wikitech.wikimedia.org/wiki/SessionStorage#Pool_and_Depool See alsohttps://wikitech.wikimedia.org/wiki/SessionStorage#See_also https://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams#Conclusions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-28_EventStreams#Actionables https://wikitech.wikimedia.org/wiki/Kubernetes/Deployments Deployments on kubernetes happen using helmfile. Deploying with helmfilehttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Deploying_with_helmfile Code deployment/configuration changeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Code_deployment/configuration_changes Release breaking changeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Release_breaking_changes Seeing the current statushttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Seeing_the_current_status Rolling back changeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Rolling_back_changes Rolling back in an emergencyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Rolling_back_in_an_emergency Rolling restarthttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Rolling_restart Undeploy/delete a releasehttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Undeploy/delete_a_release Advanced use cases: using kubeconfighttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Advanced_use_cases:_using_kubeconfig Advanced use cases: using helmhttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Advanced_use_cases:_using_helm When `helmfile apply` Does Nothinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#When_`helmfile_apply`_Does_Nothing `helmfile destroy` without root permissionshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#`helmfile_destroy`_without_root_permissions Cheatsheethttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Cheatsheet Deploying a changehttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Deploying_a_change Rendering the helmfile file itselfhttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Rendering_the_helmfile_file_itself Rendering the final values overlayhttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Rendering_the_final_values_overlay Rendering a charthttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#Rendering_a_chart See alsohttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployments#See_also https://wikitech.wikimedia.org/wiki/SRE/Service_Operations SRE Service Operations▼ https://wikitech.wikimedia.org/wiki/SRE == Site Reliability Engineering (SRE) == Site Reliability Engineering (SRE)https://wikitech.wikimedia.org/wiki/SRE#Site_Reliability_Engineering_(SRE) The Foundation has a number of sub-teams within SRE, each responsible for different areas:https://wikitech.wikimedia.org/wiki/SRE#The_Foundation_has_a_number_of_sub-teams_within_SRE,_each_responsible_for_different_areas: https://wikitech.wikimedia.org/wiki/Metrics To gather metrics we are currently using mostly Prometheus. Metricshttps://wikitech.wikimedia.org/wiki/Category:Metrics https://wikitech.wikimedia.org/wiki/Container In the context of Wikitech container usually means a Linux Container as in LXC. Glossaryhttps://wikitech.wikimedia.org/wiki/Container#Glossary LXChttps://wikitech.wikimedia.org/wiki/Container#LXC LXCFShttps://wikitech.wikimedia.org/wiki/Container#LXCFS LXDhttps://wikitech.wikimedia.org/wiki/Container#LXD See alsohttps://wikitech.wikimedia.org/wiki/Container#See_also https://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU == What GPU model do we have? On what hosts? What GPU model do we have? On what hosts?https://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#What_GPU_model_do_we_have?_On_what_hosts? Do we have Nvidia GPUs?https://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Do_we_have_Nvidia_GPUs? Should we run Nvidia cards on cloud providers to bypass the above concerns?https://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Should_we_run_Nvidia_cards_on_cloud_providers_to_bypass_the_above_concerns? Should we run Nvidia cards on a subset of hosts in Production with specific security rules and boundaries?https://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Should_we_run_Nvidia_cards_on_a_subset_of_hosts_in_Production_with_specific_security_rules_and_boundaries? Use the Debian packageshttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Use_the_Debian_packages Use the GPU on the hosthttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Use_the_GPU_on_the_host Use tensorflowhttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Use_tensorflow Experimentalhttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Experimental Configure your Tensorflow scripthttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Configure_your_Tensorflow_script Check the version of ROCm deployed on a hosthttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Check_the_version_of_ROCm_deployed_on_a_host Check usage of the GPUhttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Check_usage_of_the_GPU Outstanding issueshttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Outstanding_issues Reset the GPU statehttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Reset_the_GPU_state Upgrade the Debian packageshttps://wikitech.wikimedia.org/wiki/Machine_Learning/AMD_GPU#Upgrade_the_Debian_packages https://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl kubectl is the Kubernetes command-line tool to deploy and manage applications on a Kubernetes cluster. Setting KUBECONFIGhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#Setting_KUBECONFIG Running kubectl Commandshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#Running_kubectl_Commands Using kube_envhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#Using_kube_env kube_env related helpershttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#kube_env_related_helpers Privileged user (for admin access)https://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#Privileged_user_(for_admin_access) Describe a podhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#Describe_a_pod Also seehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl#Also_see https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/07 === Week of July 1st === Week of July 1sthttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/07#Week_of_July_1st Week of July 8thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/07#Week_of_July_8th Week of July 15thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/07#Week_of_July_15th Week of July 22ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/07#Week_of_July_22nd Week of July 29thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/07#Week_of_July_29th https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta The Analytics Mysql Meta instance is a Mariadb database currently running on two dedicated hosts: Databaseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Databases Dependent serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Dependent_services Maintenancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Maintenance Backuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Backup Restore a Backuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Restore_a_Backup Check on dbprov100x when was the last analytics-meta dump taken.https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Check_on_dbprov100x_when_was_the_last_analytics-meta_dump_taken. Make a list of binlogs that were created AFTER the binlog registered in the metadata filehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Make_a_list_of_binlogs_that_were_created_AFTER_the_binlog_registered_in_the_metadata_file Find the last good transaction from the binloghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Find_the_last_good_transaction_from_the_binlog Use mysqlbinlog to create a dedicated recovery filehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Use_mysqlbinlog_to_create_a_dedicated_recovery_file Recover the databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Recover_the_database Failoverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta#Failover https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA DRAFT WORK IN PROGRESS Current configurationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA#Current_configuration Proposed designhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA#Proposed_design requirementshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA#requirements load balancinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA#load_balancing Networkinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA#Networking endpoint mappinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/OpenStackHA#endpoint_mapping https://wikitech.wikimedia.org/wiki/Dbctl dbctl is a tool based on conftool to store Mediawiki's database loadbalancer configuration in etcd. Its code lives in here under [repository on Gitlab. Backgroundhttps://wikitech.wikimedia.org/wiki/Dbctl#Background Schemahttps://wikitech.wikimedia.org/wiki/Dbctl#Schema Usagehttps://wikitech.wikimedia.org/wiki/Dbctl#Usage Completely depool a hosthttps://wikitech.wikimedia.org/wiki/Dbctl#Completely_depool_a_host Depool a host from a section and a group (api, recentchanges, vslow, dump..)https://wikitech.wikimedia.org/wiki/Dbctl#Depool_a_host_from_a_section_and_a_group_(api,_recentchanges,_vslow,_dump..) Automatically slowly repool a hosthttps://wikitech.wikimedia.org/wiki/Dbctl#Automatically_slowly_repool_a_host Fully repool a hosthttps://wikitech.wikimedia.org/wiki/Dbctl#Fully_repool_a_host Slowly repool a host to warm it up (10% of its usual weight)https://wikitech.wikimedia.org/wiki/Dbctl#Slowly_repool_a_host_to_warm_it_up_(10%_of_its_usual_weight) Fully repool a host after it is already warmed uphttps://wikitech.wikimedia.org/wiki/Dbctl#Fully_repool_a_host_after_it_is_already_warmed_up Repool a host in a given group (api, recentchanges, vslow, dump...)https://wikitech.wikimedia.org/wiki/Dbctl#Repool_a_host_in_a_given_group_(api,_recentchanges,_vslow,_dump...) Add a new host (ie: a new provisioned host) to a sectionhttps://wikitech.wikimedia.org/wiki/Dbctl#Add_a_new_host_(ie:_a_new_provisioned_host)_to_a_section Removing / decommissioning a hosthttps://wikitech.wikimedia.org/wiki/Dbctl#Removing_/_decommissioning_a_host Changing weights for a hosthttps://wikitech.wikimedia.org/wiki/Dbctl#Changing_weights_for_a_host Changing weights for a host in a grouphttps://wikitech.wikimedia.org/wiki/Dbctl#Changing_weights_for_a_host_in_a_group Setting a section on read only (ie: master failover)https://wikitech.wikimedia.org/wiki/Dbctl#Setting_a_section_on_read_only_(ie:_master_failover) Setting a section on read-write (ie: master failover done and we skip the restore command)https://wikitech.wikimedia.org/wiki/Dbctl#Setting_a_section_on_read-write_(ie:_master_failover_done_and_we_skip_the_restore_command) Setting a host as new master and also depool the previous master (which is what we normally do when we failover a master)https://wikitech.wikimedia.org/wiki/Dbctl#Setting_a_host_as_new_master_and_also_depool_the_previous_master_(which_is_what_we_normally_do_when_we_failover_a_master) Checking for any depooled hostshttps://wikitech.wikimedia.org/wiki/Dbctl#Checking_for_any_depooled_hosts Checking for depooled hosts in a given sectionhttps://wikitech.wikimedia.org/wiki/Dbctl#Checking_for_depooled_hosts_in_a_given_section Checking all the instances associated with a given sectionhttps://wikitech.wikimedia.org/wiki/Dbctl#Checking_all_the_instances_associated_with_a_given_section Find candidate masters for a given sectionhttps://wikitech.wikimedia.org/wiki/Dbctl#Find_candidate_masters_for_a_given_section Check live confighttps://wikitech.wikimedia.org/wiki/Dbctl#Check_live_config Add new core sectionhttps://wikitech.wikimedia.org/wiki/Dbctl#Add_new_core_section Add new externalload sectionhttps://wikitech.wikimedia.org/wiki/Dbctl#Add_new_externalload_section Monitoringhttps://wikitech.wikimedia.org/wiki/Dbctl#Monitoring I want to see changes pushed with dbctlhttps://wikitech.wikimedia.org/wiki/Dbctl#I_want_to_see_changes_pushed_with_dbctl Uncommitted dbctl diffshttps://wikitech.wikimedia.org/wiki/Dbctl#Uncommitted_dbctl_diffs Runbookhttps://wikitech.wikimedia.org/wiki/Dbctl#Runbook Emergency revert to static configshttps://wikitech.wikimedia.org/wiki/Dbctl#Emergency_revert_to_static_configs Building and deploying a new releasehttps://wikitech.wikimedia.org/wiki/Dbctl#Building_and_deploying_a_new_release Schema upgradeshttps://wikitech.wikimedia.org/wiki/Dbctl#Schema_upgrades https://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_maps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Timeline Graphshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Graphs Some log excerptshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Some_log_excerpts Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-15_logstash#Actionables https://wikitech.wikimedia.org/wiki/Ncredir Ncredir is our Non-Canonical Redirect service. It handles traffic from the outside world to a list of domain names which we own but are not primary canonical domain names for our projects. Componentshttps://wikitech.wikimedia.org/wiki/Ncredir#Components Redirection logichttps://wikitech.wikimedia.org/wiki/Ncredir#Redirection_logic TLShttps://wikitech.wikimedia.org/wiki/Ncredir#TLS Logginghttps://wikitech.wikimedia.org/wiki/Ncredir#Logging See alsohttps://wikitech.wikimedia.org/wiki/Ncredir#See_also https://wikitech.wikimedia.org/wiki/Proxysql The proxysql profile is just a theoretical class and not used in production yet. https://wikitech.wikimedia.org/wiki/Anycast == Anycast-based Wikimedia deployments == Anycast-based Wikimedia deploymentshttps://wikitech.wikimedia.org/wiki/Anycast#Anycast-based_Wikimedia_deployments High level viewhttps://wikitech.wikimedia.org/wiki/Anycast#High_level_view Deploying a new servicehttps://wikitech.wikimedia.org/wiki/Anycast#Deploying_a_new_service Other relevant configurationshttps://wikitech.wikimedia.org/wiki/Anycast#Other_relevant_configurations Routinghttps://wikitech.wikimedia.org/wiki/Anycast#Routing Configurationhttps://wikitech.wikimedia.org/wiki/Anycast#Configuration Routing to specific VIPshttps://wikitech.wikimedia.org/wiki/Anycast#Routing_to_specific_VIPs Monitoringhttps://wikitech.wikimedia.org/wiki/Anycast#Monitoring Sysloghttps://wikitech.wikimedia.org/wiki/Anycast#Syslog Netconsolehttps://wikitech.wikimedia.org/wiki/Anycast#Netconsole Pooling/Depoolinghttps://wikitech.wikimedia.org/wiki/Anycast#Pooling/Depooling Upgrading Birdhttps://wikitech.wikimedia.org/wiki/Anycast#Upgrading_Bird anycast-healthchecker logginghttps://wikitech.wikimedia.org/wiki/Anycast#anycast-healthchecker_logging Unicast announcementshttps://wikitech.wikimedia.org/wiki/Anycast#Unicast_announcements Troubleshootinghttps://wikitech.wikimedia.org/wiki/Anycast#Troubleshooting Bird daemon not runninghttps://wikitech.wikimedia.org/wiki/Anycast#Bird_daemon_not_running Anycast healthchecker not runninghttps://wikitech.wikimedia.org/wiki/Anycast#Anycast_healthchecker_not_running VIP not being announced by BGPhttps://wikitech.wikimedia.org/wiki/Anycast#VIP_not_being_announced_by_BGP https://wikitech.wikimedia.org/wiki/Monitoring/dpkg If Icinga reports a dpkg issue you should ssh to the affected host and run: Monitoringhttps://wikitech.wikimedia.org/wiki/Category:Monitoring Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-16_docker_registry#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Public Right now, this page is a draft where we will work out the best way to publish this dataset. With some compression, we have roughly five billion events adding up to one terabyte of data. Ideas for splittinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Public#Ideas_for_splitting Split by wiki with groupinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Public#Split_by_wiki_with_grouping Split by wiki, data set and time in GZipped TSVshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Public#Split_by_wiki,_data_set_and_time_in_GZipped_TSVs https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_network_eqiad#Actionables https://wikitech.wikimedia.org/wiki/Deployment_pipeline/FAQ === What does this mean for me? === What does this mean for me?https://wikitech.wikimedia.org/wiki/Deployment_pipeline/FAQ#What_does_this_mean_for_me? What steps are part of the pipeline?https://wikitech.wikimedia.org/wiki/Deployment_pipeline/FAQ#What_steps_are_part_of_the_pipeline? How can I view application logs from my service in production Kubernetes?https://wikitech.wikimedia.org/wiki/Deployment_pipeline/FAQ#How_can_I_view_application_logs_from_my_service_in_production_Kubernetes? https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components == Blubber == Blubberhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Blubber PipelineLibhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#PipelineLib Helmhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Helm Helmfilehttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Helmfile Kuberneteshttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Kubernetes Application Metrics monitoringhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Application_Metrics_monitoring Prometheushttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Prometheus Grafanahttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#Grafana https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration Documentation for Migrating a service to Kubernetes https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial There are many moving pieces in the deployment pipeline. To better understand how those pieces fit together, let's work through a concrete example. Goalhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial#Goal Stepshttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial#Steps Update helloworldoidhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial#Update_helloworldoid Update the deployment charthttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial#Update_the_deployment_chart Run a deploymenthttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial#Run_a_deployment Resultshttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial#Results https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-07-23_logstash#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Conclusions What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-06-19_JobQueue#Actionables https://wikitech.wikimedia.org/wiki/Monitoring/root_disk_space This Icinga alert says the disk space on the / file system is too low. Monitoringhttps://wikitech.wikimedia.org/wiki/Category:Monitoring Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Monitoring/puppet_checkpuppetrun This Icinga alert says a puppet agent failed to run. Monitoringhttps://wikitech.wikimedia.org/wiki/Category:Monitoring Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Monitoring/check_eth == Check Eth Alerts == Check Eth Alertshttps://wikitech.wikimedia.org/wiki/Monitoring/check_eth#Check_Eth_Alerts InterfaceDuplexErrorhttps://wikitech.wikimedia.org/wiki/Monitoring/check_eth#InterfaceDuplexError InterfaceSpeedErrorhttps://wikitech.wikimedia.org/wiki/Monitoring/check_eth#InterfaceSpeedError InterfaceReceiveErrorshttps://wikitech.wikimedia.org/wiki/Monitoring/check_eth#InterfaceReceiveErrors InterfaceTransmitErrorshttps://wikitech.wikimedia.org/wiki/Monitoring/check_eth#InterfaceTransmitErrors Legacy Icinga / NRPE based checkhttps://wikitech.wikimedia.org/wiki/Monitoring/check_eth#Legacy_Icinga_/_NRPE_based_check https://wikitech.wikimedia.org/wiki/Monitoring/check_dhclient This Icinga alert says it found a running DHCP client (dhclient) process. Monitoringhttps://wikitech.wikimedia.org/wiki/Category:Monitoring Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/DHCP https://wikitech.wikimedia.org/wiki/Monitoring/check_cpufreq This Icinga checks tests if CPUs are running at an expected frequency. Runbookshttps://wikitech.wikimedia.org/wiki/Category:Runbooks https://wikitech.wikimedia.org/wiki/Monitoring/check_dsh_groups This Icinga alert checks if a MediaWiki appserver is a member of the mediawiki-installation DSH group. Inactive servershttps://wikitech.wikimedia.org/wiki/Monitoring/check_dsh_groups#Inactive_servers Historyhttps://wikitech.wikimedia.org/wiki/Monitoring/check_dsh_groups#History https://wikitech.wikimedia.org/wiki/Cumin1001 Cumin1001 is the first dedicated Cumin server. It is used for cluster management and uses the Puppet role role::cluster::management. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-02_api-overload-parsoid#Actionables https://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade == Download the JTAC Recommended Software == Download the JTAC Recommended Softwarehttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Download_the_JTAC_Recommended_Software Connect the new EX4300https://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Connect_the_new_EX4300 Copy the file from your USB to the new EX4300https://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Copy_the_file_from_your_USB_to_the_new_EX4300 Identify your USB drivehttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Identify_your_USB_drive Mount the USB drivehttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Mount_the_USB_drive Start the upgradehttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Start_the_upgrade Verificationhttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Verification Copy old switch configuration to new switchhttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Copy_old_switch_configuration_to_new_switch Virtual Chassis switcheshttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Virtual_Chassis_switches Monitoring downtimehttps://wikitech.wikimedia.org/wiki/Juniper_switch_upgrade#Monitoring_downtime https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts This page describes the current procedure/workflow/details that are required to create service accounts working on our CloudVPS (openstack) deployments. Setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts#Setup Known exampleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts#Known_examples Infrastructure user on Cloud VPShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts#Infrastructure_user_on_Cloud_VPS Interacting with the openstack APIhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts#Interacting_with_the_openstack_API Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts#Troubleshooting See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts#See_also https://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Where_did_we_get_lucky? Other informationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Other_information Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-07_s8-cawiki-errors#Actionables https://wikitech.wikimedia.org/wiki/CAS-Setup They keystore file got created using https://wikitech.wikimedia.org/wiki/Envoy == What is Envoy proxy == What is Envoy proxyhttps://wikitech.wikimedia.org/wiki/Envoy#What_is_Envoy_proxy Envoy at WMFhttps://wikitech.wikimedia.org/wiki/Envoy#Envoy_at_WMF TLS terminationhttps://wikitech.wikimedia.org/wiki/Envoy#TLS_termination Services Proxyhttps://wikitech.wikimedia.org/wiki/Envoy#Services_Proxy Add a new service (listener)https://wikitech.wikimedia.org/wiki/Envoy#Add_a_new_service_(listener) Use a listenerhttps://wikitech.wikimedia.org/wiki/Envoy#Use_a_listener Example (calling mw-api)https://wikitech.wikimedia.org/wiki/Envoy#Example_(calling_mw-api) Runtime configurationhttps://wikitech.wikimedia.org/wiki/Envoy#Runtime_configuration Telemetryhttps://wikitech.wikimedia.org/wiki/Envoy#Telemetry Building envoy for WMFhttps://wikitech.wikimedia.org/wiki/Envoy#Building_envoy_for_WMF Prepare a new versionhttps://wikitech.wikimedia.org/wiki/Envoy#Prepare_a_new_version Import with reprepohttps://wikitech.wikimedia.org/wiki/Envoy#Import_with_reprepo Copying the envoy-future package to mainhttps://wikitech.wikimedia.org/wiki/Envoy#Copying_the_envoy-future_package_to_main Build the envoy docker imagehttps://wikitech.wikimedia.org/wiki/Envoy#Build_the_envoy_docker_image Update envoyhttps://wikitech.wikimedia.org/wiki/Envoy#Update_envoy In CIhttps://wikitech.wikimedia.org/wiki/Envoy#In_CI envoy update rollouthttps://wikitech.wikimedia.org/wiki/Envoy#envoy_update_rollout Kubernetes/deployment pipelinehttps://wikitech.wikimedia.org/wiki/Envoy#Kubernetes/deployment_pipeline Deploy single services with a new envoy versionhttps://wikitech.wikimedia.org/wiki/Envoy#Deploy_single_services_with_a_new_envoy_version Set new envoy version as default for all chart deploymentshttps://wikitech.wikimedia.org/wiki/Envoy#Set_new_envoy_version_as_default_for_all_chart_deployments https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/08 ===Week of August 5th === Week of August 5thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/08#Week_of_August_5th Week of August 12thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/08#Week_of_August_12th Week of August 19thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/08#Week_of_August_19th Week of August 26thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/08#Week_of_August_26th https://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-23_network_codfw#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization Some of the data sets stored in the Analytics Hadoop cluster contain privacy-sensitive information. According to WMF's privacy policy and data retention guidelines, those need to be deleted or sanitized after at most 90 days after collection. Retention period and timer execution intervalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#Retention_period_and_timer_execution_interval Deletion scriptshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#Deletion_scripts refinery-drop-older-thanhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#refinery-drop-older-than refinery-drop-druid-deep-storage-datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#refinery-drop-druid-deep-storage-data refinery-drop-druid-snapshotshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#refinery-drop-druid-snapshots refinery-drop-mediawiki-snapshotshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#refinery-drop-mediawiki-snapshots Sanitization scriptshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#Sanitization_scripts EventLoggingSanitizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_deletion_and_sanitization#EventLoggingSanitization https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Exporting_from_HDFS_to_Swift When generating regular datasets via jobs scheduled in Oozie, you may want to export those datasets for production use outside of the Analytics Cluster. To do so, you (as of 2019-08) have two options: Oozie Swift Uploadhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Exporting_from_HDFS_to_Swift#Oozie_Swift_Upload https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38 == 2019-08-31 == 2019-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-31 2019-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-30 2019-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-29 2019-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-28 2019-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-27 2019-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-26 2019-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-25 2019-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-24 2019-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-23 2019-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-22 2019-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-21 2019-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-20 2019-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-19 2019-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-18 2019-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-16 2019-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-15 2019-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-14 2019-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-13 2019-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-12 2019-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-11 2019-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-10 2019-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-09 2019-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-08 2019-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-07 2019-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-06 2019-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-05 2019-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-04 2019-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-03 2019-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-02 2019-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-08-01 2019-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-31 2019-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-30 2019-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-29 2019-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-28 2019-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-27 2019-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-26 2019-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-25 2019-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-24 2019-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-23 2019-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-22 2019-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-21 2019-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-19 2019-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-18 2019-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-17 2019-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-16 2019-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-15 2019-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-14 2019-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-13 2019-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-12 2019-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-11 2019-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-10 2019-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-09 2019-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-08 2019-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-07 2019-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-06 2019-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-05 2019-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-04 2019-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-03 2019-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-02 2019-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-07-01 2019-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-30 2019-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-28 2019-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-27 2019-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-26 2019-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-25 2019-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-24 2019-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-21 2019-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-20 2019-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-19 2019-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-18 2019-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-17 2019-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-16 2019-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-15 2019-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-14 2019-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-13 2019-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-12 2019-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-11 2019-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-10 2019-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-09 2019-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-08 2019-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-07 2019-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-06 2019-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-05 2019-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-04 2019-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-03 2019-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-02 2019-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-06-01 2019-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-31 2019-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-30 2019-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-29 2019-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-28 2019-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-27 2019-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-26 2019-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-25 2019-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-24 2019-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-23 2019-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-22 2019-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-21 2019-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-20 2019-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-19 2019-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-18 2019-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-17 2019-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-16 2019-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-15 2019-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-14 2019-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-13 2019-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-12 2019-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-11 2019-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-10 2019-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-09 2019-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-08 2019-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-07 2019-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-06 2019-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-05 2019-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-04 2019-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-03 2019-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-02 2019-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#2019-05-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_38#Other_archives https://wikitech.wikimedia.org/wiki/Conftool/Load_balanced_services All of our production LVS pools use Conftool with Etcd as data source. States in conftool and their meaninghttps://wikitech.wikimedia.org/wiki/Conftool/Load_balanced_services#States_in_conftool_and_their_meaning Helper scriptshttps://wikitech.wikimedia.org/wiki/Conftool/Load_balanced_services#Helper_scripts In cookbookshttps://wikitech.wikimedia.org/wiki/Conftool/Load_balanced_services#In_cookbooks https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/09 === Week of September 2nd === Week of September 2ndhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/09#Week_of_September_2nd Week of September 9thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/09#Week_of_September_9th Week of September 16thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/09#Week_of_September_16th Week of September 23rdhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/09#Week_of_September_23rd https://wikitech.wikimedia.org/wiki/News/Jessie_deprecation This page keeps track of our ongoing effort towards Debian Jessie deprecation before April 2020. Tell me exactly what I need to dohttps://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Tell_me_exactly_what_I_need_to_do Cloud VPS project maintainershttps://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Cloud_VPS_project_maintainers Toolforge tool maintainershttps://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Toolforge_tool_maintainers Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Why_are_we_doing_this? Timelines. What will change? What has changed already?https://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Timelines._What_will_change?_What_has_changed_already? Cloud VPS projectshttps://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Cloud_VPS_projects Toolforgehttps://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#Toolforge See alsohttps://wikitech.wikimedia.org/wiki/News/Jessie_deprecation#See_also https://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-10_toolforge-kubernetes#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated) We will update or replace this document soon. Introductionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Introduction Etcd is a component of Kubernetes and the Toolforge Proxy system (via the network overlay, flannel)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Etcd_is_a_component_of_Kubernetes_and_the_Toolforge_Proxy_system_(via_the_network_overlay,_flannel) Cluster Managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Cluster_Management Health Monitoringhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Health_Monitoring Overriding the Default Timeout Valuehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Overriding_the_Default_Timeout_Value Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Debugging Enabling/Disabling Debug Logginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Enabling/Disabling_Debug_Logging Starting/Stopping etcd servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Starting/Stopping_etcd_service Logshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Logs Membership Managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Membership_Management Adding a Memberhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Adding_a_Member Removing a Memberhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Removing_a_Member Displaying current Member Listhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Displaying_current_Member_List Datahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Data Taking a backuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Taking_a_backup Lifecyclehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Lifecycle Contentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Contents Recovering from backup in etcd v2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Etcd_(deprecated)#Recovering_from_backup_in_etcd_v2 https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser This page describes our setup for ua-parser, a library used in Java and Python to parse user-agent strings into more meaningful values. Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser#Setup How to updatehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser#How_to_update Measure the changehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser#Measure_the_change Update the code for productionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser#Update_the_code_for_production https://wikitech.wikimedia.org/wiki/Netflow/sflow High level description on https://en.wikipedia. Goalhttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Goal How does it work?https://wikitech.wikimedia.org/wiki/Netflow/sflow#How_does_it_work? Netflow, on routers, for external traffichttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Netflow,_on_routers,_for_external_traffic Sflow, on switches, for internal traffichttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Sflow,_on_switches,_for_internal_traffic How to deploy?https://wikitech.wikimedia.org/wiki/Netflow/sflow#How_to_deploy? Troubleshootinghttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Troubleshooting Check if pmacct is sending data to kafkahttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Check_if_pmacct_is_sending_data_to_kafka Real time Fastnetmon dashboardhttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Real_time_Fastnetmon_dashboard Check the logshttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Check_the_logs Visualizationhttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Visualization Limitationshttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Limitations Resourceshttps://wikitech.wikimedia.org/wiki/Netflow/sflow#Resources https://wikitech.wikimedia.org/wiki/Wikifeeds Wikifeeds is an API service served via API Gateway. The functionality provided by this was previously part of Mobile content services (MCS). Contactshttps://wikitech.wikimedia.org/wiki/Wikifeeds#Contacts Overviewhttps://wikitech.wikimedia.org/wiki/Wikifeeds#Overview Repositoryhttps://wikitech.wikimedia.org/wiki/Wikifeeds#Repository Technologyhttps://wikitech.wikimedia.org/wiki/Wikifeeds#Technology Deploymenthttps://wikitech.wikimedia.org/wiki/Wikifeeds#Deployment Internal endpointshttps://wikitech.wikimedia.org/wiki/Wikifeeds#Internal_endpoints Architecturehttps://wikitech.wikimedia.org/wiki/Wikifeeds#Architecture Metricshttps://wikitech.wikimedia.org/wiki/Wikifeeds#Metrics Service level indicators/objectives (SLIs/SLOs)https://wikitech.wikimedia.org/wiki/Wikifeeds#Service_level_indicators/objectives_(SLIs/SLOs) See alsohttps://wikitech.wikimedia.org/wiki/Wikifeeds#See_also https://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-16_kubernetes-dns#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-13_maps#Actionables https://wikitech.wikimedia.org/wiki/Event_Platform/Schemas == Motivation and Overview == Motivation and Overviewhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Motivation_and_Overview Event Schema Design Rules and Conventionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Event_Schema_Design_Rules_and_Conventions Schema Repositorieshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Schema_Repositories Hierarchy Ruleshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Hierarchy_Rules Creating a new schema repositoryhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Creating_a_new_schema_repository Creating a new schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Creating_a_new_schema Schema metadatahttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Schema_metadata Event fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Event_fields Required event datahttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Required_event_data $schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#$schema Timestamps: meta.dt and dthttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Timestamps:_meta.dt_and_dt meta.streamhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#meta.stream Event data fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Event_data_fields The new schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#The_new_schema Materializing the schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Materializing_the_schema Modifying schemashttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Modifying_schemas Including sub schemashttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Including_sub_schemas How this workshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#How_this_works Absolute $refhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Absolute_$ref Relative to baseSchemaUris.https://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Relative_to_baseSchemaUris. Testing schemashttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas#Testing_schemas https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy This page contains information about our HAProxy configuration in the CloudVPS environment. OpenStack API Endpointshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#OpenStack_API_Endpoints Backend HA Statushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Backend_HA_Status EQIAD1https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#EQIAD1 Port Mappingshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Port_Mappings Load Balancing and Session Handlinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Load_Balancing_and_Session_Handling Monitoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Monitoring Icingahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Icinga Prometheushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Prometheus Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Troubleshooting Log fileshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Log_files Primary Failoverhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Primary_Failover Designhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#Design DNShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Haproxy#DNS https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser/2019-09-18_Update This page documents the data quality checks for the 2019-09-18 ua-parser update. Comparison-table creationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser/2019-09-18_Update#Comparison-table_creation Analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/ua-parser/2019-09-18_Update#Analysis https://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines This page intends to document conventions, guidelines and rules for designing and evolving Event Schemas. WMF Schema Repositorieshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#WMF_Schema_Repositories Ruleshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Rules Required fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Required_fields No union types / No null valueshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#No_union_types_/_No_null_values No object additionalPropertieshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#No_object_additionalProperties arrayshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#arrays Identifier Naming Ruleshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Identifier_Naming_Rules No Capital letters - Use snake_casehttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#No_Capital_letters_-_Use_snake_case No special charactershttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#No_special_characters Acceptable identifier regexhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Acceptable_identifier_regex Backwards compatible modifications onlyhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Backwards_compatible_modifications_only No type changeshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#No_type_changes Do not remove fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Do_not_remove_fields Do not rename fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Do_not_rename_fields Do not delete schemashttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Do_not_delete_schemas Exceptionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Exceptions Major schema version upgradeshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Major_schema_version_upgrades Incompatible changes to schemas not yet in usehttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Incompatible_changes_to_schemas_not_yet_in_use Incompatible changes to WMF analytics schemashttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Incompatible_changes_to_WMF_analytics_schemas Conventionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Conventions Optional / Missing fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Optional_/_Missing_fields exampleshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#examples datetimes / timestampshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#datetimes_/_timestamps Elapsed time fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Elapsed_time_fields map typeshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#map_types Complex array element and map value type evolution is not well supportedhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Complex_array_element_and_map_value_type_evolution_is_not_well_supported Modeling state changeshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Modeling_state_changes Schema fragmentshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Schema_fragments Frequently used fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Frequently_used_fields http informationhttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#http_information MediaWiki state fragmentshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#MediaWiki_state_fragments Common analytics fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Common_analytics_fields Automatically populated fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Automatically_populated_fields Event Data Modeling and Schema Naminghttps://wikitech.wikimedia.org/wiki/Event_Platform/Schemas/Guidelines#Event_Data_Modeling_and_Schema_Naming https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security This page contains the design of Role-based Access Control (RBAC) and Pod Security system that Toolforge Kubernetes cluster uses. Kubernetes RBAC Role-bindingshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#Kubernetes_RBAC_Role-bindings Pod Securityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#Pod_Security Roleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#Roles Toolforge user roleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#Toolforge_user_roles YAMLhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#YAML Explanationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#Explanation Observer rolehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#Observer_role See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security#See_also https://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-23_s3_primary_db_master_crash#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-09-20_d2_switch_failure#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/MariaDB There is an analytics-specific set of MariaDB servers which hosts full, unredacted replicas of the production MediaWiki databases. Clientshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/MariaDB#Clients Database setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/MariaDB#Database_setup MySQL wrapperhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/MariaDB#MySQL_wrapper https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#What_happens_when_a_project_is_not_marked_as_active Further clueshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#Further_clues Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#Projects_and_Instances account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#account-creation-assistance adminhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#admin admin-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#admin-monitoring analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#analytics antiharassmenthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#antiharassment asyncwikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#asyncwiki automation-frameworkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#automation-framework bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#bastion bloghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#blog butterflyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#butterfly catgraphhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#catgraph chicotestprojecthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#chicotestproject cloud-analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#cloud-analytics clouddb-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#clouddb-services cloudinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#cloudinfra codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#codereview codesearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#codesearch collection-alt-rendererhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#collection-alt-renderer commonsarchivehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#commonsarchive commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#commtech community-labs-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#community-labs-monitoring cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#cvn cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#dashiki deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#deployment-prep designhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#design discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#discourse discovery-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#discovery-stats dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#dwl etcdhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#etcd etytreehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#etytree eventmetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#eventmetrics extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#fastcci general-k8shttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#general-k8s gerrithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#gerrit getstartedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#getstarted githttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#git glampipehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#glampipe globalcuhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#globalcu globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#google-api-proxy grantreviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#grantreview graphqlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#graphql gratitudehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#gratitude hashtagshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#hashtags hat-imagescalershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#hat-imagescalers hhvmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#hhvm houndhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#hound hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#huggle huwiki-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#huwiki-dev icingadutyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#icingaduty ign2commonshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#ign2commons iiabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#iiab incubatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#incubator indicohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#indico integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#integration k8splayhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#k8splay languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#language lewton-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#lewton-test library-card-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#library-card-test library-upgraderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#library-upgrader linkwatcherhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#linkwatcher lizenzhinweisgeneratorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#lizenzhinweisgenerator logginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#logging lta-trackerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#lta-tracker machine-visionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#machine-vision mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#maps mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#math matrixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#matrix mcr-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mcr-dev mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mediawiki-vagrant mezahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#meza mix-n-matchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mix-n-match mobilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mobile monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#monitoring mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mwoffliner mwstakehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mwstake mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#mwv-apt newsletterhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#newsletter observerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#observer ogvjs-integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#ogvjs-integration openocrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#openocr openrefinehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#openrefine openstackhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#openstack orchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#orch oreshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#ores ores-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#ores-staging orighttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#orig osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#osmit otrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#otrs packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#packaging packagist-mirrorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#packagist-mirror partnermetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#partnermetrics pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#paws petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#petscan phabricatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#phabricator phlogistonhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#phlogiston phragilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#phragile planethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#planet pluggableauthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#pluggableauth privpol-captchahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#privpol-captcha project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#project-proxy puppethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#puppet puppet-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#puppet-diffs qnahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#qna quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#quarry queryrapihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#queryrapi rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#rcm reading-web-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#reading-web-staging recommendation-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#recommendation-api redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#redirects sciencesourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#sciencesource searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#search security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#security-tools sentryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#sentry serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#services shinkenhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#shinken shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#signwriting snugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#snuggle social-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#social-tools https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge# strikerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#striker structurednavigationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#structurednavigation suggestbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#suggestbot swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#swift telnethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#telnet test-twemproxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#test-twemproxy testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#testlabs thumborhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#thumbor toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#toolsbeta toolserver-legacyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#toolserver-legacy traffichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#traffic twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#twl utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#utrs videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#video videowikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#videowiki visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#visualeditor wcdohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wcdo webperfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#webperf wikiapiaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikiapiary wikibase-registryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikibase-registry wikibrainhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikibrain wikicitevishttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikicitevis wikidata-autodeschttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidata-autodesc wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidata-dev wikidata-federationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidata-federation wikidata-history-query-servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidata-history-query-service wikidata-primary-sources-toolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidata-primary-sources-tool wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidata-query wikidiff2-wmde-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidiff2-wmde-dev wikidocumentarieshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidocumentaries wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikidumpparse wikifactminehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikifactmine wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikilabels wikilinkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikilink wikimania-supporthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikimania-support wikimetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikimetrics wikispeechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikispeech wikisporehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikispore wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikistats wikistreamhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikistream wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wikitextexp wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wildcat wm-bothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wm-bot wmde-dashboardshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wmde-dashboards wmf-research-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wmf-research-tools wmflabsdotorghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#wmflabsdotorg SHUTDOWN wpxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#SHUTDOWN_wpx xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#xtools https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book The WMCS SRE book is a collection of agreement, best practices and engineering operations workflows that we all in the team try to follow and apply in our day to day work. Community interaction/communicationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Community_interaction/communication Communication channelshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Communication_channels Deprecation planshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Deprecation_plans Expected downtimehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Expected_downtime Exampleshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Examples Changes trackinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Changes_tracking Tickets and work trackinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Tickets_and_work_tracking Server Admin Logshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Server_Admin_Logs Personal availabilityhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Personal_availability On-call and paginghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#On-call_and_paging Additional noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/WMCS-SRE-book#Additional_notes https://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties Cassandra table and keyspace property configuration tool. Source Codehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Source_Code Overview/Motivationhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Overview/Motivation Keyspace Examplehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Keyspace_Example Table Examplehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Table_Example Workflowhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Workflow Sample YAML Outputhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Sample_YAML_Output Installationhttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Installation Usagehttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Usage Changing Defaults and Using cqlshrchttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Changing_Defaults_and_Using_cqlshrc Other switcheshttps://wikitech.wikimedia.org/wiki/Cassandra/Tools/cassandra-table-properties#Other_switches https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/10 ===Week of September 30th=== Week of September 30thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/10#Week_of_September_30th Week of October 7thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/10#Week_of_October_7th Week of October 14thhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/10#Week_of_October_14th Week of October 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/10#Week_of_October_21 Week of October 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/10#Week_of_October_28 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Introduction Serviceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Services IaaS (hardware)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#IaaS_(hardware) Networkhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Network NIC Teaminghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#NIC_Teaming Action Planshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Action_Plans IaaS (software)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#IaaS_(software) Openstackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Openstack Provisioning/bootstraphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Provisioning/bootstrap Configuration Managementhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Configuration_Management PaaS (hardware)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#PaaS_(hardware) PaaS (software)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#PaaS_(software) Legacy Container Orchestration Platform: Kuberneteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Legacy_Container_Orchestration_Platform:_Kubernetes New Container Orchestration Platform: Kuberneteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#New_Container_Orchestration_Platform:_Kubernetes Son of Grid Enginehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Son_of_Grid_Engine Auxiliary Serviceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Auxiliary_Services Legacy Distributed File System: NFShttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Legacy_Distributed_File_System:_NFS New Distributed File System: Cephhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#New_Distributed_File_System:_Ceph DaaS (Hardware)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#DaaS_(Hardware) Wiki Replicashttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Wiki_Replicas Dumpshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Dumps NFShttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#NFS Rsynchttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Rsync Webhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Web DaaS (software)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#DaaS_(software) Toolsdbhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Toolsdb Terminologieshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Terminologies Power Supplyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Power_Supply What is N? N+1? 2N?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#What_is_N?_N+1?_2N? Industry Trendhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Industry_Trend Network Redundancyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Network_Redundancy Server Clusteringhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Server_Clustering Softwarehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Software Kuberneteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Kubernetes Network File Systemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Network_File_System Cephhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Ceph Cost–benefit analysis (CBA)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#Cost–benefit_analysis_(CBA) Referenceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity#References https://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-07_wmcs-network#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration Kerberos is a computer-network authentication protocol that works on the basis of tickets to allow nodes communicating over a non-secure network to prove their identity to one another in a secure manner. The protocol was named after the character Kerberos (or Cerberus) from Greek mythology, the ferocious three-headed guard dog of Hades. Current setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Current_setup Daemons and their roleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Daemons_and_their_roles Bootstrap a kerberos hosthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Bootstrap_a_kerberos_host Master nodehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Master_node Replica nodehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Replica_node Good docs to use as referencehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Good_docs_to_use_as_reference Backupshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Backups Handling failures and failoverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Handling_failures_and_failover Manage principals and keytabshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Manage_principals_and_keytabs Check if a user has a principalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Check_if_a_user_has_a_principal Create a principal for a real userhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Create_a_principal_for_a_real_user Create a keytab for a servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Create_a_keytab_for_a_service Create a custom principal and keytab entryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Create_a_custom_principal_and_keytab_entry Reset a kerberos user passwordhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Reset_a_kerberos_user_password Delete a principal for a real userhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Delete_a_principal_for_a_real_user Delete Kerberos principals and keytabs when a host is decommissionedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#Delete_Kerberos_principals_and_keytabs_when_a_host_is_decommissioned List of principals and their keytabs for Hadoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#List_of_principals_and_their_keytabs_for_Hadoop Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos/Administration#References https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress This page describes the design, topology and setup of Toolforge's networking and ingress, specifically those bits related to webservices in the new kubernetes cluster. Network topologyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#Network_topology Componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#Components outside kuberneteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#outside_kubernetes dynamicproxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#dynamicproxy haproxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#haproxy inside kuberneteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#inside_kubernetes calicohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#calico nginx-ingresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#nginx-ingress error handlinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#error_handling ingress objectshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#ingress_objects ingress admission controllerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#ingress_admission_controller How to test the setuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#How_to_test_the_setup See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Networking_and_ingress#See_also https://wikitech.wikimedia.org/wiki/Puppetmaster1001 puppetmaster1001 is a Puppet master in eqiad. Serviceshttps://wikitech.wikimedia.org/wiki/Puppetmaster1001#Services https://wikitech.wikimedia.org/wiki/Puppetmaster2001 puppetmaster2001 is a Puppet master in codfw. Serviceshttps://wikitech.wikimedia.org/wiki/Puppetmaster2001#Services https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark/Administration = Upgrading Spark = Upgrading Sparkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark/Administration#Upgrading_Spark Spark Shuffle Servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark/Administration#Spark_Shuffle_Service Spark Assemblyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark/Administration#Spark_Assembly Testing PySparkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Spark/Administration#Testing_PySpark https://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-16_network_eqsin#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy This document describes a POC made by the Analytics team. It studied the feasibility of using entropy calculations on top of user agent values to produce data quality metrics that would be fit for alarming. Processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Process Criteriahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Criteria Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Results Useragent os family entropyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Useragent_os_family_entropy Useragent browser family entropyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Useragent_browser_family_entropy Useragent device family entropyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Useragent_device_family_entropy Useragent combined entropyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Useragent_combined_entropy Conclusionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/User_agent_entropy#Conclusions https://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance) == Graphite for synthetic testing == Graphite for synthetic testinghttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Graphite_for_synthetic_testing Accesshttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Access Start/stophttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Start/stop Setuphttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Setup Configurationshttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Configurations Docker composehttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Docker_compose Storage aggregationhttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Storage_aggregation Storage schemashttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Storage_schemas Storing annotationshttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)#Storing_annotations https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster This page contains information on how to deploy kubernetes for our Toolforge setup. This refers to the basic building blocks on bare-metal (such as etcd, controller, worker, etcs) and not to end-user apps running inside kubernetes. general considerationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#general_considerations etcd nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#etcd_nodes Add a new member to the etcd cluster:https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Add_a_new_member_to_the_etcd_cluster: List current members of a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#List_current_members_of_a_cluster front proxy (haproxy)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#front_proxy_(haproxy) control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#control_nodes bootstraphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#bootstrap existing clusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#existing_cluster reconfiguring control plane elements after deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#reconfiguring_control_plane_elements_after_deployment worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#worker_nodes Using cookbookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Using_cookbooks Adding a nodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Adding_a_node Removing a nodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Removing_a_node Manuallyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Manually Bryan's bulk instance processhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Bryan's_bulk_instance_process ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#ingress_nodes Other componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Other_components Kubernetes componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Kubernetes_components Non-kubernetes componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Non-kubernetes_components first tool: fourohfourhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#first_tool:_fourohfour Metricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#Metrics See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/New_cluster#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics == Definition of a mediarequest == Definition of a mediarequesthttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Definition_of_a_mediarequest Differences with mediacountshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Differences_with_mediacounts Mediarequest hive datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Mediarequest_hive_dataset Conclusionhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Conclusion Mediarequests aggregated per refererhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Mediarequests_aggregated_per_referer Mediarequests per filehttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Mediarequests_per_file Top media files by request counthttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Wikistats_2/DataQuality/Vetting_of_mediarequest_metrics#Top_media_files_by_request_count https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public This is a public version of the Geoeditors Monthly dataset. It reports the number of active editors per country per month for a set number of countries. Data Formathttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public#Data_Format Privacyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public#Privacy Country Protection Listhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public#Country_Protection_List No exact countshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public#No_exact_counts Only active wikishttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public#Only_active_wikis Risk Assessmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Geoeditors/Public#Risk_Assessment https://wikitech.wikimedia.org/wiki/Bast3004 bast3004 was the main bastion for the Esams cluster. It replaced bast3002 as part of the 2019 ESAMS refresh ([phab:T236394]), and was in turn replaced by [[bast3005 ([Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast3004#Services https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests https://wikitech.wikimedia.org/wiki/HTTP_timeouts This documents HTTP timeouts involved in a web request from end-users to a service behind WMF traffic layers. Frontend TLShttps://wikitech.wikimedia.org/wiki/HTTP_timeouts#Frontend_TLS Cachinghttps://wikitech.wikimedia.org/wiki/HTTP_timeouts#Caching App serverhttps://wikitech.wikimedia.org/wiki/HTTP_timeouts#App_server Noteshttps://wikitech.wikimedia.org/wiki/HTTP_timeouts#Notes https://wikitech.wikimedia.org/wiki/Recover-dump recover-dump allows the recovery of a database dump (logical backup) as described on MariaDB/Backups#Recovering_a_logical_backup: https://wikitech.wikimedia.org/wiki/SRE/SRE_tooling List of automation tools and libraries, reporting and authoritative Web UIs used by the SRE team. Toolshttps://wikitech.wikimedia.org/wiki/SRE/SRE_tooling#Tools Reporting Web UIhttps://wikitech.wikimedia.org/wiki/SRE/SRE_tooling#Reporting_Web_UI Authoritative Web UIhttps://wikitech.wikimedia.org/wiki/SRE/SRE_tooling#Authoritative_Web_UI https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients The production cluster has several servers which you can use to access the various private data sources and do general statistical computation. They are called the [clients], since they act as clients accessing data from various other databases (but they are also known informally as stat hosts, stat machines, or stat clients). Jupyterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Jupyter Condahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Conda Querying datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Querying_data Pythonhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Python Rhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#R Internet accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Internet_access Resource managementhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Resource_management Local data storagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Local_data_storage Checking for available disk spacehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Checking_for_available_disk_space Checking the space used by your fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Checking_the_space_used_by_your_files Web publicationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Web_publication GPU usagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#GPU_usage Rsync between clientshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Rsync_between_clients Common workflows (WIP)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Common_workflows_(WIP) Spark jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Clients#Spark_jobs https://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-10-31_wikidata#Actionables https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts ==Alertmanager== Alertmanagerhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Alertmanager Grafanahttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Grafana Maxlag: Above 10 for 1 hourhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Maxlag:_Above_10_for_1_hour Edits: Wikidata edit ratehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Edits:_Wikidata_edit_rate API: Max p95 execute time for write moduleshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#API:_Max_p95_execute_time_for_write_modules Termbox Request Errorshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Termbox_Request_Errors Change Dispatchinghttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Change_Dispatching Oozie Jobhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Alerts#Oozie_Job https://wikitech.wikimedia.org/wiki/Generate_an_SSH_Key This page contains information about generating a public SSH Key Overviewhttps://wikitech.wikimedia.org/wiki/Generate_an_SSH_Key#Overview Generate an SSH keyhttps://wikitech.wikimedia.org/wiki/Generate_an_SSH_Key#Generate_an_SSH_key Add or Change a passphrasehttps://wikitech.wikimedia.org/wiki/Generate_an_SSH_Key#Add_or_Change_a_passphrase Noteshttps://wikitech.wikimedia.org/wiki/Generate_an_SSH_Key#Notes https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines tl;dr Executive summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Executive_summary Data sourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Data_sources Request logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Request_logs EventLogginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#EventLogging Operational logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Operational_logs Private application datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Private_application_data Sharing and moving data internallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Sharing_and_moving_data_internally Sharing data with other staff and contractorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Sharing_data_with_other_staff_and_contractors Sensitive data in Phabricatorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Sensitive_data_in_Phabricator Surveys and long-term storagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Surveys_and_long-term_storage Sharing data externallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Sharing_data_externally Sanitization. Do not do it.https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#Sanitization._Do_not_do_it. Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_access_guidelines#References https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/SSL_certificate This page contains information on how to administer and replace the star.wmflabs. Usagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/SSL_certificate#Usage *.wmflabs.org (also known as star.wmflabs.org)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/SSL_certificate#*.wmflabs.org_(also_known_as_star.wmflabs.org) Renewing star.wmflabs.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/SSL_certificate#Renewing_star.wmflabs.org Example of replacing *.wmflabs.orghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/SSL_certificate#Example_of_replacing_*.wmflabs.org https://wikitech.wikimedia.org/wiki/Homer Homer (previously jnt) is our homemade network configuration manager. Deploymenthttps://wikitech.wikimedia.org/wiki/Homer#Deployment Releasing a new versionhttps://wikitech.wikimedia.org/wiki/Homer#Releasing_a_new_version In the homer repositoryhttps://wikitech.wikimedia.org/wiki/Homer#In_the_homer_repository In the homer-deploy repositoryhttps://wikitech.wikimedia.org/wiki/Homer#In_the_homer-deploy_repository In the deployment serverhttps://wikitech.wikimedia.org/wiki/Homer#In_the_deployment_server On any cumin hosthttps://wikitech.wikimedia.org/wiki/Homer#On_any_cumin_host Daily diffshttps://wikitech.wikimedia.org/wiki/Homer#Daily_diffs Usage 🚀https://wikitech.wikimedia.org/wiki/Homer#Usage_🚀 Step 1: Making code changeshttps://wikitech.wikimedia.org/wiki/Homer#Step_1:_Making_code_changes Case 1: Editing the private repositoryhttps://wikitech.wikimedia.org/wiki/Homer#Case_1:_Editing_the_private_repository Case 2: Editing the public repositoryhttps://wikitech.wikimedia.org/wiki/Homer#Case_2:_Editing_the_public_repository Case 3: Editing Netboxhttps://wikitech.wikimedia.org/wiki/Homer#Case_3:_Editing_Netbox Part 2: Deploying above changeshttps://wikitech.wikimedia.org/wiki/Homer#Part_2:_Deploying_above_changes Option 1: Running Homer from cluster management hosts (recommended)https://wikitech.wikimedia.org/wiki/Homer#Option_1:_Running_Homer_from_cluster_management_hosts_(recommended) Option 2: Running Homer from your local machine (less recommended)https://wikitech.wikimedia.org/wiki/Homer#Option_2:_Running_Homer_from_your_local_machine_(less_recommended) Style guideshttps://wikitech.wikimedia.org/wiki/Homer#Style_guides YAML fileshttps://wikitech.wikimedia.org/wiki/Homer#YAML_files Templateshttps://wikitech.wikimedia.org/wiki/Homer#Templates Capirca (ACL generation)https://wikitech.wikimedia.org/wiki/Homer#Capirca_(ACL_generation) How it works?https://wikitech.wikimedia.org/wiki/Homer#How_it_works? Advantageshttps://wikitech.wikimedia.org/wiki/Homer#Advantages Limitationshttps://wikitech.wikimedia.org/wiki/Homer#Limitations How to use it?https://wikitech.wikimedia.org/wiki/Homer#How_to_use_it? Update an existing ACLhttps://wikitech.wikimedia.org/wiki/Homer#Update_an_existing_ACL Guidelineshttps://wikitech.wikimedia.org/wiki/Homer#Guidelines Add a new ACL (firewall filter)https://wikitech.wikimedia.org/wiki/Homer#Add_a_new_ACL_(firewall_filter) Common errorshttps://wikitech.wikimedia.org/wiki/Homer#Common_errors Referenceshttps://wikitech.wikimedia.org/wiki/Homer#References Network configuration coveragehttps://wikitech.wikimedia.org/wiki/Homer#Network_configuration_coverage CRhttps://wikitech.wikimedia.org/wiki/Homer#CR TODOhttps://wikitech.wikimedia.org/wiki/Homer#TODO MRhttps://wikitech.wikimedia.org/wiki/Homer#MR CLOUDSWhttps://wikitech.wikimedia.org/wiki/Homer#CLOUDSW Common/known issueshttps://wikitech.wikimedia.org/wiki/Homer#Common/known_issues https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/11 ===Week of November 4=== Week of November 4https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/11#Week_of_November_4 Week of November 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/11#Week_of_November_11 Week of November 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/11#Week_of_November_18 Week of November 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/11#Week_of_November_25 https://wikitech.wikimedia.org/wiki/Local-charts Local-charts is an ecosystem for Mediawiki in Minikube. https://wikitech.wikimedia.org/wiki/Local-charts/Tutorial To better understand how to contribute to the local-charts environment, let's walk through it together. Goalhttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Goal Stepshttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Steps Clone the local-charts repositoryhttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Clone_the_local-charts_repository Update requirements.yamlhttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Update_requirements.yaml Update values.example.yamlhttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Update_values.example.yaml Run a deploymenthttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Run_a_deployment Resultshttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Results Clean uphttps://wikitech.wikimedia.org/wiki/Local-charts/Tutorial#Clean_up https://wikitech.wikimedia.org/wiki/Shell_Request/Kaleem_Bhatti Shell Access Requestshttps://wikitech.wikimedia.org/wiki/Category:Shell_Access_Requests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos Hadoop by default does not ship with a strong authentication mechanism for users and daemons. In order to enable its "Secure mode", an external authentication service must be plugged in, and the only compatible one is Kerberos. High level overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#High_level_overview Will my files on HDFS change when Kerberos is enabled?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Will_my_files_on_HDFS_change_when_Kerberos_is_enabled? How do I..https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#How_do_I.. Authenticate via Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Authenticate_via_Kerberos Renewing a Tickethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Renewing_a_Ticket Kerberos Auto-Renewal Servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Kerberos_Auto-Renewal_Service Get a password for Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Get_a_password_for_Kerberos Reset my password for Kerberos?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Reset_my_password_for_Kerberos? Run a command as a system user?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Run_a_command_as_a_system_user? Submit a job to Oozie or Hive with a different user than minehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Submit_a_job_to_Oozie_or_Hive_with_a_different_user_than_mine Use JDBC with Hive Serverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Use_JDBC_with_Hive_Server Check the Yarn Resource Manager's UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Check_the_Yarn_Resource_Manager's_UI Check Huehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Check_Hue Use Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Use_Hive Use Spark 2https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Use_Spark_2 Use Jupyterhub (SWAP replica)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Use_Jupyterhub_(SWAP_replica) Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Administration Check the status of the HDFS Namenodes and Yarn Resource Managershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Kerberos#Check_the_status_of_the_HDFS_Namenodes_and_Yarn_Resource_Managers https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats/Deprecation_of_Wikistats_1 This page describes the planned steps to effectively replace Wikistats 1 with the new version released by the Analytics team as it reaches its beta status. URLs (T237752)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats/Deprecation_of_Wikistats_1#URLs_(T237752) Notice (T237999)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats/Deprecation_of_Wikistats_1#Notice_(T237999) Docshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Wikistats/Deprecation_of_Wikistats_1#Docs https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/SSR_Service/sequence Compatible with: https://wikitech.wikimedia.org/wiki/Microcode All our servers (with the exceptions of some very old ones which are not supported by Intel anymore) are expected to use mitigations for the following three Intel CPU vulnerability classes requiring microcode updates (some issues were fixed without needing additional microcode): https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching This dataset is a restricted public snapshot of the wmf.webrequest table intended for caching research. Data Updates & Formathttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Data_Updates_&_Format Upload Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Upload_Data Text Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Text_Data Privacyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Privacy Relative timestampshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Relative_timestamps Hashed host, path, and queryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Hashed_host,_path,_and_query Risk Assessmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Risk_Assessment Previous Releaseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#Previous_Releases 2016https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#2016 2008https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Caching#2008 https://wikitech.wikimedia.org/wiki/XHGui/Runbook This is the internal runbook for XHGui service. Hostshttps://wikitech.wikimedia.org/wiki/XHGui/Runbook#Hosts Metahttps://wikitech.wikimedia.org/wiki/XHGui/Runbook#Meta Upgrade XHGuihttps://wikitech.wikimedia.org/wiki/XHGui/Runbook#Upgrade_XHGui Update our mirrorhttps://wikitech.wikimedia.org/wiki/XHGui/Runbook#Update_our_mirror Update dependencieshttps://wikitech.wikimedia.org/wiki/XHGui/Runbook#Update_dependencies Upgrade our installhttps://wikitech.wikimedia.org/wiki/XHGui/Runbook#Upgrade_our_install https://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment == Push LFS data to gerrit == Push LFS data to gerrithttps://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment#Push_LFS_data_to_gerrit Add a `gerrit` remote to your github.com clonehttps://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment#Add_a_`gerrit`_remote_to_your_github.com_clone Pull and push LFS datahttps://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment#Pull_and_push_LFS_data Update the deploy repositoryhttps://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment#Update_the_deploy_repository Update wheelshttps://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment#Update_wheels After the change to wheels is merged: Submit the deploy repo changes for reviewhttps://wikitech.wikimedia.org/wiki/ORES/Prepare_deployment#After_the_change_to_wheels_is_merged:_Submit_the_deploy_repo_changes_for_review https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes This document only applies to a kubeadm-managed cluster deployed as described in Portal:Toolforge/Admin/Kubernetes/Deploying. Prepare upgradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Prepare_upgrade Create an upgrade taskhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Create_an_upgrade_task Kubernetes changeloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Kubernetes_changelog Third-party componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Third-party_components Etcdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Etcd Managing packageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Managing_packages Upgrade lima-kilohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Upgrade_lima-kilo Announce user-facing changeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Announce_user-facing_changes Upgrade a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Upgrade_a_cluster Begin upgradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Begin_upgrade Upgrade control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Upgrade_control_nodes Upgrade worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Upgrade_worker_nodes Ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Ingress_nodes finishing toucheshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#finishing_touches Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Troubleshooting Permission errors after control plane upgradeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Permission_errors_after_control_plane_upgrades Sub pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes#Sub_pages https://wikitech.wikimedia.org/wiki/Incidents/2019-12-04_MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-04_MediaWiki#Summary Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-04_MediaWiki#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-04_MediaWiki#Timeline Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-04_MediaWiki#Links_to_relevant_documentation https://wikitech.wikimedia.org/wiki/Phab2001 phab2001 is a Phabricator (standby) server in codfw. Connectinghttps://wikitech.wikimedia.org/wiki/Phab2001#Connecting https://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms === Traffic Outages == Traffic Outageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Traffic_Outages Methodhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Method Criteriahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Criteria Resultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Results Iraq Oct 2019https://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Iraq_Oct_2019 China Apr 2019https://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#China_Apr_2019 Venezuela Jan 2019https://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Venezuela_Jan_2019 India Oct 2019https://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#India_Oct_2019 Conclusionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_quality/Entrophy_alarms#Conclusions https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/12 ===Week of December 02=== Week of December 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/12#Week_of_December_02 Week of December 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/12#Week_of_December_09 Week of December 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/12#Week_of_December_16 Week of December 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2019/12#Week_of_December_23 https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Detection Timeline (European time)https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Timeline_(European_time) Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_Cite#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2020#By_month https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Overview Abstracthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Abstract Backgroundhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Background Migration methodshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Migration_methods Rough Steps in Orderhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Rough_Steps_in_Order Migration Phaseshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Migration_Phases Phase 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Phase_1 Phase 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Phase_2 Phase 2.1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Phase_2.1 Phase 2.2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Phase_2.2 Example User Instructions for Phase 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Example_User_Instructions_for_Phase_2 Phase 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Phase_3 Timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Migration_Plan_and_Timeline#Timeline https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Capacity_Planning There are several measures that can be considered when capacity designing for a Kubernetes cluster. In our current use case, the primary driver of cluster capacity consumption is the number of webservices deployed at any given time. Nodeshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Capacity_Planning#Nodes Webserviceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Capacity_Planning#Webservices Ingresshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Capacity_Planning#Ingress DNShttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Kubernetes_Capacity_Planning#DNS https://wikitech.wikimedia.org/wiki/Kubernetes/Service_ports In general, new services should reserve TLS ports in the 4000-5000 port range. Old services will be moved over that range as soon as practically possible. Service portshttps://wikitech.wikimedia.org/wiki/Kubernetes/Service_ports#Service_ports Infrastructure serviceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Service_ports#Infrastructure_services https://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_updateCategoryCounts == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_updateCategoryCounts#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_updateCategoryCounts#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_updateCategoryCounts#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_updateCategoryCounts#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-10_updateCategoryCounts#Actionables https://wikitech.wikimedia.org/wiki/PipelineLib PipelineLib is a container based CI workflow specification and engine. It executes any number of discrete CI tasks—building images, running tests, deploying images, etc. https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Maintenance This page contains information for common maintenance tasks we administrator do in Toolforge. Admin scriptshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Maintenance#Admin_scripts wmcs-k8s-get-certhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Maintenance#wmcs-k8s-get-cert wmcs-k8s-enable-cluster-monitorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Maintenance#wmcs-k8s-enable-cluster-monitor Other scriptshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Maintenance#Other_scripts wmcs-package-buildhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Maintenance#wmcs-package-build https://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-11_MachineVision%2Bcpjobqueue#Actionables https://wikitech.wikimedia.org/wiki/Cloudmetrics1002 cloudmetrics1002 was a part of the Cloud VPS monitoring infrastructure. Serviceshttps://wikitech.wikimedia.org/wiki/Cloudmetrics1002#Services See alsohttps://wikitech.wikimedia.org/wiki/Cloudmetrics1002#See_also https://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode Welcome to Testing Hello Node, a simple PipelineLib tutorial. Prerequisiteshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Prerequisites Learning objectiveshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Learning_objectives Tutorialhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Tutorial Clone the example repohttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Clone_the_example_repo Look for a test image varianthttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Look_for_a_test_image_variant Define the test pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Define_the_test_pipeline Submit our change to Gerrithttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Submit_our_change_to_Gerrit Watch CI execute the pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode#Watch_CI_execute_the_pipeline https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/01 ===Week of December 30=== Week of December 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/01#Week_of_December_30 Week of January 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/01#Week_of_January_06 Week of January 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/01#Week_of_January_13 Week of January 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/01#Week_of_January_20 Week of January 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/01#Week_of_January_27 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39 == 2019-12-31 == 2019-12-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-31 2019-12-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-30 2019-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-29 2019-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-28 2019-12-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-27 2019-12-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-25 2019-12-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-24 2019-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-23 2019-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-22 2019-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-21 2019-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-20 2019-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-19 2019-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-18 2019-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-17 2019-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-16 2019-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-14 2019-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-13 2019-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-12 2019-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-11 2019-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-10 2019-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-09 2019-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-08 2019-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-07 2019-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-06 2019-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-05 2019-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-04 2019-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-03 2019-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-02 2019-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-12-01 2019-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-30 2019-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-29 2019-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-28 2019-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-27 2019-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-26 2019-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-25 2019-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-24 2019-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-23 2019-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-22 2019-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-21 2019-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-20 2019-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-19 2019-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-18 2019-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-16 2019-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-15 2019-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-14 2019-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-13 2019-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-12 2019-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-11 2019-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-09 2019-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-08 2019-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-07 2019-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-06 2019-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-05 2019-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-04 2019-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-03 2019-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-02 2019-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-11-01 2019-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-31 2019-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-30 2019-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-29 2019-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-28 2019-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-26 2019-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-25 2019-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-24 2019-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-23 2019-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-22 2019-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-21 2019-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-19 2019-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-18 2019-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-17 2019-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-16 2019-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-15 2019-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-14 2019-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-13 2019-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-12 2019-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-11 2019-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-10 2019-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-09 2019-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-08 2019-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-07 2019-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-06 2019-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-05 2019-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-04 2019-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-03 2019-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-02 2019-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-10-01 2019-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-30 2019-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-28 2019-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-27 2019-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-26 2019-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-25 2019-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-24 2019-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-23 2019-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-22 2019-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-21 2019-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-20 2019-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-19 2019-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-18 2019-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-17 2019-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-16 2019-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-15 2019-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-14 2019-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-13 2019-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-12 2019-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-11 2019-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-10 2019-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-09 2019-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-08 2019-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-06 2019-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-05 2019-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-04 2019-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-03 2019-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-02 2019-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#2019-09-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_39#Other_archives https://wikitech.wikimedia.org/wiki/Puppetmaster Puppetmaster may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/SRE/Observability SRE Observability▼ How we work.https://wikitech.wikimedia.org/wiki/SRE/Observability#How_we_work. Overviewhttps://wikitech.wikimedia.org/wiki/SRE/Observability#Overview How to connect (and why)https://wikitech.wikimedia.org/wiki/SRE/Observability#How_to_connect_(and_why) Office Hourshttps://wikitech.wikimedia.org/wiki/SRE/Observability#Office_Hours How we Organize our Workhttps://wikitech.wikimedia.org/wiki/SRE/Observability#How_we_Organize_our_Work Phabricator Workflowhttps://wikitech.wikimedia.org/wiki/SRE/Observability#Phabricator_Workflow How we Plan our Roadmaphttps://wikitech.wikimedia.org/wiki/SRE/Observability#How_we_Plan_our_Roadmap Prioritizationhttps://wikitech.wikimedia.org/wiki/SRE/Observability#Prioritization Project Work (OKR)https://wikitech.wikimedia.org/wiki/SRE/Observability#Project_Work_(OKR) Maintenance (non-OKR)https://wikitech.wikimedia.org/wiki/SRE/Observability#Maintenance_(non-OKR) Work Cadence Summaryhttps://wikitech.wikimedia.org/wiki/SRE/Observability#Work_Cadence_Summary https://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Actionables Grander schemeshttps://wikitech.wikimedia.org/wiki/Incidents/2019-12-31_search-api-traffic-block#Grander_schemes https://wikitech.wikimedia.org/wiki/Superset Apache Superset is a platform for data exploration, collaboration, and visualization. Instanceshttps://wikitech.wikimedia.org/wiki/Superset#Instances Wikimedia Cloud Serviceshttps://wikitech.wikimedia.org/wiki/Superset#Wikimedia_Cloud_Services Data Engineeringhttps://wikitech.wikimedia.org/wiki/Superset#Data_Engineering How do I ...https://wikitech.wikimedia.org/wiki/Superset#How_do_I_... Get access to Superset?https://wikitech.wikimedia.org/wiki/Superset#Get_access_to_Superset? See a list of recent queries from all users?https://wikitech.wikimedia.org/wiki/Superset#See_a_list_of_recent_queries_from_all_users? Run a SQL query?https://wikitech.wikimedia.org/wiki/Superset#Run_a_SQL_query? Collaborate with others?https://wikitech.wikimedia.org/wiki/Superset#Collaborate_with_others? Create a visualization?https://wikitech.wikimedia.org/wiki/Superset#Create_a_visualization? Use the API?https://wikitech.wikimedia.org/wiki/Superset#Use_the_API? Add a featurehttps://wikitech.wikimedia.org/wiki/Superset#Add_a_feature https://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration This page details information about the historical migration to the 2020 Toolforge Kubernetes cluster from the legacy (2016) Kubernetes cluster. This migration was completed on 2020-03-01. What is changing?https://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#What_should_I_do? Manually migrate a webservice to the new clusterhttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Manually_migrate_a_webservice_to_the_new_cluster Manually migrate Kubernetes continuous jobs or other custom Deploymentshttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Manually_migrate_Kubernetes_continuous_jobs_or_other_custom_Deployments What are the primary changes with moving to the new cluster?https://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#What_are_the_primary_changes_with_moving_to_the_new_cluster? Lower default resource limits for webservicehttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Lower_default_resource_limits_for_webservice Namespace quota systemhttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Namespace_quota_system Improved isolation between namespaceshttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Improved_isolation_between_namespaces New LDAP integration mechanismhttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#New_LDAP_integration_mechanism New ingress routing layerhttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#New_ingress_routing_layer Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Solutions_to_common_problems webservice restart failshttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#webservice_restart_fails Switch back to the legacy Kubernetes clusterhttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#Switch_back_to_the_legacy_Kubernetes_cluster kubectl errors: "cannot create resource … in API group … in the namespace"https://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#kubectl_errors:_"cannot_create_resource_…_in_API_group_…_in_the_namespace" See alsohttps://wikitech.wikimedia.org/wiki/News/2020_Kubernetes_cluster_migration#See_also https://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-08_mw-api#Actionables https://wikitech.wikimedia.org/wiki/Phabricator/Conduit_API_Tokens Wikimedia's SRE and Release Engineering teams maintain several automated processes which utilize [Bot] accounts to access Phabricator's Conduit API. This list is an attempt to document all of these bots and where their api tokens are used. Bots maintained by RelEng & SREhttps://wikitech.wikimedia.org/wiki/Phabricator/Conduit_API_Tokens#Bots_maintained_by_RelEng_&_SRE Bots maintained by WMCShttps://wikitech.wikimedia.org/wiki/Phabricator/Conduit_API_Tokens#Bots_maintained_by_WMCS Bots maintained by the communityhttps://wikitech.wikimedia.org/wiki/Phabricator/Conduit_API_Tokens#Bots_maintained_by_the_community See Alsohttps://wikitech.wikimedia.org/wiki/Phabricator/Conduit_API_Tokens#See_Also https://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages Welcome to Testing Hello Node (with multiple stages), a slightly more advanced PipelineLib tutorial than the previous Testing Hello Node tutorial. Prerequisiteshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Prerequisites Learning objectiveshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Learning_objectives Tutorialhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Tutorial Set up the example repohttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Set_up_the_example_repo Modify the existing test variant to run lintershttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Modify_the_existing_test_variant_to_run_linters Define a stage to build the script runnerhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Define_a_stage_to_build_the_script_runner Define additional test and lint stageshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Define_additional_test_and_lint_stages Submit our change and watch our pipeline executehttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Submit_our_change_and_watch_our_pipeline_execute Clean up and move onhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_multiple_stages#Clean_up_and_move_on https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing Synthetic testing (or lab testing) is the practice of continously monitoring frontend performance from a known and controlled environment. Responsibilitieshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Responsibilities Our Web Performance testing principleshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Our_Web_Performance_testing_principles Strategyhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Strategy Current setuphttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Current_setup How it workshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#How_it_works Resultshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Results Browsertime and WebPageReplayhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Browsertime_and_WebPageReplay CruXhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#CruX When to use what tool/test?https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#When_to_use_what_tool/test? Further readinghttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing#Further_reading https://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial PipelineLib is a container based CI workflow specification and engine. It executes any number of discrete CI tasks—building images, running tests, deploying images, etc. https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5 == 2019-12-29 == 2019-12-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-29 2019-12-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-28 2019-12-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-27 2019-12-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-26 2019-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-21 2019-12-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-20 2019-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-19 2019-12-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-18 2019-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-17 2019-12-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-16 2019-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-15 2019-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-14 2019-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-13 2019-12-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-12 2019-12-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-11 2019-12-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-10 2019-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-09 2019-12-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-06 2019-12-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-05 2019-12-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-04 2019-12-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-03 2019-12-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-12-02 2019-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-30 2019-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-29 2019-11-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-28 2019-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-27 2019-11-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-26 2019-11-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-25 2019-11-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-24 2019-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-22 2019-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-20 2019-11-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-18 2019-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-17 2019-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-15 2019-11-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-13 2019-11-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-12 2019-11-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-11 2019-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-08 2019-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-07 2019-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-06 2019-11-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-05 2019-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-04 2019-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-02 2019-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-11-01 2019-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-31 2019-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-30 2019-10-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-29 2019-10-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-28 2019-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-27 2019-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-26 2019-10-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-25 2019-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-24 2019-10-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-23 2019-10-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-22 2019-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-21 2019-10-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-20 2019-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-19 2019-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-18 2019-10-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-17 2019-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-16 2019-10-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-15 2019-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-14 2019-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-12 2019-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-11 2019-10-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-10 2019-10-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-09 2019-10-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-08 2019-10-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-07 2019-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-04 2019-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-03 2019-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-02 2019-10-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-10-01 2019-09-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-30 2019-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-28 2019-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-27 2019-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-26 2019-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-25 2019-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-24 2019-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-23 2019-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-21 2019-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-20 2019-09-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-19 2019-09-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-18 2019-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-17 2019-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-16 2019-09-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-14 2019-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-13 2019-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-12 2019-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-11 2019-09-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-10 2019-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-09 2019-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-06 2019-09-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-05 2019-09-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-04 2019-09-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-03 2019-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-09-02 2019-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-31 2019-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-30 2019-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-29 2019-08-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-28 2019-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-27 2019-08-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-26 2019-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-25 2019-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-23 2019-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-21 2019-08-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-20 2019-08-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-19 2019-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-15 2019-08-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-14 2019-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-13 2019-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-08 2019-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-07 2019-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-06 2019-08-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-05 2019-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-04 2019-08-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-02 2019-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-08-01 2019-07-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-31 2019-07-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-30 2019-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-29 2019-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-27 2019-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-26 2019-07-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-25 2019-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-24 2019-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-23 2019-07-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-22 2019-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-19 2019-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-18 2019-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-17 2019-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-16 2019-07-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-15 2019-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-14 2019-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-12 2019-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-11 2019-07-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-10 2019-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-09 2019-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-08 2019-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-06 2019-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-05 2019-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-03 2019-07-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-02 2019-07-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-07-01 2019-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-30 2019-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-28 2019-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-27 2019-06-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-26 2019-06-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-25 2019-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-24 2019-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-22 2019-06-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-21 2019-06-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-20 2019-06-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-19 2019-06-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-18 2019-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-15 2019-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-14 2019-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-13 2019-06-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-12 2019-06-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-11 2019-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-10 2019-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-08 2019-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-07 2019-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-06 2019-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-05 2019-06-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-04 2019-06-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-03 2019-06-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-06-01 2019-05-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-31 2019-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-30 2019-05-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-29 2019-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-28 2019-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-26 2019-05-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-22 2019-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-21 2019-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-20 2019-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-19 2019-05-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-18 2019-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-17 2019-05-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-16 2019-05-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-15 2019-05-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-14 2019-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-13 2019-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-10 2019-05-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-09 2019-05-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-07 2019-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-06 2019-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-03 2019-05-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-05-01 2019-04-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-30 2019-04-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-29 2019-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-26 2019-04-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-25 2019-04-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-23 2019-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-19 2019-04-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-18 2019-04-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-17 2019-04-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-16 2019-04-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-15 2019-04-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-13 2019-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-12 2019-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-11 2019-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-10 2019-04-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-09 2019-04-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-08 2019-04-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-07 2019-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-06 2019-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-05 2019-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-04 2019-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-03 2019-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-02 2019-04-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-04-01 2019-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-29 2019-03-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-28 2019-03-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-27 2019-03-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-26 2019-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-25 2019-03-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-24 2019-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-23 2019-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-22 2019-03-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-21 2019-03-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-20 2019-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-19 2019-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-18 2019-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-17 2019-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-16 2019-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-15 2019-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-14 2019-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-13 2019-03-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-12 2019-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-11 2019-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-10 2019-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-08 2019-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-06 2019-03-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-05 2019-03-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-04 2019-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-03 2019-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-02 2019-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-03-01 2019-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-28 2019-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-27 2019-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-26 2019-02-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-25 2019-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-24 2019-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-23 2019-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-22 2019-02-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-21 2019-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-20 2019-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-19 2019-02-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-18 2019-02-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-17 2019-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-16 2019-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-15 2019-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-14 2019-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-13 2019-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-12 2019-02-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-11 2019-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-10 2019-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-08 2019-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-07 2019-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-06 2019-02-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-05 2019-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-04 2019-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-03 2019-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-02-02 2019-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-31 2019-01-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-30 2019-01-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-29 2019-01-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-28 2019-01-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-27 2019-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-26 2019-01-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-25 2019-01-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-23 2019-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-22 2019-01-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-21 2019-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-18 2019-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-17 2019-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-16 2019-01-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-15 2019-01-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-14 2019-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-11 2019-01-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-09 2019-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-08 2019-01-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-07 2019-01-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-06 2019-01-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-03 2019-01-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-02 2019-01-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_5#2019-01-01 https://wikitech.wikimedia.org/wiki/Gerrit1002 gerrit1002 is a temp. gerrit host to test the 2. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/Gerrit1001 gerrit1001 is the current production gerrit host. It replaced cobalt. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Servershttps://wikitech.wikimedia.org/wiki/Category:Servers https://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution Welcome to Testing Hello Node (using parallel execution), an even more advanced PipelineLib tutorial than the previous Testing Hello Node (using multiple stages) tutorial. Prerequisiteshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Prerequisites Learning objectiveshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Learning_objectives Tutorialhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Tutorial Starting pointhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Starting_point Define a stage for running system testshttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Define_a_stage_for_running_system_tests Define a custom execution graphhttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Define_a_custom_execution_graph Submit our change and watch our pipeline executehttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Submit_our_change_and_watch_our_pipeline_execute Clean uphttps://wikitech.wikimedia.org/wiki/PipelineLib/Tutorial/TestingHelloNode_using_parallel_execution#Clean_up https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_current This page describes the dataset on HDFS and Hive that stores the wikitext last-revision per-page of WMF's wikis, as provided through [dumps|monthly XML Dumps]. It lives in Analytic's Hadoop cluster and is accessible via the Hive/Beeline/spark external table wmf. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_current#Schema Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_current#Changes_and_known_problems XMLDumps Row Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_current#XMLDumps_Row_Data Example usagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_current#Example_usage See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_current#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps This page describes the data set dump of the denormalized revision, user and page history of all WMF's wikis. It is computed from the MediaWiki History dataset, lives in the Analytics Hadoop cluster, and is downloadable from MediaWiki Dumps. General Informationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#General_Information Contenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Content Updateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Updates Versioninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Versioning Partitioninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Partitioning File formathttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#File_format Directory structurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Directory_structure Technical Documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Technical_Documentation Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Access Schema overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Schema_overview Important fields: event_entity and event_typehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Important_fields:_event_entity_and_event_type Schema detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Schema_details Code exampleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Code_examples Changes and known problemshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps#Changes_and_known_problems https://wikitech.wikimedia.org/wiki/PipelineLib/Concepts = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/PipelineLib/Concepts#Overview Example .pipeline/config.yamlhttps://wikitech.wikimedia.org/wiki/PipelineLib/Concepts#Example_.pipeline/config.yaml https://wikitech.wikimedia.org/wiki/PipelineLib/Reference = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Overview Configurationhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Configuration Pipelineshttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Pipelines Stageshttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Stages Actionshttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Actions Setuphttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Setup Buildhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Build Runhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Run Copyhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Copy Publishhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Publish Promotehttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Promote Deployhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Deploy Exporthttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Export Triggerhttps://wikitech.wikimedia.org/wiki/PipelineLib/Reference#Trigger https://wikitech.wikimedia.org/wiki/PipelineLib/Guides The guides below are intended to help developers get their projects up and running on the PipelineLib based deployment pipeline, building images, running various tests, performing test deployments, and publishing images. https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/Scala_spark_examples This page provides examples of using Scala Spark to process the Mediawiki history dumps. Loading the data (unescape strings and split arrays)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/Scala_spark_examples#Loading_the_data_(unescape_strings_and_split_arrays) https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/Python_spark_examples This page provides examples of using Python Spark to process the Mediawiki history dumps. Loading the data (unescape strings and split arrays)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/Python_spark_examples#Loading_the_data_(unescape_strings_and_split_arrays) https://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics There are a couple of ways that you can add extra metrics to a page to get more useful performance data. Element timingshttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#Element_timings Addhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#Add Collect from real usershttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#Collect_from_real_users Collect from synthetic testinghttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#Collect_from_synthetic_testing User timinghttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#User_timing Add a markhttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#Add_a_mark sitespeed.iohttps://wikitech.wikimedia.org/wiki/Performance/Guides/Create_new_frontend_metrics#sitespeed.io https://wikitech.wikimedia.org/wiki/Performance/User_Journey User journeys are performance measurements that span multiple interactions and/or browser navigations. User Journeyshttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#User_Journeys Desktophttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Desktop Measure pages as a logged in userhttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Measure_pages_as_a_logged_in_user Searchhttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Search Second view page viewshttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Second_view_page_views Emulated mobilehttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Emulated_mobile Add your own user journeyhttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Add_your_own_user_journey Backgroundhttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Background Addhttps://wikitech.wikimedia.org/wiki/Performance/User_Journey#Add https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup This page is the implementation proposal related to Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_usage#Resolution. domainshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup#domains wikimediacloud.orghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup#wikimediacloud.org toolforge.orghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup#toolforge.org wikimedia.cloudhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup#wikimedia.cloud wmcloud.orghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup#wmcloud.org servershttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/DNS_domain_setup#servers https://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline Welcome to How to define a Node test pipeline, a simple PipelineLib guide to get your NodeJS project's test/lint/other scripts running for each patchset submitted to Gerrit. Prerequisiteshttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#Prerequisites Guidehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#Guide Define a generic npm run-script image varianthttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#Define_a_generic_npm_run-script_image_variant Define a test pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#Define_a_test_pipeline (Optionally) Inject environment variables into the containerhttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#(Optionally)_Inject_environment_variables_into_the_container (Optionally) Define an execution graph that runs your scripts in parallelhttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#(Optionally)_Define_an_execution_graph_that_runs_your_scripts_in_parallel Next uphttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_node_test_pipeline#Next_up https://wikitech.wikimedia.org/wiki/News/Toolforge.org The Toolforge project is ready to start using toolforge.org as its DNS domain for naming both infrastructure (for example the Toolforge bastion servers) and Toolforge hosted webservices, replacing tools. What is changing?https://wikitech.wikimedia.org/wiki/News/Toolforge.org#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge.org#What_should_I_do? SSH to the Toolforge bastions using new hostnameshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#SSH_to_the_Toolforge_bastions_using_new_hostnames Test your webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Test_your_webservice Migrate your webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Migrate_your_webservice What are the primary changes with moving to the new domain?https://wikitech.wikimedia.org/wiki/News/Toolforge.org#What_are_the_primary_changes_with_moving_to_the_new_domain? New service names for accessing Toolforge SSH bastionshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#New_service_names_for_accessing_Toolforge_SSH_bastions New URLs for webserviceshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#New_URLs_for_webservices Temporary --canonical switch for webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Temporary_--canonical_switch_for_webservice Webservice templateshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Webservice_templates Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Solutions_to_common_problems My Kubernetes webservice does not have the proper ingress objectshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#My_Kubernetes_webservice_does_not_have_the_proper_ingress_objects OAuth not working at new domainhttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#OAuth_not_working_at_new_domain Flask and cookieshttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Flask_and_cookies Interwiki links point to legacy URLs rather than toolforge.orghttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Interwiki_links_point_to_legacy_URLs_rather_than_toolforge.org URL query string is not sent with redirect to toolforge.orghttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#URL_query_string_is_not_sent_with_redirect_to_toolforge.org Rewrites in $HOME/.lighttpd.conf not workinghttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Rewrites_in_$HOME/.lighttpd.conf_not_working Cross-Origin Resource Sharing (CORS) requests brokenhttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Cross-Origin_Resource_Sharing_(CORS)_requests_broken URLs to static files named /$TOOL... returning 404https://wikitech.wikimedia.org/wiki/News/Toolforge.org#URLs_to_static_files_named_/$TOOL..._returning_404 Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Toolforge.org#Why_are_we_doing_this? After migration periodhttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#After_migration_period Exceptions to service migrationhttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#Exceptions_to_service_migration See alsohttps://wikitech.wikimedia.org/wiki/News/Toolforge.org#See_also https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment Wikidata Query Service in its current implementation is limited in its scaling options. At the moment, each WDQS cluster is a group of independent servers, sharing nothing, with each server independently updated and each server holding a full data set. Production Constraintshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Production_Constraints Storage capacityhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Storage_capacity Read loadhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Read_load Write loadhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Write_load Graphshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Graphs Test Constraintshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Test_Constraints Validating Evolution of the current Implementationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Validating_Evolution_of_the_current_Implementation Validating a different implementationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Validating_a_different_implementation An ideal testing environment for validationhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#An_ideal_testing_environment_for_validation Private vs Public clustershttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Private_vs_Public_clusters Other Concernshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Other_Concerns Ideashttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Ideas Meeting 2019-02 -05https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/TestEnvironment#Meeting_2019-02_-05 https://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-06_mediawiki#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Emergencies . If that fails, it may be appropriate to use Klaxon. How tohttps://wikitech.wikimedia.org/wiki/Deployments/Emergencies#How_to Reasons for an emergency deployhttps://wikitech.wikimedia.org/wiki/Deployments/Emergencies#Reasons_for_an_emergency_deploy For deployershttps://wikitech.wikimedia.org/wiki/Deployments/Emergencies#For_deployers https://wikitech.wikimedia.org/wiki/Install1003 install1003 was an install server which consists of DHCP, TFTP, webproxy (Squid). https://wikitech.wikimedia.org/wiki/Install2003 install2003 is an install server which consists of DHCP, TFTP, webproxy (Squid). Serviceshttps://wikitech.wikimedia.org/wiki/Install2003#Services See alsohttps://wikitech.wikimedia.org/wiki/Install2003#See_also https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_app_server_latency#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/02 ===Week of February 03=== Week of February 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/02#Week_of_February_03 Week of February 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/02#Week_of_February_10 Week of February 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/02#Week_of_February_17 Week of February 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/02#Week_of_February_24 https://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-26_app_server_latency#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_wikidata#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Timeline Monday 2020-02-10https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Monday_2020-02-10 Tuesday 2020-02-11https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Tuesday_2020-02-11 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-11_caching-proxies#Actionables https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh This page contains an enhacement proposal for the CloudVPS service, specifically the network. Several goals are involved: Constraintshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Constraints VM instance identification vs NAThttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#VM_instance_identification_vs_NAT Datacenter row confinementhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Datacenter_row_confinement Clear separation and no special trusthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Clear_separation_and_no_special_trust Proposalshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Proposals Eliminate routing_source_ip addresshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Eliminate_routing_source_ip_address Benefitshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Benefits Drawbackshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Drawbacks Required changeshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Required_changes Introduce IPv6 as a replacement of dmz_cidrhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Introduce_IPv6_as_a_replacement_of_dmz_cidr Openstackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Openstack Toolforge kuberneteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Toolforge_kubernetes Timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Timeline BGP in the transport networkhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#BGP_in_the_transport_network Debian packageshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Debian_packages Configuration fileshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Configuration_files codfw1devhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#codfw1dev experimentation summary from 2020-03-18https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#experimentation_summary_from_2020-03-18 Use VXLAN in the cloud networkhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Use_VXLAN_in_the_cloud_network considerationshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#considerations intermediate router/firewallhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#intermediate_router/firewall Other optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#Other_options neutron address scopeshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#neutron_address_scopes neutron address scopes revisitedhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#neutron_address_scopes_revisited neutron direct connection to physical internal prod networkshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#neutron_direct_connection_to_physical_internal_prod_networks See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Network_refresh#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus This page contains administrator information about the Toolforge prometheus setup and how to manage it. Setuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#Setup Redundancyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#Redundancy Hierahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#Hiera Alertshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#Alerts Failoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#Failover Data migrationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#Data_migration See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Prometheus#See_also https://wikitech.wikimedia.org/wiki/Services/Monitoring/recommendation_api The Recommendation API is a Node.js API service, served via RESTBase. Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Incidents/2020-01-27_app_server_latency == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-27_app_server_latency#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-01-27_app_server_latency#Timeline https://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#What_went_well? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2019-08-20_logstash#Actionables https://wikitech.wikimedia.org/wiki/MariaDB/monitoring == Icinga == Icingahttps://wikitech.wikimedia.org/wiki/MariaDB/monitoring#Icinga Metricshttps://wikitech.wikimedia.org/wiki/MariaDB/monitoring#Metrics Prometheushttps://wikitech.wikimedia.org/wiki/MariaDB/monitoring#Prometheus Grafanahttps://wikitech.wikimedia.org/wiki/MariaDB/monitoring#Grafana Orchestratorhttps://wikitech.wikimedia.org/wiki/MariaDB/monitoring#Orchestrator Logstash/Kibanahttps://wikitech.wikimedia.org/wiki/MariaDB/monitoring#Logstash/Kibana https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph [(software)|Ceph] is a distributed storage platform which is used to provide shared block storage services for Cloud VPS instance disk and operating system images. This is a low level support system which is interesting to the Wikimedia Cloud Services team and others who work on the OpenStack hosting platform for the Cloud VPS product. Architecturehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Architecture Hardware sizinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Hardware_sizing BIOShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#BIOS Base Settingshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Base_Settings PXE boot settingshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#PXE_boot_settings Storagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Storage Operating System Diskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Operating_System_Disks Ceph OSD Diskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Ceph_OSD_Disks SSD Drive Detailshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#SSD_Drive_Details Networkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Network switcheshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#switches servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#servers Operating Systemhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Operating_System Ceph Packaginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Ceph_Packaging Puppethttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Puppet Roleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Roles Profileshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Profiles Moduleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Modules Post Installation Procedureshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Post_Installation_Procedures Adding OSDshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Adding_OSDs Using cookbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Using_cookbooks Pre-flight checkshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Pre-flight_checks Run the cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Run_the_cookbook Manuallyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Manually Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Common_issues OSDs not joining due to missed heartbeatshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#OSDs_not_joining_due_to_missed_heartbeats Creating Poolshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Creating_Pools Configuring Client Keyringshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Configuring_Client_Keyrings Monitoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Monitoring Logshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Logs Dashboardshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Dashboards Icinga alertshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Icinga_alerts Ceph Cluster Healthhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Ceph_Cluster_Health Ceph Monitor Quorumhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Ceph_Monitor_Quorum Maintenancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Maintenance Restarting Ceph nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Restarting_Ceph_nodes Restarting Ceph serviceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Restarting_Ceph_services ceph-crashhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#ceph-crash ceph-mgrhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#ceph-mgr ceph-monhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#ceph-mon ceph-osdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#ceph-osd Removing or Replacing a failed OSD drivehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Removing_or_Replacing_a_failed_OSD_drive Clientshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Clients Rate limitinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Rate_limiting Nativehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Native OpenStackhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#OpenStack Glancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Glance Nova computehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Nova_compute Migrating local VMs to Cephhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Migrating_local_VMs_to_Ceph CPU Model Typehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#CPU_Model_Type Virtual Machine Imageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Virtual_Machine_Images Object Storage via Radosgwhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Object_Storage_via_Radosgw VirtIO SCSI deviceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#VirtIO_SCSI_devices IO Throttles in Nova Flavorshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#IO_Throttles_in_Nova_Flavors Performance Testinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Performance_Testing Baseline (default tuning options)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Baseline_(default_tuning_options) cloudcephosd <-> cloudcephosdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#cloudcephosd_cloudcephosd cloudvirt1022 -> cloudcephosdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#cloudvirt1022_->_cloudcephosd Ceph RBDhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#Ceph_RBD CLI exampleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Ceph#CLI_examples https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-07_mediawiki_API_down#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_entity The wmf.wikidata_entity table (available on Hive) is a conversion of the Wikidata entities JSON dumps in parquet. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_entity#Current_Schema Sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_entity#Sample_queries Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_entity#Hive Changes and known problems since 2020-02https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_entity#Changes_and_known_problems_since_2020-02 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_entity#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_item_page_link The wmf.wikidata_item_page_link table (available on Hive) contains links between a wikidata item and its related wikipedia pages in various languages. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_item_page_link#Current_Schema Sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_item_page_link#Sample_queries Changes and known problems since 2020-02https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_item_page_link#Changes_and_known_problems_since_2020-02 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Wikidata_item_page_link#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_project_namespace_map The wmf_raw.mediawiki_project_namespace_map table (available on Hive) contains project and namespace data for every project referenced in the Wikimedia sitematrix. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_project_namespace_map#Current_Schema Changes and known problems since 2019-08https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_project_namespace_map#Changes_and_known_problems_since_2019-08 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_project_namespace_map#See_also https://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-25_mediawiki_interface_language#Actionables https://wikitech.wikimedia.org/wiki/Search/articletopic CirrusSearch supports searching Wikipedia main-namespace articles by article topic (provided by the [agnostic link-based article topic]) using the articletopic: keyword. This requires loading LiftWing predictions into Elasticsearch. Detailshttps://wikitech.wikimedia.org/wiki/Search/articletopic#Details Managementhttps://wikitech.wikimedia.org/wiki/Search/articletopic#Management See alsohttps://wikitech.wikimedia.org/wiki/Search/articletopic#See_also https://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-24_esams#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates Cloud VPS uses host aggregates to assign different hypervisors to different use-cases. For a quick overview of which host is assigned where, run this on a controller node: How it Workshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#How_it_Works Propertieshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#Properties standardhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#standard db-hosthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#db-host wdqshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#wdqs cephhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#ceph localdiskhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#localdisk network-agenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#network-agent Aggregateshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#Aggregates dbhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#db sparehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#spare maintenancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#maintenance toobusyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#toobusy network-linuxbridgehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#network-linuxbridge network-ovshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#network-ovs Common Actionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Host_aggregates#Common_Actions https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-02-04_maps#Actionables https://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project Welcome to Configure our CI system to execute your pipeline, a simple PipelineLib guide to get your project's newly defined test pipeline running for each patchset submitted to Gerrit. Prerequisiteshttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Prerequisites Guidehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Guide Configure our CI system to execute your pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Configure_our_CI_system_to_execute_your_pipeline Clone integration/confighttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Clone_integration/config Tell Jenkins about your project's test pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Tell_Jenkins_about_your_project's_test_pipeline Tell Zuul to invoke your pipeline jobs to test project patchsetshttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Tell_Zuul_to_invoke_your_pipeline_jobs_to_test_project_patchsets (Optionally) Tell Zuul to invoke your publish pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#(Optionally)_Tell_Zuul_to_invoke_your_publish_pipeline Publish after every merged changehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Publish_after_every_merged_change Publish for every created/updated taghttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_configure_CI_for_your_project#Publish_for_every_created/updated_tag https://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline Welcome to How to define a Go test pipeline, a simple PipelineLib guide to get your Go project patchsets tested and linted. Prerequisiteshttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline#Prerequisites Guidehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline#Guide Define test and lint image variantshttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline#Define_test_and_lint_image_variants Define a simple test pipelinehttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline#Define_a_simple_test_pipeline (Optionally) Perform lint and test in parallelhttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline#(Optionally)_Perform_lint_and_test_in_parallel Next uphttps://wikitech.wikimedia.org/wiki/PipelineLib/Guides/How_to_define_a_golang_test_pipeline#Next_up https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates This page contains information on certificates (PKI, X.509, etc) for the Toolforge Kubernetes cluster. General considerationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#General_considerations External API accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#External_API_access Operationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#Operations Internal API requestshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#Internal_API_requests cert-managerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#cert-manager Kubernetes CA certificates (legacy method)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#Kubernetes_CA_certificates_(legacy_method) Node/kubelet certshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#Node/kubelet_certs NODE GROUPhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#NODE_GROUP Tool certshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#Tool_certs Etcd certshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#Etcd_certs See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Certificates#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/03 ===Week of March 02=== Week of March 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/03#Week_of_March_02 Week of March 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/03#Week_of_March_09 Week of March 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/03#Week_of_March_16 Week of March 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/03#Week_of_March_23 Week of March 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/03#Week_of_March_30 https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion == Goals == Goalshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Goals Current clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Current_cluster Related taskshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Related_tasks Storage considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Storage_considerations Current State (2020-03-06)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Current_State_(2020-03-06) Adding pagecountshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Adding_pagecounts Pageviewshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Pageviews Pagecountshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Pagecounts Remarkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Remarks Note on sizinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Note_on_sizing Ops thoughtshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/Scaling/2020/Cluster_Expansion#Ops_thoughts https://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration == What is changing? == What is changing?https://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#What_should_I_do? Update client connection stringshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#Update_client_connection_strings Update your Tools support Elasticsearch version 7 APIshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#Update_your_Tools_support_Elasticsearch_version_7_APIs Deprecated index document typeshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#Deprecated_index_document_types See alsohttps://wikitech.wikimedia.org/wiki/News/Toolforge_Elasticsearch_v7_migration#See_also https://wikitech.wikimedia.org/wiki/User-agent_policy https://wikitech.wikimedia.org/wiki/CAS-SSO The Wikimedia Developer SSO Portal at idp.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/CAS-SSO#Service Enabling U2F as a second factorhttps://wikitech.wikimedia.org/wiki/CAS-SSO#Enabling_U2F_as_a_second_factor Requesting to enable U2F (if you're not in SRE)https://wikitech.wikimedia.org/wiki/CAS-SSO#Requesting_to_enable_U2F_(if_you're_not_in_SRE) Enabling U2F for an accounthttps://wikitech.wikimedia.org/wiki/CAS-SSO#Enabling_U2F_for_an_account Known issues / FAQhttps://wikitech.wikimedia.org/wiki/CAS-SSO#Known_issues_/_FAQ What username do services usehttps://wikitech.wikimedia.org/wiki/CAS-SSO#What_username_do_services_use Debugginghttps://wikitech.wikimedia.org/wiki/CAS-SSO#Debugging mod_auth_cashttps://wikitech.wikimedia.org/wiki/CAS-SSO#mod_auth_cas External linkhttps://wikitech.wikimedia.org/wiki/CAS-SSO#External_link https://wikitech.wikimedia.org/wiki/Httpbb httpbb (for "HTTP Black Box") is a [testing|black-box testing] tool for HTTP servers. It reads in a list of test cases, each of which is a specification for an HTTP request followed by one or more assertions about the response. Running testshttps://wikitech.wikimedia.org/wiki/Httpbb#Running_tests Adding testshttps://wikitech.wikimedia.org/wiki/Httpbb#Adding_tests Exampleshttps://wikitech.wikimedia.org/wiki/Httpbb#Examples Deploying httpbbhttps://wikitech.wikimedia.org/wiki/Httpbb#Deploying_httpbb https://wikitech.wikimedia.org/wiki/Deployments/COVID-19 == Why == Whyhttps://wikitech.wikimedia.org/wiki/Deployments/COVID-19#Why Questions to answer if you’re thinking about merginghttps://wikitech.wikimedia.org/wiki/Deployments/COVID-19#Questions_to_answer_if_you’re_thinking_about_merging Heightened Awarenesshttps://wikitech.wikimedia.org/wiki/Deployments/COVID-19#Heightened_Awareness Office hourshttps://wikitech.wikimedia.org/wiki/Deployments/COVID-19#Office_hours https://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-19_parsercache#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Horizon = deploying updates to Horizon = deploying updates to Horizonhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Horizon#deploying_updates_to_Horizon Refreshing upstream code basehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Horizon#Refreshing_upstream_code_base Deployinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Horizon#Deploying https://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org techblog.wikimedia. Local dev setuphttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#Local_dev_setup GitHub reposhttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#GitHub_repos Visitor privacyhttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#Visitor_privacy Piwik for analyticshttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#Piwik_for_analytics Monitoringhttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#Monitoring Historyhttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#History See alsohttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#See_also External linkshttps://wikitech.wikimedia.org/wiki/Techblog.wikimedia.org#External_links https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Administration == View the Presto UI == View the Presto UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Administration#View_the_Presto_UI Roll restart the Presto clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Administration#Roll_restart_the_Presto_cluster Check metrics about Prestohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Administration#Check_metrics_about_Presto Who/What uses Presto?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Administration#Who/What_uses_Presto? Presto server downhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Administration#Presto_server_down https://wikitech.wikimedia.org/wiki/CAS-SSO/Administration Page with information on how to debug/handle Apereo CAS as deployed by the Wikimedia Foundation. Test URLshttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#Test_URLs Icingahttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#Icinga $vhost requires authenticationhttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#$vhost_requires_authentication API endpointshttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#API_endpoints Session timeout handlinghttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#Session_timeout_handling Current Settingshttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#Current_Settings Updating the CAS Debian packagehttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#Updating_the_CAS_Debian_package Rebootinghttps://wikitech.wikimedia.org/wiki/CAS-SSO/Administration#Rebooting https://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network document status: Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-03-25_codfw-network#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Legacy_redirector_for_webservices In 2020, a change happened to how Toolforge webservices are accessed from the internet. How it workshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Legacy_redirector_for_webservices#How_it_works Deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Legacy_redirector_for_webservices#Deployment See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Legacy_redirector_for_webservices#See_also https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors This is a guide for monitoring production errors with OpenSearch, and creating or triaging reports of such errors with Phabricator. Introductionhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Introduction Terminologyhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Terminology OpenSearchhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#OpenSearch Privacy policyhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Privacy_policy Log message contexthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Log_message_context Other places to find logshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Other_places_to_find_logs Triage processhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Triage_process Getting startedhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Getting_started Review the workboardhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Review_the_workboard Reporting an errorhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Reporting_an_error Search for existing taskshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Search_for_existing_tasks Create a taskhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Create_a_task Create a filterhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Create_a_filter Bag of trickshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Bag_of_tricks Determine componenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Determine_component Find where an extension runshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Find_where_an_extension_runs Train blockerhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Train_blocker Managing filtershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Managing_filters Find obsolete filtershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Find_obsolete_filters Filtering by query stringhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Filtering_by_query_string Filter by multiple fieldshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#Filter_by_multiple_fields After task resolutionhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Monitor_production_errors#After_task_resolution https://wikitech.wikimedia.org/wiki/Planet1002 planet1002 is a backend for planet.wikimedia. See alsohttps://wikitech.wikimedia.org/wiki/Planet1002#See_also https://wikitech.wikimedia.org/wiki/Planet2002 planet2002 is a backend for planet.wikimedia. See alsohttps://wikitech.wikimedia.org/wiki/Planet2002#See_also https://wikitech.wikimedia.org/wiki/Changeprop changeprop (or Change Propagation) is the name given to a service that processes change events generated by MediaWiki and stored in Kafka. Various actions are taken based on the messages read from Kafka. What it doeshttps://wikitech.wikimedia.org/wiki/Changeprop#What_it_does How it workshttps://wikitech.wikimedia.org/wiki/Changeprop#How_it_works Ruleshttps://wikitech.wikimedia.org/wiki/Changeprop#Rules Service interactionshttps://wikitech.wikimedia.org/wiki/Changeprop#Service_interactions Where it runshttps://wikitech.wikimedia.org/wiki/Changeprop#Where_it_runs Adding featureshttps://wikitech.wikimedia.org/wiki/Changeprop#Adding_features Adding a new rulehttps://wikitech.wikimedia.org/wiki/Changeprop#Adding_a_new_rule Deployinghttps://wikitech.wikimedia.org/wiki/Changeprop#Deploying To Kuberneteshttps://wikitech.wikimedia.org/wiki/Changeprop#To_Kubernetes To deployment-prephttps://wikitech.wikimedia.org/wiki/Changeprop#To_deployment-prep Generating the configurationhttps://wikitech.wikimedia.org/wiki/Changeprop#Generating_the_configuration Deploying the configurationhttps://wikitech.wikimedia.org/wiki/Changeprop#Deploying_the_configuration Testinghttps://wikitech.wikimedia.org/wiki/Changeprop#Testing mw_purgehttps://wikitech.wikimedia.org/wiki/Changeprop#mw_purge null_edithttps://wikitech.wikimedia.org/wiki/Changeprop#null_edit How to monitor ithttps://wikitech.wikimedia.org/wiki/Changeprop#How_to_monitor_it Debugginghttps://wikitech.wikimedia.org/wiki/Changeprop#Debugging Querying configurationhttps://wikitech.wikimedia.org/wiki/Changeprop#Querying_configuration Non-issueshttps://wikitech.wikimedia.org/wiki/Changeprop#Non-issues Where it liveshttps://wikitech.wikimedia.org/wiki/Changeprop#Where_it_lives See alsohttps://wikitech.wikimedia.org/wiki/Changeprop#See_also https://wikitech.wikimedia.org/wiki/DNS/Netbox IP allocation is done via Netbox, that is our IPAM, and DNS records of IPs allocated in Netbox are automatically generated from Netbox data. Infrastructurehttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Infrastructure IP Allocationhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#IP_Allocation DNS records involvedhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#DNS_records_involved Missing AAAA records for primary IPv6https://wikitech.wikimedia.org/wiki/DNS/Netbox#Missing_AAAA_records_for_primary_IPv6 Mixed clustershttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Mixed_clusters Operationshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Operations Update generated recordshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Update_generated_records Force update generated recordshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Force_update_generated_records Convert an hardcoded $ORIGIN to Netboxhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Convert_an_hardcoded_$ORIGIN_to_Netbox Check if any automatically generated zone file is not includedhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Check_if_any_automatically_generated_zone_file_is_not_included Atomically deploy auto-generated records and a manual changehttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Atomically_deploy_auto-generated_records_and_a_manual_change Modify the generated data in an emergencyhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Modify_the_generated_data_in_an_emergency Add missing DNS name to the primary IPv6 addresshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Add_missing_DNS_name_to_the_primary_IPv6_address Single hosthttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Single_host Multiple hostshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Multiple_hosts Transition FAQhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Transition_FAQ Am I affected?https://wikitech.wikimedia.org/wiki/DNS/Netbox#Am_I_affected? What has changedhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#What_has_changed Why some IPv6 do not have a related AAAA/PTR DNS records?https://wikitech.wikimedia.org/wiki/DNS/Netbox#Why_some_IPv6_do_not_have_a_related_AAAA/PTR_DNS_records? Who can I ping for questions?https://wikitech.wikimedia.org/wiki/DNS/Netbox#Who_can_I_ping_for_questions? What to do if the diff has spurious changes?https://wikitech.wikimedia.org/wiki/DNS/Netbox#What_to_do_if_the_diff_has_spurious_changes? How to allocate primary IPs for a serverhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#How_to_allocate_primary_IPs_for_a_server Physical hostshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Physical_hosts Virtual machineshttps://wikitech.wikimedia.org/wiki/DNS/Netbox#Virtual_machines How to manually allocate a special purpose IP address in Netboxhttps://wikitech.wikimedia.org/wiki/DNS/Netbox#How_to_manually_allocate_a_special_purpose_IP_address_in_Netbox https://wikitech.wikimedia.org/wiki/Apt1001 apt1001 was an APT apt.wikimedia. https://wikitech.wikimedia.org/wiki/Apt2001 apt2001 was an APT apt.wikimedia. https://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy = OSM Database = OSM Databasehttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#OSM_Database Initial Importing of OSM data into PostgreSQL databasehttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Initial_Importing_of_OSM_data_into_PostgreSQL_database When you need to do initial import?https://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#When_you_need_to_do_initial_import? Importinghttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Importing Checklisthttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Checklist Depooling the maps masterhttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Depooling_the_maps_master Re-creating an empty Postgres DBhttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Re-creating_an_empty_Postgres_DB Re-creating Postgres DB from backuphttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Re-creating_Postgres_DB_from_backup The initial-import-scripthttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#The_initial-import-script Troubleshoutinghttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Troubleshouting OSM replicationhttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#OSM_replication Monitoringhttps://wikitech.wikimedia.org/wiki/Maps/OSM_Database_Legacy#Monitoring https://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Detection Underlying problemshttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Underlying_problems Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-04-07_Wikidata%27s_wb_items_per_site_table_dropped#Actionables https://wikitech.wikimedia.org/wiki/MariaDB/Backups/Example_recovery == Data recovery plan == Data recovery planhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups/Example_recovery#Data_recovery_plan https://wikitech.wikimedia.org/wiki/Kubernetes/Images == Image restriction strategy == Image restriction strategyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Image_restriction_strategy Operating Systemhttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Operating_System Image buildinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Image_building Base imageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Base_images Production imageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Production_images Rebuilding MediaWiki production imageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Rebuilding_MediaWiki_production_images Services imageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Services_images Local buildshttps://wikitech.wikimedia.org/wiki/Kubernetes/Images#Local_builds https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Summary Goalshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Goals Alternatives?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Alternatives? User Storieshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#User_Stories What is this?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#What_is_this? Concernshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Concerns Existing Toolforge Setuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Existing_Toolforge_Setup Implementationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Implementation buildpacks architecturehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#buildpacks_architecture Definition of Successhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Definition_of_Success Ideashttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Ideas The road so farhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#The_road_so_far The next things to look athttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#The_next_things_to_look_at Open Questionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Open_Question Noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy#Notes https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection = Why do we need bot detection? = Why do we need bot detection?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Why_do_we_need_bot_detection? Current state of the automated traffic detection in our pipelinehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Current_state_of_the_automated_traffic_detection_in_our_pipeline The dataset Raw Webrequest (Hive table wmf_raw.webrequest)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#The_dataset_Raw_Webrequest_(Hive_table_wmf_raw.webrequest) The refine job on webrequest is creating the Webrequest dataset (Hive table wmf.webrequest)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#The_refine_job_on_webrequest_is_creating_the_Webrequest_dataset_(Hive_table_wmf.webrequest) Then a job computes user activity stats (Hive table features.actor_hourly)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Then_a_job_computes_user_activity_stats_(Hive_table_features.actor_hourly) Aggregate stats for the last 24 hours (Hive table features.actor_rollup_hourly)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Aggregate_stats_for_the_last_24_hours_(Hive_table_features.actor_rollup_hourly) Classify the pageviews_actor (Hive table predictions.actor_label_hourly)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Classify_the_pageviews_actor_(Hive_table_predictions.actor_label_hourly) Add the automated classification to webrequest (Hive table wmf.pageview_actor)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Add_the_automated_classification_to_webrequest_(Hive_table_wmf.pageview_actor) Create other datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Create_other_datasets Effect of automated-traffic detection on Pageview metric - March 2020https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Effect_of_automated-traffic_detection_on_Pageview_metric_-_March_2020 Effect on most-viewed pages list (top)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Effect_on_most-viewed_pages_list_(top) Global Impact - All wikimedia projectshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Global_Impact_-_All_wikimedia_projects Totalshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Totals By access-methodhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#By_access-method Impact per projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Impact_per_project Top 10 projects by number of viewshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Top_10_projects_by_number_of_views en.wikipedia (1)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#en.wikipedia_(1) es.wikipedia (2)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#es.wikipedia_(2) ja.wikipedia (3)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#ja.wikipedia_(3) de.wikipedia (4)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#de.wikipedia_(4) commons.wikimedia (5)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#commons.wikimedia_(5) ru.wikipedia (6)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#ru.wikipedia_(6) fr.wikipedia (7)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#fr.wikipedia_(7) it.wikipedia (8)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#it.wikipedia_(8) zh.wikipedia (9)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#zh.wikipedia_(9) pt.wikipedia (10)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#pt.wikipedia_(10) 5 random Smaller projectshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#5_random_Smaller_projects gl.wikipedia (80)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#gl.wikipedia_(80) en.wikivoyage (81)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#en.wikivoyage_(81) wikisource (158)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#wikisource_(158) de.wikiquote (259)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#de.wikiquote_(259) el.wikiquote (473)https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#el.wikiquote_(473) Codehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/BotDetection#Code https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/04 ===Week of April 06=== Week of April 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/04#Week_of_April_06 Week of April 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/04#Week_of_April_13 Week of April 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/04#Week_of_April_20 Week of April 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/04#Week_of_April_27 https://wikitech.wikimedia.org/wiki/Wmf-laptop wmf-laptop is a Debian package which simplifies SSH access to Wikimedia production servers: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Monitoring Monitoring Discussion. This meeting was held on 2020-04-11. Scopehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Monitoring#Scope https://wikitech.wikimedia.org/wiki/Cescout cescout is a censorship monitoring toolkit that is currently deployed on cescout1001.eqiad. Introductionhttps://wikitech.wikimedia.org/wiki/Cescout#Introduction Source Codehttps://wikitech.wikimedia.org/wiki/Cescout#Source_Code Setting up cescout1001https://wikitech.wikimedia.org/wiki/Cescout#Setting_up_cescout1001 Usagehttps://wikitech.wikimedia.org/wiki/Cescout#Usage Example Runhttps://wikitech.wikimedia.org/wiki/Cescout#Example_Run Current Projectshttps://wikitech.wikimedia.org/wiki/Cescout#Current_Projects Configuration Filehttps://wikitech.wikimedia.org/wiki/Cescout#Configuration_File OONIhttps://wikitech.wikimedia.org/wiki/Cescout#OONI IODAhttps://wikitech.wikimedia.org/wiki/Cescout#IODA RIPEhttps://wikitech.wikimedia.org/wiki/Cescout#RIPE https://wikitech.wikimedia.org/wiki/Infographics == Data center overview == Data center overviewhttps://wikitech.wikimedia.org/wiki/Infographics#Data_center_overview MediaWiki architecturehttps://wikitech.wikimedia.org/wiki/Infographics#MediaWiki_architecture Databaseshttps://wikitech.wikimedia.org/wiki/Infographics#Databases Traffichttps://wikitech.wikimedia.org/wiki/Infographics#Traffic Networkinghttps://wikitech.wikimedia.org/wiki/Infographics#Networking Individual software, services, and clustershttps://wikitech.wikimedia.org/wiki/Infographics#Individual_software,_services,_and_clusters See alsohttps://wikitech.wikimedia.org/wiki/Infographics#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging This page contains information on Debian packages (.deb) related to Toolforge. Debian Packageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Debian_Packages Bumping the versionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Bumping_the_version Using bump_versionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Using_bump_version Manuallyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Manually Building the packagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Building_the_package Deploy using the cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Deploy_using_the_cookbook Creating a release in GitLabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Creating_a_release_in_GitLab Deploy manuallyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Deploy_manually Uploading a packagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Uploading_a_package Installing a packagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Installing_a_package Obsolete methodshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Obsolete_methods wmcs-package-buildhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#wmcs-package-build sbuildhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#sbuild Yuvi's method (debuild)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Yuvi's_method_(debuild) Bd808's method (pdebuild)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#Bd808's_method_(pdebuild) See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Packaging#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations == Data limitations == Data limitationshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Data_limitations Issues with file pathshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Issues_with_file_paths File: URLs vs upload.wikimedia.org URIshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#File:_URLs_vs_upload.wikimedia.org_URIs Varying URL encodingshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Varying_URL_encodings Browser pathhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Browser_path Path of file as queried to upload.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Path_of_file_as_queried_to_upload.wikimedia.org Path of file stored in the mediarequest datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Path_of_file_stored_in_the_mediarequest_dataset Path of file as queried for statisticshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Mediarequests/Limitations#Path_of_file_as_queried_for_statistics https://wikitech.wikimedia.org/wiki/Storm_control =What is Storm control?= What is Storm control?https://wikitech.wikimedia.org/wiki/Storm_control#What_is_Storm_control? How to setup Storm control?https://wikitech.wikimedia.org/wiki/Storm_control#How_to_setup_Storm_control? Create the storm control profilehttps://wikitech.wikimedia.org/wiki/Storm_control#Create_the_storm_control_profile Create the interface rangehttps://wikitech.wikimedia.org/wiki/Storm_control#Create_the_interface_range Add members to the interface-rangehttps://wikitech.wikimedia.org/wiki/Storm_control#Add_members_to_the_interface-range Add action-shutdownhttps://wikitech.wikimedia.org/wiki/Storm_control#Add_action-shutdown View traffic statisticshttps://wikitech.wikimedia.org/wiki/Storm_control#View_traffic_statistics Restore the interfaces after a shutdownhttps://wikitech.wikimedia.org/wiki/Storm_control#Restore_the_interfaces_after_a_shutdown https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email This page contains information on the email setup and how to manage it inside Cloud VPS. Servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Servers SPFhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#SPF Toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Toolforge Operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Operations Total count for queuehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Total_count_for_queue Count for the queue per userhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Count_for_the_queue_per_user Statshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Stats Blackhole an in-bound addresshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#Blackhole_an_in-bound_address See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Email#See_also https://wikitech.wikimedia.org/wiki/Miscweb1002 miscweb1002 is a virtual machine on Ganeti which is hosting several misc. web sites, including: See alsohttps://wikitech.wikimedia.org/wiki/Miscweb1002#See_also https://wikitech.wikimedia.org/wiki/Miscweb2002 miscweb1002 is a virtual machine on Ganeti which is hosting several misc. web sites, including: See alsohttps://wikitech.wikimedia.org/wiki/Miscweb2002#See_also https://wikitech.wikimedia.org/wiki/Puppet/Pontoon Reach out to godog / Filippo Giunchedi on for more information and assistance Introhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Intro Installation and quickstarthttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Installation_and_quickstart Howtohttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Howto Make roles work in Pontoonhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Make_roles_work_in_Pontoon Load balancing and service discoveryhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Load_balancing_and_service_discovery "Reimage" an hosthttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#"Reimage"_an_host Get patches ready for reviewhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Get_patches_ready_for_review Hierahttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Hiera Caveats and limitationshttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Caveats_and_limitations Lookup orderhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Lookup_order Team collaboration and git brancheshttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon#Team_collaboration_and_git_branches https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial = Migrating a service to Kubernetes = Migrating a service to Kuberneteshttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Migrating_a_service_to_Kubernetes Set Uphttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Set_Up Creating a Docker Imagehttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Creating_a_Docker_Image blubber.yaml:https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#blubber.yaml: Publishing Docker Imageshttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Publishing_Docker_Images config.yamlhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#config.yaml project-pipelines.yamlhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#project-pipelines.yaml layout.yamlhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#layout.yaml Creating a Helm Charthttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Creating_a_Helm_Chart charts/helloworldoid/values.yamlhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#charts/helloworldoid/values.yaml Testing the Helm Charthttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Testing_the_Helm_Chart helm/requirements.yamlhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#helm/requirements.yaml values.example.yamlhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#values.example.yaml Getting Deployed to Productionhttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Getting_Deployed_to_Production Running Benchmarkshttps://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial#Running_Benchmarks https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40 == 2020-04-30 == 2020-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-30 2020-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-29 2020-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-28 2020-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-27 2020-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-26 2020-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-25 2020-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-24 2020-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-23 2020-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-22 2020-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-21 2020-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-20 2020-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-19 2020-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-18 2020-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-17 2020-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-16 2020-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-15 2020-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-14 2020-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-13 2020-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-12 2020-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-11 2020-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-10 2020-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-09 2020-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-08 2020-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-07 2020-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-06 2020-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-03 2020-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-02 2020-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-04-01 2020-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-31 2020-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-30 2020-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-29 2020-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-28 2020-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-27 2020-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-26 2020-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-25 2020-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-24 2020-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-23 2020-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-22 2020-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-20 2020-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-19 2020-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-18 2020-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-17 2020-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-16 2020-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-15 2020-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-14 2020-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-13 2020-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-12 2020-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-11 2020-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-10 2020-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-09 2020-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-08 2020-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-07 2020-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-06 2020-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-05 2020-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-04 2020-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-03 2020-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-02 2020-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-03-01 2020-02-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-29 2020-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-28 2020-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-27 2020-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-26 2020-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-25 2020-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-24 2020-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-23 2020-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-22 2020-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-21 2020-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-20 2020-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-19 2020-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-18 2020-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-17 2020-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-15 2020-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-14 2020-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-13 2020-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-12 2020-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-11 2020-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-10 2020-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-09 2020-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-08 2020-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-07 2020-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-06 2020-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-05 2020-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-04 2020-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-03 2020-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-02 2020-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-02-01 2020-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-31 2020-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-30 2020-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-29 2020-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-28 2020-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-27 2020-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-26 2020-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-25 2020-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-24 2020-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-23 2020-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-22 2020-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-21 2020-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-20 2020-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-19 2020-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-18 2020-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-17 2020-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-16 2020-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-15 2020-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-14 2020-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-13 2020-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-12 2020-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-11 2020-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-10 2020-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-09 2020-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-08 2020-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-07 2020-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-06 2020-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-05 2020-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-04 2020-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-03 2020-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-02 2020-01-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_40#2020-01-01 https://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-01_vc-link-failure#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-05_wdqs-deploy#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Calendar The deployment calendar page is generated weekly by a script that lives in the [repo called [[gitlab:repos/releng/release/-/tree/master/make-deployment-calendar|makedeploymentcaledar.py]. Example Usagehttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Example_Usage Week with a train with an EU primary conductor and an American secondary conductorhttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Week_with_a_train_with_an_EU_primary_conductor_and_an_American_secondary_conductor Week with a train with an American primary conductor and an EU secondary conductorhttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Week_with_a_train_with_an_American_primary_conductor_and_an_EU_secondary_conductor Week with a train with an American primary conductor and an American secondary conductorhttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Week_with_a_train_with_an_American_primary_conductor_and_an_American_secondary_conductor Week without a trainhttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Week_without_a_train Week American primary train conductor and American secondary conductorhttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Week_American_primary_train_conductor_and_American_secondary_conductor Generate a week that is not the next weekhttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Generate_a_week_that_is_not_the_next_week Scheduleshttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Schedules Full Usagehttps://wikitech.wikimedia.org/wiki/Deployments/Calendar#Full_Usage https://wikitech.wikimedia.org/wiki/Deployments/Calendar# https://wikitech.wikimedia.org/wiki/Wikimedia_DNS Wikimedia DNS (formerly called Wikidough), is a caching, recursive [over HTTPS|DNS-over-HTTPS] (DoH) and [over TLS|DNS-over-TLS] (DoT) resolver service. A Note About Encrypted DNShttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#A_Note_About_Encrypted_DNS Designhttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Design Featureshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Features Encrypted DNShttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Encrypted_DNS Modern TLS Protocolshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Modern_TLS_Protocols No EDNS Client Subnet*https://wikitech.wikimedia.org/wiki/Wikimedia_DNS#No_EDNS_Client_Subnet* Query Name Minimisationhttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Query_Name_Minimisation DNSSEChttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#DNSSEC IPv6 Supporthttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#IPv6_Support EDNS(0) Paddinghttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#EDNS(0)_Padding Deploymenthttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Deployment Source Codehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Source_Code Testinghttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Testing Check Servicehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Check_Service Technical Noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#Technical_Notes External Linkshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS#External_Links https://wikitech.wikimedia.org/wiki/Security/Peek Peek is a program in use by the Security Team meant to be run on cron that sends status information for project management purposes. https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/05 ===Week of May 04=== Week of May 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/05#Week_of_May_04 Week of May 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/05#Week_of_May_11 Week of May 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/05#Week_of_May_18 Week of May 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/05#Week_of_May_25 https://wikitech.wikimedia.org/wiki/Ban == Network layer == Network layerhttps://wikitech.wikimedia.org/wiki/Ban#Network_layer Prefixeshttps://wikitech.wikimedia.org/wiki/Ban#Prefixes https://wikitech.wikimedia.org/wiki/Static-codereview.wikimedia.org static-codereview.wikimedia. https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater The WDQS Streaming Updater is an Apache Flink application whose purpose is to create a stream of diffs of RDF triples, meant to be fed into Blazegraph. It uses the available mediawiki change streams to calculate the diffs and push it to a Kafka topic. Designhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Design Dependencieshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Dependencies Deployment strategyhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Deployment_strategy Operationshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Operations Kubernetes setup (flink-app chart)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Kubernetes_setup_(flink-app_chart) Logshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Logs Managing the streaming-updater-producerhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Managing_the_streaming-updater-producer Destroy all pods and prevent from being recreatedhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Destroy_all_pods_and_prevent_from_being_recreated Destroy all configmapshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Destroy_all_configmaps Clean up object storagehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Clean_up_object_storage How to tell if the object storage data can be safely deletedhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#How_to_tell_if_the_object_storage_data_can_be_safely_deleted Rotating S3/Swift Password*https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Rotating_S3/Swift_Password* Kubernetes setup (Flink Application Mode/Flink Operator)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Kubernetes_setup_(Flink_Application_Mode/Flink_Operator) Deploying the WDQS chart to production (using active deploy host):https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Deploying_the_WDQS_chart_to_production_(using_active_deploy_host): Looking at job manager logs for the WDQS release:https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Looking_at_job_manager_logs_for_the_WDQS_release: Checking status of Custom Resource "Flinkdeployment"https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Checking_status_of_Custom_Resource_"Flinkdeployment" Restore from a Checkpoint or Savepointhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Restore_from_a_Checkpoint_or_Savepoint Trigger a Savepointhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Trigger_a_Savepoint Savepoint logshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Savepoint_logs Redeploying Flink-Operatorhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Redeploying_Flink-Operator Monitoringhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Monitoring Runbookshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Runbooks The job is not startinghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#The_job_is_not_starting The job is not runninghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#The_job_is_not_running The job processing latency is highhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#The_job_processing_latency_is_high The consumers are backloggedhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#The_consumers_are_backlogged Potential root cause: single host alertinghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Potential_root_cause:_single_host_alerting Potential root cause: multiple hosts alertinghttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Potential_root_cause:_multiple_hosts_alerting First run (bootstrap) OR recovering from savepointhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#First_run_(bootstrap)_OR_recovering_from_savepoint Running from YARNhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Running_from_YARN https://wikitech.wikimedia.org/wiki/Scb scb means service cluster B. It used to be a group of hosts that run Wikimedia services, but has now been replaced by Kubernetes. https://wikitech.wikimedia.org/wiki/Incident_response/Runbook This is a brief, at-a-glance description of what steps to take when responding to an on-going incident. If you’ve been pagedhttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#If_you’ve_been_paged If there was no page, but...https://wikitech.wikimedia.org/wiki/Incident_response/Runbook#If_there_was_no_page,_but... To become the Incident Coordinator (IC)https://wikitech.wikimedia.org/wiki/Incident_response/Runbook#To_become_the_Incident_Coordinator_(IC) When you are the IChttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#When_you_are_the_IC When you are not the IChttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#When_you_are_not_the_IC To hand over the IC role to another personhttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#To_hand_over_the_IC_role_to_another_person To resolve the incident and stop being IChttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#To_resolve_the_incident_and_stop_being_IC Writing an incident reporthttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#Writing_an_incident_report Deciding whether to contact others & how to contact othershttps://wikitech.wikimedia.org/wiki/Incident_response/Runbook#Deciding_whether_to_contact_others_&_how_to_contact_others https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To Wikimedia's Event Platform supports both production "Tier 1" events, as well as analytics "Tier 2" events. To support both, the backend systems that handle these events are more reliable and scalable, but also more complex than legacy EventLogging. Creating a new schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Creating_a_new_schema Setting up for local testinghttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Setting_up_for_local_testing In [Docker]https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In_[Docker] In [Vagrant]https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In_[Vagrant] In your local dev environment with eventgate-devserverhttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In_your_local_dev_environment_with_eventgate-devserver Writing MediaWiki instrumentation codehttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Writing_MediaWiki_instrumentation_code JavaScripthttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#JavaScript PHPhttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#PHP Deploymenthttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Deployment Configuring the streamhttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Configuring_the_stream Registering the stream with EventLogginghttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Registering_the_stream_with_EventLogging Configuring data retentionhttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Configuring_data_retention Viewing and querying eventshttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Viewing_and_querying_events Betahttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Beta Productionhttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Production Data Lakehttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Data_Lake Kafkahttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Kafka EventStreamshttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#EventStreams Viewing schema validation errorshttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Viewing_schema_validation_errors Evolving your schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Evolving_your_schema Backwards incompatible schema changeshttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Backwards_incompatible_schema_changes Overriding event stream config settingshttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Overriding_event_stream_config_settings In production for specific wikis / groupshttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In_production_for_specific_wikis_/_groups In betahttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In_beta Decommissioninghttps://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#Decommissioning https://wikitech.wikimedia.org/wiki/People1002 people1002 is a virtual machine running on Ganeti on Debian buster. It hosts the service People. Connectinghttps://wikitech.wikimedia.org/wiki/People1002#Connecting https://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS Work in progress. Limitation of a non-anycast setuphttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Limitation_of_a_non-anycast_setup Configurationhttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Configuration Server sidehttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Server_side Routers sidehttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Routers_side Troubleshootinghttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Troubleshooting Know which server a client is routed tohttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Know_which_server_a_client_is_routed_to Failure testshttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Failure_tests Total local AuthDNS failurehttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Total_local_AuthDNS_failure Limitationshttps://wikitech.wikimedia.org/wiki/Anycast_authoritative_DNS#Limitations https://wikitech.wikimedia.org/wiki/LocustProofOfConcept Locust is a distributed load/stress testing system. The system itself and the test specification are programmed in Python and can then be run on N hosts (nodes) that all query a central server for work assignments. Installation using Vagrant and Puppethttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#Installation_using_Vagrant_and_Puppet locustserverhttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#locustserver locustclienthttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#locustclient locusthttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#locust Test on AWShttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#Test_on_AWS Preparationhttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#Preparation AWS Setuphttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#AWS_Setup vagrant up puppetmasterhttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#vagrant_up_puppetmaster vagrant up locustmasterhttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#vagrant_up_locustmaster vagrant uphttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#vagrant_up Performance Datahttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#Performance_Data Alternative node creation: Use AWS API/CLI directlyhttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#Alternative_node_creation:_Use_AWS_API/CLI_directly AMI images usedhttps://wikitech.wikimedia.org/wiki/LocustProofOfConcept#AMI_images_used https://wikitech.wikimedia.org/wiki/Library https://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup This doc is based off https://phabricator.wikimedia. Introductionhttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#Introduction Existing examples of acme-chief in Cloud VPShttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#Existing_examples_of_acme-chief_in_Cloud_VPS Setting it up for your own Cloud VPS projecthttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#Setting_it_up_for_your_own_Cloud_VPS_project You will needhttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#You_will_need Full stepshttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#Full_steps Summaryhttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#Summary Troubleshootinghttps://wikitech.wikimedia.org/wiki/Acme-chief/Cloud_VPS_setup#Troubleshooting https://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-28_commons_read-only#Actionables https://wikitech.wikimedia.org/wiki/Service_Catalog https://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Timeline Links to dashboardshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Links_to_dashboards Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-11_thumbor#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/FAQ == How are rows ordered? == How are rows ordered?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/FAQ#How_are_rows_ordered? How do I get the number of unique editors of a given page?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/FAQ#How_do_I_get_the_number_of_unique_editors_of_a_given_page? Doing certain kinds of analysis on this data is very expensive, any plans to make it queryable?https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history_dumps/FAQ#Doing_certain_kinds_of_analysis_on_this_data_is_very_expensive,_any_plans_to_make_it_queryable? https://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-04_cloud-private-repo#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-05-22_thumbnails#Actionables https://wikitech.wikimedia.org/wiki/Juniper_router_upgrade == Known issues == Known issueshttps://wikitech.wikimedia.org/wiki/Juniper_router_upgrade#Known_issues Still validhttps://wikitech.wikimedia.org/wiki/Juniper_router_upgrade#Still_valid Obsoletehttps://wikitech.wikimedia.org/wiki/Juniper_router_upgrade#Obsolete Preparationhttps://wikitech.wikimedia.org/wiki/Juniper_router_upgrade#Preparation Upgradehttps://wikitech.wikimedia.org/wiki/Juniper_router_upgrade#Upgrade Cleanuphttps://wikitech.wikimedia.org/wiki/Juniper_router_upgrade#Cleanup https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/06 ===Week of June 01=== Week of June 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/06#Week_of_June_01 Week of June 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/06#Week_of_June_08 Week of June 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/06#Week_of_June_15 Week of June 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/06#Week_of_June_22 Week of June 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/06#Week_of_June_29 https://wikitech.wikimedia.org/wiki/Thanos == What is it? == What is it?https://wikitech.wikimedia.org/wiki/Thanos#What_is_it? Use caseshttps://wikitech.wikimedia.org/wiki/Thanos#Use_cases Global viewhttps://wikitech.wikimedia.org/wiki/Thanos#Global_view Long-term storage and downsamplinghttps://wikitech.wikimedia.org/wiki/Thanos#Long-term_storage_and_downsampling Deploymenthttps://wikitech.wikimedia.org/wiki/Thanos#Deployment Web interfaceshttps://wikitech.wikimedia.org/wiki/Thanos#Web_interfaces Ports in usehttps://wikitech.wikimedia.org/wiki/Thanos#Ports_in_use Porting dashboards to Thanoshttps://wikitech.wikimedia.org/wiki/Thanos#Porting_dashboards_to_Thanos Operationshttps://wikitech.wikimedia.org/wiki/Thanos#Operations Pool / depool a sitehttps://wikitech.wikimedia.org/wiki/Thanos#Pool_/_depool_a_site Delete blocks / free up spacehttps://wikitech.wikimedia.org/wiki/Thanos#Delete_blocks_/_free_up_space Upgrade to a new versionhttps://wikitech.wikimedia.org/wiki/Thanos#Upgrade_to_a_new_version Add new thanos-fe hosts (Object Storage frontends)https://wikitech.wikimedia.org/wiki/Thanos#Add_new_thanos-fe_hosts_(Object_Storage_frontends) Add new titan hosts (Thanos components)https://wikitech.wikimedia.org/wiki/Thanos#Add_new_titan_hosts_(Thanos_components) Alertshttps://wikitech.wikimedia.org/wiki/Thanos#Alerts Service thanos-query:443 has failed probeshttps://wikitech.wikimedia.org/wiki/Thanos#Service_thanos-query:443_has_failed_probes More than one Thanos compact runninghttps://wikitech.wikimedia.org/wiki/Thanos#More_than_one_Thanos_compact_running Thanos compact has not run / is haltedhttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_compact_has_not_run_/_is_halted Thanos has disappeared from Prometheus discoveryhttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_has_disappeared_from_Prometheus_discovery Thanos has high percentage of failureshttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_has_high_percentage_of_failures Thanos has high latencyhttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_has_high_latency Thanos sidecar cannot connect to Prometheushttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_sidecar_cannot_connect_to_Prometheus Thanos sidecar is unhealthyhttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_sidecar_is_unhealthy Thanos query has high gRPC client errorshttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_query_has_high_gRPC_client_errors Thanos sidecar is failing to upload blockshttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_sidecar_is_failing_to_upload_blocks Thanos sidecar no connection to started Prometheushttps://wikitech.wikimedia.org/wiki/Thanos#Thanos_sidecar_no_connection_to_started_Prometheus Steps to Remediatehttps://wikitech.wikimedia.org/wiki/Thanos#Steps_to_Remediate Noteshttps://wikitech.wikimedia.org/wiki/Thanos#Notes Metrics Retentionhttps://wikitech.wikimedia.org/wiki/Thanos#Metrics_Retention https://wikitech.wikimedia.org/wiki/Analytics [is the systematic computational analysis of data or statistics, for the purposes of discovery, interpretation, and communication of meaningful patterns. Analytics Clusterhttps://wikitech.wikimedia.org/wiki/Analytics#Analytics_Cluster Data Lakehttps://wikitech.wikimedia.org/wiki/Analytics#Data_Lake See alsohttps://wikitech.wikimedia.org/wiki/Analytics#See_also https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#Timeline May 28https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#May_28 June 11https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#June_11 Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-11_sessionstore%2Bkubernetes#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Keepalived This page contains information on how to introduce L3 network high availability for arbitrary services running on virtual machines in Cloud VPS by using keepalived. Puppet manifesthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Keepalived#Puppet_manifest Neutron configurationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Keepalived#Neutron_configuration DNShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Keepalived#DNS See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Keepalived#See_also https://wikitech.wikimedia.org/wiki/Deployments/Risky_change_template You have a patch that you feel might cause problems on deployment: now what? Templatehttps://wikitech.wikimedia.org/wiki/Deployments/Risky_change_template#Template Examplehttps://wikitech.wikimedia.org/wiki/Deployments/Risky_change_template#Example https://wikitech.wikimedia.org/wiki/Monitoring/https_unauthorized check_https_unauthorized is used to ensure that a specific end point requires authentication. The icinga definition looks as follows https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study This document describes our decision process (Data Engineering team) when choosing a replacement for our workflow management system. Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Overview The problemhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#The_problem The objectivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#The_objective Hard requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Hard_requirements Candidateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Candidates Prefect [discarded]https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Prefect_[discarded] Argo [discarded]https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Argo_[discarded] Azkaban [discarded]https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Azkaban_[discarded] Luigi [discarded]https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Luigi_[discarded] Apache Airflowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Apache_Airflow Airflow 1 P.O.C.https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Airflow_1_P.O.C. Pythonhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Python Support and extensibilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Support_and_extensibility Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Architecture DAGs: interpretation in 2 stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#DAGs:_interpretation_in_2_steps Documentation and communityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Documentation_and_community UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#UI Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Kerberos PyArrow concurrency issueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#PyArrow_concurrency_issues Oozie vs Airflowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Oozie_vs_Airflow Conclusion after 1st P.O.C.https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Conclusion_after_1st_P.O.C. Airflow 2 P.O.C.https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Airflow_2_P.O.C. Confirmed functionalityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Confirmed_functionality Customization capabilitieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Customization_capabilities Where does the code live?https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Where_does_the_code_live? Data probes vs. DAG dependencieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Data_probes_vs._DAG_dependencies Local executorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Local_executor Configuration layershttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Configuration_layers Delayed updateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Delayed_updates Caveatshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Caveats Conslusions after 2nd P.O.C.https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Workflow_management_tools_study#Conslusions_after_2nd_P.O.C. https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera The databases for OpenStack services are stored on a Galera cluster hosted on the cloudcontrol nodes. Deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#Deployment DB setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#DB_setup General Operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#General_Operations Restarting the local mariadb processhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#Restarting_the_local_mariadb_process Depool a single nodehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#Depool_a_single_node Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#Troubleshooting See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_actor The wmf.pageview_actor table (available on Hive) contains filtered webrequest data to keep only pageviews and redirects to pageviews. Current Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_actor#Current_Schema Sample querieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_actor#Sample_queries Changes and known problems since 2020-06-25https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_actor#Changes_and_known_problems_since_2020-06-25 See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_actor#See_also Noteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageview_actor#Notes https://wikitech.wikimedia.org/wiki/Purged purged (pronounced "purge-dee") is a daemon running on all cache hosts that reads Kafka purge messages, parses them, and turns them into HTTP purge requests to be sent to the local ATS and Varnish daemons (via TCP or Unix sockets). Building the packagehttps://wikitech.wikimedia.org/wiki/Purged#Building_the_package Alertshttps://wikitech.wikimedia.org/wiki/Purged#Alerts Gather information for bug reportshttps://wikitech.wikimedia.org/wiki/Purged#Gather_information_for_bug_reports Operationshttps://wikitech.wikimedia.org/wiki/Purged#Operations Restart purged servicehttps://wikitech.wikimedia.org/wiki/Purged#Restart_purged_service See alsohttps://wikitech.wikimedia.org/wiki/Purged#See_also https://wikitech.wikimedia.org/wiki/ChartMuseum ChartMuseum is an open-source Helm Chart Repository written in Go, with support for cloud storage backends like Swift. Interacting with ChartMuseumhttps://wikitech.wikimedia.org/wiki/ChartMuseum#Interacting_with_ChartMuseum Storagehttps://wikitech.wikimedia.org/wiki/ChartMuseum#Storage Operationshttps://wikitech.wikimedia.org/wiki/ChartMuseum#Operations Pool/Depoolhttps://wikitech.wikimedia.org/wiki/ChartMuseum#Pool/Depool Delete Chartshttps://wikitech.wikimedia.org/wiki/ChartMuseum#Delete_Charts Packaginghttps://wikitech.wikimedia.org/wiki/ChartMuseum#Packaging Importing a new versionhttps://wikitech.wikimedia.org/wiki/ChartMuseum#Importing_a_new_version Building a new versionhttps://wikitech.wikimedia.org/wiki/ChartMuseum#Building_a_new_version Patcheshttps://wikitech.wikimedia.org/wiki/ChartMuseum#Patches Resourceshttps://wikitech.wikimedia.org/wiki/ChartMuseum#Resources https://wikitech.wikimedia.org/wiki/PAWS/Admin == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Introduction Kubernetes clusterhttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Kubernetes_cluster Deploymenthttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Deployment Blue Green Deploymenthttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Blue_Green_Deployment PAWS updateshttps://wikitech.wikimedia.org/wiki/PAWS/Admin#PAWS_updates Troubleshootinghttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Troubleshooting Upgrading k8shttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Upgrading_k8s Upgrading z2jhhttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Upgrading_z2jh Architecturehttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Architecture Helmhttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Helm Modify worker counthttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Modify_worker_count General noteshttps://wikitech.wikimedia.org/wiki/PAWS/Admin#General_notes Jupyterhub deploymenthttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Jupyterhub_deployment Jupyterhub & PAWS Componentshttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Jupyterhub_&_PAWS_Components Common administrative actionshttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Common_administrative_actions Deleting user data in case of spam or credential leakshttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Deleting_user_data_in_case_of_spam_or_credential_leaks Stop a running workload in PAWShttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Stop_a_running_workload_in_PAWS Prevent an user from using PAWShttps://wikitech.wikimedia.org/wiki/PAWS/Admin#Prevent_an_user_from_using_PAWS https://wikitech.wikimedia.org/wiki/Incidents/2020-07-03_Lilypond_down == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-03_Lilypond_down#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-03_Lilypond_down#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction Since June 2020beginning of the month for monthly data, 24th for daily data the unique-devices metric computation has been updated to take advantage from the automated label that was recently added to pageview data (see Analytics/Data_Lake/Traffic/BotDetection). Better detection of bot spam or bot vandalism leads to metrics of better quality as those "bad" or "spammy" pageviews are removed from our data. Impact summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Impact_summary Big Picturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Big_Picture Per domainhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Per_domain Monthlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Monthly Dailyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Daily Per project familyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Per_project_family Detailed analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Detailed_analysis Technical detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Technical_details Automated traffic removalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Automated_traffic_removal Actor signature changehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Unique_Devices/Automated_traffic_correction#Actor_signature_change https://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-05_eqsin-router-crash#Actionables https://wikitech.wikimedia.org/wiki/Database_tables == See also == See alsohttps://wikitech.wikimedia.org/wiki/Database_tables#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/07 ===Week of July 06=== Week of July 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/07#Week_of_July_06 Week of July 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/07#Week_of_July_13 Week of July 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/07#Week_of_July_20 Week of July 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/07#Week_of_July_27 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh This page describes a joint project between WMCS and SRE to reduce technical debt as well as improve reliability and security of both the CloudVPS and production realms. Summaryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Summary Goalshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Goals Backgroundhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Background Starting point: current edge network setuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Starting_point:_current_edge_network_setup Technical debthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Technical_debt Further separate CloudVPS/prod networkshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Further_separate_CloudVPS/prod_networks Prepare for the futurehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Prepare_for_the_future Other considerationshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Other_considerations Out of Scopehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Out_of_Scope Objectiveshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Objectives A. Remove physical and logical dependency on eqiad row B (asw2-b-eqiad)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#A._Remove_physical_and_logical_dependency_on_eqiad_row_B_(asw2-b-eqiad) B. Standardize production<->WMCS physical and logical interconnecthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#B._Standardize_productionWMCS_physical_and_logical_interconnect C. High availability of the WMCS network layerhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#C._High_availability_of_the_WMCS_network_layer D. Provide groundwork for WMCS growth and infrastructure independencehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#D._Provide_groundwork_for_WMCS_growth_and_infrastructure_independence E. Reduce neutron technical debthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#E._Reduce_neutron_technical_debt Future Workhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Future_Work Implementation: Proposed solutionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Implementation:_Proposed_solutions Option 1: use only cloudgwhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Option_1:_use_only_cloudgw option 1 pros & conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#option_1_pros_&_cons Option 2: use only cloudswhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Option_2:_use_only_cloudsw option 2 pros & conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#option_2_pros_&_cons Option 3: use both cloudgw and cloudswhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Option_3:_use_both_cloudgw_and_cloudsw option 3 pros & conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#option_3_pros_&_cons option 3 timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#option_3_timeline option 3 understanding the NAThttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#option_3_understanding_the_NAT option 3 implementation detailshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#option_3_implementation_details Meeting Noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Meeting_Notes Additional noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#Additional_notes See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh#See_also https://wikitech.wikimedia.org/wiki/Kafka_HTTP_purging The current (2020) mechanism for purging objects from the CDN is based on a daemon running on all cache nodes called Purged. Purged can be configured to read purge messages using either the legacy Multicast HTCP purging mechanism, or via Kafka. Typical purge flowhttps://wikitech.wikimedia.org/wiki/Kafka_HTTP_purging#Typical_purge_flow MediaWikihttps://wikitech.wikimedia.org/wiki/Kafka_HTTP_purging#MediaWiki One-off purgehttps://wikitech.wikimedia.org/wiki/Kafka_HTTP_purging#One-off_purge https://wikitech.wikimedia.org/wiki/ONFIRE/Incident_doc_review_workflow Process for grooming our [board]: General Guidelineshttps://wikitech.wikimedia.org/wiki/ONFIRE/Incident_doc_review_workflow#General_Guidelines https://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Links_to_relevant_documentation Open Questionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Open_Questions Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-14_termbox_and_wikifeeds_timeouts#Actionables https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools A number of tools should be considered infrastructure for Toolforge and Cloud VPS. These tools are open to participation by technical volunteers, but ultimately the Toolforge admin team and the Foundation staff on that team are responsible for making sure that they work (or are properly removed from use). Why do we do this?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#Why_do_we_do_this? Toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#Tools adminhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#admin admin-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#admin-beta automated-toolforge-testshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#automated-toolforge-tests cloudvpshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#cloudvps csp-reporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#csp-report docker-registryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#docker-registry fourohfourhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#fourohfour helphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#help iwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#iw jobshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#jobs k8s-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#k8s-status keystone-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#keystone-browser openstack-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#openstack-browser openstack-browser-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#openstack-browser-dev os-deprecationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#os-deprecation replaghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#replag salhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#sal statichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#static tool-db-usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#tool-db-usage toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#toolforge toolscheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#toolschecker toolviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#toolviews wwwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#www xn--dk8hv9ghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#xn--dk8hv9g See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Infrastructure_tools#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica The Analytics DB replica is the host running with the role::mariadb::misc::analytics::backup At the the time of writing, this is db1208. Start/Stop replicas for maintenancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica#Start/Stop_replicas_for_maintenance Check status of replicationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica#Check_status_of_replication Replicated databaseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica#Replicated_databases Add a new database to replicatehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica#Add_a_new_database_to_replicate Set up replicationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica#Set_up_replication Bacula backupshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DB_Replica#Bacula_backups https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects A number of projects should be considered infrastructure for Toolforge and Cloud VPS. These projects are open to participation by technical volunteers, but ultimately the Cloud VPS admin team and the Foundation staff on that team are responsible for making sure that they work (or are properly removed from use). Projectshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#Projects adminhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#admin admin-monitoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#admin-monitoring bastionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#bastion clouddb-serviceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#clouddb-services cloudinfrahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#cloudinfra cloudstorehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#cloudstore cloudvirt-canaryhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#cloudvirt-canary metricsinfrahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#metricsinfra project-proxyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#project-proxy pawshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#paws quarryhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#quarry redirectshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#redirects strikerhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#striker testlabshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#testlabs toolshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#tools toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#toolsbeta trovehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#trove See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Infrastructure_projects#See_also https://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments == Schema Fragments == Schema Fragmentshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Schema_Fragments Example 1https://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Example_1 Identifiershttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Identifiers App Identifiershttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#App_Identifiers Web Identifiershttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Web_Identifiers Sequenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Sequences Datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Data Userhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#User Pagehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Page User Interfacehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#User_Interface A/B Testinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#A/B_Testing Campaign Attributionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#Campaign_Attribution Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics/Fragments#References https://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-19_Logstash#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-06-25_caching-sessions == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-25_caching-sessions#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-25_caching-sessions#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-06-25_caching-sessions#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-07-23_wdqs-outage#Actionables https://wikitech.wikimedia.org/wiki/Blubber/Deployment =Deploying blubber(oid) to Production= Deploying blubber(oid) to Productionhttps://wikitech.wikimedia.org/wiki/Blubber/Deployment#Deploying_blubber(oid)_to_Production Testing the deploymentshttps://wikitech.wikimedia.org/wiki/Blubber/Deployment#Testing_the_deployments https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd Cloud VPS instances do some interesting things with sshd config. This page will try to explain what we do, why we do it, and offer some troubleshooting tips for when things go wrong. Confighttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd#Config ssh-key-ldap-lookuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd#ssh-key-ldap-lookup PAMhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd#PAM Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd#Troubleshooting Check the ssh keyshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd#Check_the_ssh_keys Check for project membershiphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Sshd#Check_for_project_membership https://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration In order to encourage volunteer participation in and to improve WMCS support of the PAWS project, we have been rebuilding it in its own project with quite a number of design and deployment changes. For most users, the change should be totally transparent except for moving to a new domain name (which will have redirects), better service availability and upgrades to Jupyterhub. What is changing?https://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#What_should_I_do? Please try out the new clusterhttps://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#Please_try_out_the_new_cluster Why are we doing this?https://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#Why_are_we_doing_this? After the public testing and migrationhttps://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#After_the_public_testing_and_migration See alsohttps://wikitech.wikimedia.org/wiki/News/2020_PAWS_migration#See_also https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41 == 2020-07-31 == 2020-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-31 2020-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-30 2020-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-29 2020-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-28 2020-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-27 2020-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-25 2020-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-24 2020-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-23 2020-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-22 2020-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-21 2020-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-20 2020-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-19 2020-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-18 2020-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-17 2020-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-16 2020-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-15 2020-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-14 2020-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-13 2020-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-11 2020-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-10 2020-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-09 2020-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-08 2020-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-07 2020-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-06 2020-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-05 2020-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-04 2020-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-03 2020-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-02 2020-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-07-01 2020-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-30 2020-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-29 2020-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-28 2020-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-27 2020-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-26 2020-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-25 2020-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-24 2020-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-23 2020-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-22 2020-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-20 2020-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-19 2020-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-18 2020-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-17 2020-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-16 2020-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-15 2020-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-14 2020-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-13 2020-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-12 2020-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-11 2020-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-10 2020-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-09 2020-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-08 2020-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-05 2020-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-04 2020-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-03 2020-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-02 2020-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-06-01 2020-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-31 2020-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-29 2020-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-28 2020-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-27 2020-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-26 2020-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-25 2020-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-24 2020-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-23 2020-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-22 2020-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-21 2020-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-20 2020-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-19 2020-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-18 2020-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-16 2020-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-15 2020-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-14 2020-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-13 2020-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-12 2020-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-11 2020-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-10 2020-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-08 2020-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-07 2020-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-06 2020-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-05 2020-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-04 2020-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-03 2020-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-02 2020-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_41#2020-05-01 https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda We use Conda to manage packages and virtual environments on the analytics clients. Use with Jupyterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Use_with_Jupyter Use outside Jupyterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Use_outside_Jupyter Creating a new environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Creating_a_new_environment Listing environmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Listing_environments Activating an environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Activating_an_environment Installing packageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Installing_packages Pinned package managementhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Pinned_package_management The Mamba solverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#The_Mamba_solver Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Troubleshooting Installing packages is extremely slowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Installing_packages_is_extremely_slow Conda fails to solve the environment with an error about not finding an old version of Condahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Conda_fails_to_solve_the_environment_with_an_error_about_not_finding_an_old_version_of_Conda Spark 3 insert statement requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Spark_3_insert_statement_requirements Broken environmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Broken_environments R supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#R_support Tipshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Tips Querying the data lake and MariaDB in Rhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#Querying_the_data_lake_and_MariaDB_in_R brms and lme4https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#brms_and_lme4 conda-analyticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Conda#conda-analytics https://wikitech.wikimedia.org/wiki/Stat1008 stat1008 has a GPU slated for use with training machine learning models. As of September 2019 the GPU is only available for users of the gpu-testers POSIX group. See alsohttps://wikitech.wikimedia.org/wiki/Stat1008#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1008#Notes https://wikitech.wikimedia.org/wiki/Incident_response/Lightweight_report_template == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incident_response/Lightweight_report_template#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incident_response/Lightweight_report_template#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incident_response/Lightweight_report_template#Scorecard https://wikitech.wikimedia.org/wiki/Incident_response/Lightweight_report A lightweight incident report may be used to document incidents that are sufficiently straightforward, well-understood, and low-impact that the effort of writing a full-length incident report isn't justified either by the expected readership or by the investigative writing process itself. Decision criteriahttps://wikitech.wikimedia.org/wiki/Incident_response/Lightweight_report#Decision_criteria https://wikitech.wikimedia.org/wiki/Splunk_On-Call Splunk On-Call (formerly VictorOps) is the paging/notification/engagement solution used by SRE, WMCS and others (since June 2020). How tohttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#How_to Page all SREs (Batphone)https://wikitech.wikimedia.org/wiki/Splunk_On-Call#Page_all_SREs_(Batphone) Set up as a new userhttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Set_up_as_a_new_user Logging in with Google SSOhttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Logging_in_with_Google_SSO Set up personal paging policieshttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Set_up_personal_paging_policies Make sure you hear the notifications even if your phone is in do not disturb modehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Make_sure_you_hear_the_notifications_even_if_your_phone_is_in_do_not_disturb_mode Team specific detailshttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Team_specific_details VO Administrationhttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#VO_Administration Invite a new userhttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Invite_a_new_user Removing a userhttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Removing_a_user SRE Team Usagehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#SRE_Team_Usage Adding yourself to the batphonehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Adding_yourself_to_the_batphone Business Hours Pager Shifthttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Business_Hours_Pager_Shift Viewing the business hours pager schedulehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Viewing_the_business_hours_pager_schedule Starting your shifthttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Starting_your_shift Acknowledging a pagehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Acknowledging_a_page Escalating a pagehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#Escalating_a_page Scheduling an override (out of office, on vacation, etc)https://wikitech.wikimedia.org/wiki/Splunk_On-Call#Scheduling_an_override_(out_of_office,_on_vacation,_etc) Automatic unpaged alert re-routing (klaxon/victorops.py escalate_unpaged)https://wikitech.wikimedia.org/wiki/Splunk_On-Call#Automatic_unpaged_alert_re-routing_(klaxon/victorops.py_escalate_unpaged) WMCS Usagehttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#WMCS_Usage How we use ithttps://wikitech.wikimedia.org/wiki/Splunk_On-Call#How_we_use_it https://wikitech.wikimedia.org/wiki/Maps/Tile_storage === Setting up Cassandra tile storage === Setting up Cassandra tile storagehttps://wikitech.wikimedia.org/wiki/Maps/Tile_storage#Setting_up_Cassandra_tile_storage Bulk Copyinghttps://wikitech.wikimedia.org/wiki/Maps/Tile_storage#Bulk_Copying https://wikitech.wikimedia.org/wiki/Maps/Kartotherian == Kartotherian - Maps Tile service for Wikipedia == Kartotherian - Maps Tile service for Wikipediahttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Kartotherian_-_Maps_Tile_service_for_Wikipedia Serving tileshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Serving_tiles Static map imageshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Static_map_images Info datahttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Info_data Markershttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Markers Very quick starthttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Very_quick_start Configurationhttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Configuration Componentshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Components Components by Wikimedia Foundationhttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Components_by_Wikimedia_Foundation Tile sourceshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Tile_sources Data and Stylinghttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Data_and_Styling Components by MapBoxhttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Components_by_MapBox Other Relevant Componentshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Other_Relevant_Components In depth step-by-step:https://wikitech.wikimedia.org/wiki/Maps/Kartotherian#In_depth_step-by-step: Install node.js and npmhttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Install_node.js_and_npm Install other software dependencieshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Install_other_software_dependencies Clone the repo and install npm dependencieshttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Clone_the_repo_and_install_npm_dependencies Sourcehttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Source Edit Kartotherian configuration - config.yamlhttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Edit_Kartotherian_configuration_-_config.yaml Configure Kartotherianhttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Configure_Kartotherian Add Varnish caching layer (optional)https://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Add_Varnish_caching_layer_(optional) Run Karthotherian:https://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Run_Karthotherian: Troubleshootinghttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian#Troubleshooting https://wikitech.wikimedia.org/wiki/Maps/Dynamic_tile_sources === Dynamic tile sources === Dynamic tile sourceshttps://wikitech.wikimedia.org/wiki/Maps/Dynamic_tile_sources#Dynamic_tile_sources Cassandrahttps://wikitech.wikimedia.org/wiki/Maps/Dynamic_tile_sources#Cassandra Dynamic Layer Generatorhttps://wikitech.wikimedia.org/wiki/Maps/Dynamic_tile_sources#Dynamic_Layer_Generator https://wikitech.wikimedia.org/wiki/Maps/Services_deployment == Deploying maps services == Deploying maps serviceshttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Deploying_maps_services Developer setup for updating deployment repohttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Developer_setup_for_updating_deployment_repo Publish library dependencies to NPM before building for deploymenthttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Publish_library_dependencies_to_NPM_before_building_for_deployment Building for deploymenthttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Building_for_deployment Update and build the deployment repohttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Update_and_build_the_deployment_repo Deploy to Beta Clusterhttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Deploy_to_Beta_Cluster Deploy to Productionhttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Deploy_to_Production Deploying serviceshttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Deploying_services Monitoringhttps://wikitech.wikimedia.org/wiki/Maps/Services_deployment#Monitoring https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/08 ==Week of August 03== Week of August 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/08#Week_of_August_03 Week of August 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/08#Week_of_August_10 Week of August 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/08#Week_of_August_17 Week of August 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/08#Week_of_August_24 Week of August 31https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/08#Week_of_August_31 https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration Stream configuration refers to configuration that distributed producers or consumers of a stream might want, e.g. Declaring streamshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#Declaring_streams Stream Configuration deploymenthttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#Stream_Configuration_deployment Renaming streamshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#Renaming_streams Querying stream confighttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#Querying_stream_config Stream versioninghttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#Stream_versioning Common Settings Documentationhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#Common_Settings_Documentation streamhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#stream schema_titlehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#schema_title message_key_fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#message_key_fields destination_event_servicehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#destination_event_service canary_events_enabledhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#canary_events_enabled consumers and producershttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#consumers_and_producers EventStreamConfighttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration#EventStreamConfig https://wikitech.wikimedia.org/wiki/Releases1002 releases1002 was a backend for releases.wikimedia. See alsohttps://wikitech.wikimedia.org/wiki/Releases1002#See_also https://wikitech.wikimedia.org/wiki/Releases1001 releases1001 was a backend for releases.wikimedia. See alsohttps://wikitech.wikimedia.org/wiki/Releases1001#See_also https://wikitech.wikimedia.org/wiki/Releases2001 releases1002 was a backend for releases.wikimedia. See alsohttps://wikitech.wikimedia.org/wiki/Releases2001#See_also https://wikitech.wikimedia.org/wiki/Releases2002 releases1002 is a standby backend for releases.wikimedia. See alsohttps://wikitech.wikimedia.org/wiki/Releases2002#See_also https://wikitech.wikimedia.org/wiki/Email Email may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Td-agent-bit Fluent Bit/td-agent-bithttps://fluentbit.io/ is an open source and multi-platform Log Processor and Forwarder which allows you to collect data/logs from different sources, unify and send them to multiple destinations. Packaginghttps://wikitech.wikimedia.org/wiki/Td-agent-bit#Packaging https://wikitech.wikimedia.org/wiki/News/HTTPS_enforcement_at_shared_proxy The web proxy service for Cloud VPS projects is enforcing [Layer Security|TLS] encryption by automatically redirecting from HTTP to HTTPS. What is changing?https://wikitech.wikimedia.org/wiki/News/HTTPS_enforcement_at_shared_proxy#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/HTTPS_enforcement_at_shared_proxy#Timeline https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation == HP ProLiant Server Directions == HP ProLiant Server Directionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#HP_ProLiant_Server_Directions Lights Out Managementhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Lights_Out_Management Common Actionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Common_Actions Reboot and boot from network then consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Reboot_and_boot_from_network_then_console Get consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Get_console Reset Virtual Serial porthttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Reset_Virtual_Serial_port Reboot and boot into BIOS then consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Reboot_and_boot_into_BIOS_then_console Connecting to mgmt interfacehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Connecting_to_mgmt_interface Connecting to Serial Consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Connecting_to_Serial_Console Power cyclinghttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Power_cycling Administrative Actionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Administrative_Actions Polling for MAC Addresshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Polling_for_MAC_Address Changing iLO User Passwordhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Changing_iLO_User_Password Changing the iLO Network IP Settingshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Changing_the_iLO_Network_IP_Settings Enable / Disable IPMI over iLOhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Enable_/_Disable_IPMI_over_iLO Setting a one-time boot optionhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Setting_a_one-time_boot_option Get MAC addresshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Get_MAC_address Disable PCI devicehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Disable_PCI_device Enable/Disable Hyperthreadinghttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Enable/Disable_Hyperthreading Show system event log entrieshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Show_system_event_log_entries ms-be RAID0 confighttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#ms-be_RAID0_config Additional MS-BE RAID detailshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Additional_MS-BE_RAID_details Mark a disk as failedhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Mark_a_disk_as_failed Blink disk ledhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Blink_disk_led ACPI Errorshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#ACPI_Errors Initial System Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Initial_System_Setup System Optionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#System_Options Setting Management Network Settingshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Setting_Management_Network_Settings NetBios / Wins ILOM Traffichttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#NetBios_/_Wins_ILOM_Traffic RAID controller firmware upgradehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#RAID_controller_firmware_upgrade Setting proper power optionhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/HP_Documentation#Setting_proper_power_option https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Instance_backups As of 2020-09-01, most VMs hosted on Ceph have their main disk backed up for a few days. This is a last-resort system put in place to guard against a total Ceph cluster collapse; any large-scale restore will be extremely labor-intensive. Architecturehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Instance_backups#Architecture What is backed uphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Instance_backups#What_is_backed_up Restoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Instance_backups#Restoring Restoring after 'openstack server delete'https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Instance_backups#Restoring_after_'openstack_server_delete' Restoring a lost Glance imagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Instance_backups#Restoring_a_lost_Glance_image https://wikitech.wikimedia.org/wiki/Application_servers/weights == codfw == codfwhttps://wikitech.wikimedia.org/wiki/Application_servers/weights#codfw 20200824https://wikitech.wikimedia.org/wiki/Application_servers/weights#20200824 https://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab The Mobile Device Lab is provided by the Performance Team for executing tests on real mobile devices, in a variety of network environments. We use this to measure how changes impact mobile users. Summaryhttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Summary Performance testing on mobile phoneshttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Performance_testing_on_mobile_phones Setuphttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Setup Setup the phoneshttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Setup_the_phones BitBar setuphttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#BitBar_setup Performance testshttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Performance_tests Add a testhttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Add_a_test Change configurationhttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Change_configuration Alert and error reportinghttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Alert_and_error_reporting Troubleshootinghttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Troubleshooting Dashboardshttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Dashboards Outstanding issueshttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab#Outstanding_issues https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation * Lights Out Manager: Dell iDRAC8 (14 Gen Servers, R440), Dell iDRAC9 (Dell 15 Gen servers, R450) Lights Out Managementhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Lights_Out_Management Common Actionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Common_Actions Show logshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Show_logs Reboot and boot from network then consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Reboot_and_boot_from_network_then_console Reboot and boot into BIOS then consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Reboot_and_boot_into_BIOS_then_console Connecting to mgmt interfacehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Connecting_to_mgmt_interface Connecting to Serial Consolehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Connecting_to_Serial_Console Changing BIOS Boot Orderhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Changing_BIOS_Boot_Order Get current boot order (tested on iDRAC 9 only)https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Get_current_boot_order_(tested_on_iDRAC_9_only) Change boot orderhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Change_boot_order Stage job for next reboot using "jobqueue" commandhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Stage_job_for_next_reboot_using_"jobqueue"_command Power cyclinghttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Power_cycling Administrative Actionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Administrative_Actions Updating Firmwarehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Updating_Firmware Urgent Firmware Revision Notices:https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Urgent_Firmware_Revision_Notices: Rolling back Firmware updateshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Rolling_back_Firmware_updates NICshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#NICs Firmware Device Orderinghttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Firmware_Device_Ordering HTTPS Mgmt Interfacehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#HTTPS_Mgmt_Interface Polling for MAC Addresshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Polling_for_MAC_Address Changing iDRAC User Passwordhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Changing_iDRAC_User_Password iDRAC SSH Key Based Authenticationhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#iDRAC_SSH_Key_Based_Authentication Changing the iDRAC Network IP Settingshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Changing_the_iDRAC_Network_IP_Settings Enable / Disable IPMI over DRAChttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Enable_/_Disable_IPMI_over_DRAC Setting a one-time boot optionhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Setting_a_one-time_boot_option Changing the User Defied String for the front LCDhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Changing_the_User_Defied_String_for_the_front_LCD Troubleshootinghttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Troubleshooting Initial System Setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Initial_System_Setup Automatic setuphttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Automatic_setup Failed to perform GET request to https://$HOSTNAME.mgmt.$DC.wmnet/redfishhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Failed_to_perform_GET_request_to_https://$HOSTNAME.mgmt.$DC.wmnet/redfish Unable to connect to the Redfish APIhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Unable_to_connect_to_the_Redfish_API Manual stepshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Manual_steps Perc H750 Raid Controllers (Virtual Drive ID, Boot Order)https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#Perc_H750_Raid_Controllers_(Virtual_Drive_ID,_Boot_Order) External Linkshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Dell_Documentation#External_Links https://wikitech.wikimedia.org/wiki/Add_Link This page contains information about the infrastructure used for the link recommendation service and the data pipeline used to support the [a Link" structured task project]. High-level summaryhttps://wikitech.wikimedia.org/wiki/Add_Link#High-level_summary Diagram: Fetching and completing link recommendation taskshttps://wikitech.wikimedia.org/wiki/Add_Link#Diagram:_Fetching_and_completing_link_recommendation_tasks Link Recommendation Servicehttps://wikitech.wikimedia.org/wiki/Add_Link#Link_Recommendation_Service Repositoryhttps://wikitech.wikimedia.org/wiki/Add_Link#Repository Machine learning modelhttps://wikitech.wikimedia.org/wiki/Add_Link#Machine_learning_model Local developmenthttps://wikitech.wikimedia.org/wiki/Add_Link#Local_development APIhttps://wikitech.wikimedia.org/wiki/Add_Link#API Deploymenthttps://wikitech.wikimedia.org/wiki/Add_Link#Deployment Dataset pipelinehttps://wikitech.wikimedia.org/wiki/Add_Link#Dataset_pipeline Monitoringhttps://wikitech.wikimedia.org/wiki/Add_Link#Monitoring Resolved questions / decisionshttps://wikitech.wikimedia.org/wiki/Add_Link#Resolved_questions_/_decisions Prepare the deployment patchhttps://wikitech.wikimedia.org/wiki/Add_Link#Prepare_the_deployment_patch Commit message guidelineshttps://wikitech.wikimedia.org/wiki/Add_Link#Commit_message_guidelines See alsohttps://wikitech.wikimedia.org/wiki/Add_Link#See_also Deploy the patchhttps://wikitech.wikimedia.org/wiki/Add_Link#Deploy_the_patch staginghttps://wikitech.wikimedia.org/wiki/Add_Link#staging eqiadhttps://wikitech.wikimedia.org/wiki/Add_Link#eqiad codfwhttps://wikitech.wikimedia.org/wiki/Add_Link#codfw Checking output from a containerhttps://wikitech.wikimedia.org/wiki/Add_Link#Checking_output_from_a_container Enabling on a new wikihttps://wikitech.wikimedia.org/wiki/Add_Link#Enabling_on_a_new_wiki Updateshttps://wikitech.wikimedia.org/wiki/Add_Link#Updates 9 November - 10 December 2020https://wikitech.wikimedia.org/wiki/Add_Link#9_November_-_10_December_2020 2 - 6 November 2020https://wikitech.wikimedia.org/wiki/Add_Link#2_-_6_November_2020 26 - 30 October 2020https://wikitech.wikimedia.org/wiki/Add_Link#26_-_30_October_2020 19 - 23 October 2020https://wikitech.wikimedia.org/wiki/Add_Link#19_-_23_October_2020 12 - 16 October 2020https://wikitech.wikimedia.org/wiki/Add_Link#12_-_16_October_2020 5 - 9 October 2020https://wikitech.wikimedia.org/wiki/Add_Link#5_-_9_October_2020 Teams / Contacthttps://wikitech.wikimedia.org/wiki/Add_Link#Teams_/_Contact Roles / responsibilitieshttps://wikitech.wikimedia.org/wiki/Add_Link#Roles_/_responsibilities Background readinghttps://wikitech.wikimedia.org/wiki/Add_Link#Background_reading https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_flavors Each VM created with Openstack Nova is assigned a flavor. Flavor determines the following characteristics for a VM: Deprecating a flavorhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_flavors#Deprecating_a_flavor General flavor guidelineshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_flavors#General_flavor_guidelines 3rd generation flavorshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_flavors#3rd_generation_flavors 2nd generation flavorshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_flavors#2nd_generation_flavors 1st generation flavorshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/VM_flavors#1st_generation_flavors https://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS This page contains information about how to get started with PAWS. Overviewhttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Overview Prerequisiteshttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Prerequisites Notebook based tutorialhttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Notebook_based_tutorial Quickstarthttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Quickstart Createhttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Create Sharehttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Share Forkhttps://wikitech.wikimedia.org/wiki/PAWS/Getting_started_with_PAWS#Fork https://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot Learn how to use PAWS to run Pywikibot scripts to perform automated tasks on wikis. Overviewhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot#Overview What can you do with Pywikibot?https://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot#What_can_you_do_with_Pywikibot? scriptshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot#scripts Notebook based tutorialhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot#Notebook_based_tutorial Generalhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot#General Wikidatahttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_and_Pywikibot#Wikidata https://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Overview Keyhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Key Wiki replicas and datasetshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Wiki_replicas_and_datasets Connecting to Wiki replicashttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Connecting_to_Wiki_replicas Tutorials and How-toshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Tutorials_and_How-tos Wikidata dumps tutorialshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Wikidata_dumps_tutorials Example notebookshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Example_notebooks Wiki replicashttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Wiki_replicas Dumpshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Dumps SPARQLhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#SPARQL Wikidata Queryhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Wikidata_Query APIshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#APIs Various notebooks using APIshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Various_notebooks_using_APIs Pywikibot (Uses MediaWiki API)https://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Pywikibot_(Uses_MediaWiki_API) Further resourceshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Further_resources https://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration Learn more about how PAWS is administered and maintained. Overviewhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration#Overview PAWS source codehttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration#PAWS_source_code Administrationhttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration#Administration Nova Resourcehttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration#Nova_Resource Icingahttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration#Icinga Historical noteshttps://wikitech.wikimedia.org/wiki/PAWS/PAWS_maintenance_and_administration#Historical_notes https://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#How_many_people_were_involved_in_the_remediation? What uncertainties do we still have?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#What_uncertainties_do_we_still_have? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-02_wdqs-outage#Actionables https://wikitech.wikimedia.org/wiki/API_Gateway The API Gateway is a service that runs in Kubernetes based on Envoy. The service implements many features central to serving the unified API and the API portal. What it doeshttps://wikitech.wikimedia.org/wiki/API_Gateway#What_it_does How it workshttps://wikitech.wikimedia.org/wiki/API_Gateway#How_it_works Rate limitinghttps://wikitech.wikimedia.org/wiki/API_Gateway#Rate_limiting Routinghttps://wikitech.wikimedia.org/wiki/API_Gateway#Routing JSON Web Tokenshttps://wikitech.wikimedia.org/wiki/API_Gateway#JSON_Web_Tokens API Portalhttps://wikitech.wikimedia.org/wiki/API_Gateway#API_Portal Logs and analyticshttps://wikitech.wikimedia.org/wiki/API_Gateway#Logs_and_analytics Where it runshttps://wikitech.wikimedia.org/wiki/API_Gateway#Where_it_runs How to design your APIhttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_design_your_API Before you buildhttps://wikitech.wikimedia.org/wiki/API_Gateway#Before_you_build Stylehttps://wikitech.wikimedia.org/wiki/API_Gateway#Style Authentication and authorizationhttps://wikitech.wikimedia.org/wiki/API_Gateway#Authentication_and_authorization Rate limitshttps://wikitech.wikimedia.org/wiki/API_Gateway#Rate_limits Criteria: URL structurehttps://wikitech.wikimedia.org/wiki/API_Gateway#Criteria:_URL_structure Namespacehttps://wikitech.wikimedia.org/wiki/API_Gateway#Namespace Versionhttps://wikitech.wikimedia.org/wiki/API_Gateway#Version Supported projectshttps://wikitech.wikimedia.org/wiki/API_Gateway#Supported_projects Supported subdomainshttps://wikitech.wikimedia.org/wiki/API_Gateway#Supported_subdomains Criteria: Conditional requestshttps://wikitech.wikimedia.org/wiki/API_Gateway#Criteria:_Conditional_requests Next stepshttps://wikitech.wikimedia.org/wiki/API_Gateway#Next_steps How it's configuredhttps://wikitech.wikimedia.org/wiki/API_Gateway#How_it's_configured Rate limiting internalshttps://wikitech.wikimedia.org/wiki/API_Gateway#Rate_limiting_internals How to add an API routehttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_add_an_API_route Appserver API routeshttps://wikitech.wikimedia.org/wiki/API_Gateway#Appserver_API_routes Other API routeshttps://wikitech.wikimedia.org/wiki/API_Gateway#Other_API_routes Discovery serviceshttps://wikitech.wikimedia.org/wiki/API_Gateway#Discovery_services Versioninghttps://wikitech.wikimedia.org/wiki/API_Gateway#Versioning Documentationhttps://wikitech.wikimedia.org/wiki/API_Gateway#Documentation How to deploy changeshttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_deploy_changes How to roll back changeshttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_roll_back_changes How to test changeshttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_test_changes In developmenthttps://wikitech.wikimedia.org/wiki/API_Gateway#In_development In staginghttps://wikitech.wikimedia.org/wiki/API_Gateway#In_staging How to debug ithttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_debug_it Logshttps://wikitech.wikimedia.org/wiki/API_Gateway#Logs Logstashhttps://wikitech.wikimedia.org/wiki/API_Gateway#Logstash Kuberneteshttps://wikitech.wikimedia.org/wiki/API_Gateway#Kubernetes WikimediaDebughttps://wikitech.wikimedia.org/wiki/API_Gateway#WikimediaDebug How to monitor ithttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_monitor_it How to assign a client to rate limit tierhttps://wikitech.wikimedia.org/wiki/API_Gateway#How_to_assign_a_client_to_rate_limit_tier Known issueshttps://wikitech.wikimedia.org/wiki/API_Gateway#Known_issues Relatedhttps://wikitech.wikimedia.org/wiki/API_Gateway#Related https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Overview Jupyter notebookshttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Jupyter_notebooks PAWS (A Web Shell)https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#PAWS_(A_Web_Shell) Resourceshttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Resources Example Useshttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Example_Uses Why use PAWS?https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Why_use_PAWS? What set-up and skills do you need?https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#What_set-up_and_skills_do_you_need? Required softwarehttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Required_software Programming languageshttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Programming_languages Should you use Jupyter notebooks for your project?https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Should_you_use_Jupyter_notebooks_for_your_project? Yes!https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Yes! No!https://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#No! Other optionshttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Other_options Use responsiblyhttps://wikitech.wikimedia.org/wiki/PAWS/About_Jupyter_notebooks_hosted_on_PAWS#Use_responsibly https://wikitech.wikimedia.org/wiki/Data_Platform/AQS/Editors_by_country https://wikitech.wikimedia.org/wiki/ORES/Guide:_Visualizing_the_change_in_Wikidata_Item_quality The change in the quality of Wikidata items over time can be nicely visualized with Sankey diagrams as shown in T261331: Metrics: Get the quality score changes per month for at least 2019 and 2020 in a sankey diagram based on the new model. 1. Create Snapshots from Wikidata database dumpshttps://wikitech.wikimedia.org/wiki/ORES/Guide:_Visualizing_the_change_in_Wikidata_Item_quality#1._Create_Snapshots_from_Wikidata_database_dumps Make Snapshots availablehttps://wikitech.wikimedia.org/wiki/ORES/Guide:_Visualizing_the_change_in_Wikidata_Item_quality#Make_Snapshots_available 2. Compare Snapshotshttps://wikitech.wikimedia.org/wiki/ORES/Guide:_Visualizing_the_change_in_Wikidata_Item_quality#2._Compare_Snapshots 3. Visualize Changehttps://wikitech.wikimedia.org/wiki/ORES/Guide:_Visualizing_the_change_in_Wikidata_Item_quality#3._Visualize_Change https://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover == Note == Notehttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Note Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Timeline Services/traffic switchover: 2020-08-31https://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Services/traffic_switchover:_2020-08-31 MediaWiki: 2020-09-01https://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#MediaWiki:_2020-09-01 Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-01_data-center-switchover#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-09-09_mobileapps_config_change == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-09_mobileapps_config_change#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-09_mobileapps_config_change#Actionables https://wikitech.wikimedia.org/wiki/Discovery/Analytics/Glent Glent is a search platform project that generates query suggestions based on search logs in a batch process. The suggestions are regenerated once a week and shipped to the production cirrussearch clusters to be presented to users when their search query is similar to a query glent has suggestions for. Development Environmenthttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Glent#Development_Environment Codehttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Glent#Code Buildhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Glent#Build Releasehttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Glent#Release Deploymenthttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Glent#Deployment https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/09 ==Week of September 07== Week of September 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/09#Week_of_September_07 Week of September 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/09#Week_of_September_14 Week of September 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/09#Week_of_September_21 Week of September 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/09#Week_of_September_28 https://wikitech.wikimedia.org/wiki/Service_Wiki/Etcd == Etcd == Etcdhttps://wikitech.wikimedia.org/wiki/Service_Wiki/Etcd#Etcd https://wikitech.wikimedia.org/wiki/Service == Service Wiki == Service Wikihttps://wikitech.wikimedia.org/wiki/Service#Service_Wiki https://wikitech.wikimedia.org/wiki/Service/Etcd == Etcd == Etcdhttps://wikitech.wikimedia.org/wiki/Service/Etcd#Etcd Descriptionhttps://wikitech.wikimedia.org/wiki/Service/Etcd#Description Categorieshttps://wikitech.wikimedia.org/wiki/Service/Etcd#Categories Service Typehttps://wikitech.wikimedia.org/wiki/Service/Etcd#Service_Type Service Dependenieshttps://wikitech.wikimedia.org/wiki/Service/Etcd#Service_Dependenies Related Serviceshttps://wikitech.wikimedia.org/wiki/Service/Etcd#Related_Services Ownershiphttps://wikitech.wikimedia.org/wiki/Service/Etcd#Ownership Supporting documentation and relevant informationhttps://wikitech.wikimedia.org/wiki/Service/Etcd#Supporting_documentation_and_relevant_information https://wikitech.wikimedia.org/wiki/Dumps/Testing ===Unit tests=== Unit testshttps://wikitech.wikimedia.org/wiki/Dumps/Testing#Unit_tests Deployment-prep testinghttps://wikitech.wikimedia.org/wiki/Dumps/Testing#Deployment-prep_testing SQL/XML dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Testing#SQL/XML_dumps Other dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Testing#Other_dumps Output from the dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Testing#Output_from_the_dumps https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details This page contains the implementation details for the 2020 Network refresh project. eqiadhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#eqiad specs for eqiad1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#specs_for_eqiad1 network setup in eqiad1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#network_setup_in_eqiad1 allocationshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#allocations stage 0 starting point, current network setuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#stage_0_starting_point,_current_network_setup stage 1: validate cloudgw changes in codfwhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#stage_1:_validate_cloudgw_changes_in_codfw stage 2: enable L3 routing on cloudsw nodeshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#stage_2:_enable_L3_routing_on_cloudsw_nodes stage 3: enable L3 routing on cloudgw nodeshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#stage_3:_enable_L3_routing_on_cloudgw_nodes codfwhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#codfw specs for codfw1devhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#specs_for_codfw1dev network setup in codfw1devhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#network_setup_in_codfw1dev stage 0: starting point, current network setuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#stage_0:_starting_point,_current_network_setup stage 1: validation checklisthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/Implementation_details#stage_1:_validation_checklist https://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview ==All about Wikibase (rdf) dumps via cron== All about Wikibase (rdf) dumps via cronhttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#All_about_Wikibase_(rdf)_dumps_via_cron Common functions for dump scriptshttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Common_functions_for_dump_scripts Configuration fileshttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Configuration_files Where to write files, what to name themhttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Where_to_write_files,_what_to_name_them Getting config values for your scripthttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Getting_config_values_for_your_script Example codehttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Example_code Shared functions for wikibase dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Shared_functions_for_wikibase_dumps Per-project functions for wikibase rdf dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Wikibase_dumps_overview#Per-project_functions_for_wikibase_rdf_dumps https://wikitech.wikimedia.org/wiki/Incidents/2020-08-12_appservers_oom == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-08-12_appservers_oom#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-08-12_appservers_oom#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-08-14_isp-unreachable == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-08-14_isp-unreachable#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-08-14_isp-unreachable#Actionables https://wikitech.wikimedia.org/wiki/Alertmanager == What is it? == What is it?https://wikitech.wikimedia.org/wiki/Alertmanager#What_is_it? User guidehttps://wikitech.wikimedia.org/wiki/Alertmanager#User_guide Onboardhttps://wikitech.wikimedia.org/wiki/Alertmanager#Onboard Create alertshttps://wikitech.wikimedia.org/wiki/Alertmanager#Create_alerts The "site" labelhttps://wikitech.wikimedia.org/wiki/Alertmanager#The_"site"_label Grafana alertshttps://wikitech.wikimedia.org/wiki/Alertmanager#Grafana_alerts Silences & acknowledgementshttps://wikitech.wikimedia.org/wiki/Alertmanager#Silences_&_acknowledgements FAQhttps://wikitech.wikimedia.org/wiki/Alertmanager#FAQ I'm part of a new team that needs onboarding to Alertmanager, what do I need to do?https://wikitech.wikimedia.org/wiki/Alertmanager#I'm_part_of_a_new_team_that_needs_onboarding_to_Alertmanager,_what_do_I_need_to_do? What does the "team" label mean in this context?https://wikitech.wikimedia.org/wiki/Alertmanager#What_does_the_"team"_label_mean_in_this_context? Can I display less information on the alerts dashboard?https://wikitech.wikimedia.org/wiki/Alertmanager#Can_I_display_less_information_on_the_alerts_dashboard? How can I browse alerts history?https://wikitech.wikimedia.org/wiki/Alertmanager#How_can_I_browse_alerts_history? I want to see only recent alerts, how do I do that?https://wikitech.wikimedia.org/wiki/Alertmanager#I_want_to_see_only_recent_alerts,_how_do_I_do_that? How do I access the API?https://wikitech.wikimedia.org/wiki/Alertmanager#How_do_I_access_the_API? Do alert names have to be unique?https://wikitech.wikimedia.org/wiki/Alertmanager#Do_alert_names_have_to_be_unique? I just +2'd and merged my alerts.git change, what's next?https://wikitech.wikimedia.org/wiki/Alertmanager#I_just_+2'd_and_merged_my_alerts.git_change,_what's_next? How do I get an alert to open a task?https://wikitech.wikimedia.org/wiki/Alertmanager#How_do_I_get_an_alert_to_open_a_task? My new alert should be firing but it isn'thttps://wikitech.wikimedia.org/wiki/Alertmanager#My_new_alert_should_be_firing_but_it_isn't The IRC bot has quit my channel and hasn't joined yet, what's up?https://wikitech.wikimedia.org/wiki/Alertmanager#The_IRC_bot_has_quit_my_channel_and_hasn't_joined_yet,_what's_up? Local and global alertshttps://wikitech.wikimedia.org/wiki/Alertmanager#Local_and_global_alerts deploy-taghttps://wikitech.wikimedia.org/wiki/Alertmanager#deploy-tag Deploy alerts to specific siteshttps://wikitech.wikimedia.org/wiki/Alertmanager#Deploy_alerts_to_specific_sites The site labelhttps://wikitech.wikimedia.org/wiki/Alertmanager#The_site_label Software stackhttps://wikitech.wikimedia.org/wiki/Alertmanager#Software_stack Upgrading phalertshttps://wikitech.wikimedia.org/wiki/Alertmanager#Upgrading_phalerts Notificationshttps://wikitech.wikimedia.org/wiki/Alertmanager#Notifications Operationshttps://wikitech.wikimedia.org/wiki/Alertmanager#Operations Alertshttps://wikitech.wikimedia.org/wiki/Alertmanager#Alerts Cluster configuration is out of synchttps://wikitech.wikimedia.org/wiki/Alertmanager#Cluster_configuration_is_out_of_sync Alert linting found problemshttps://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems Prometheus didn't have any series (promql/series)https://wikitech.wikimedia.org/wiki/Alertmanager#Prometheus_didn't_have_any_series_(promql/series) rate() should be used with counters but is a gauge (promql/rate)https://wikitech.wikimedia.org/wiki/Alertmanager#rate()_should_be_used_with_counters_but_is_a_gauge_(promql/rate) Add a silence via CLIhttps://wikitech.wikimedia.org/wiki/Alertmanager#Add_a_silence_via_CLI Fire a test alert via CLIhttps://wikitech.wikimedia.org/wiki/Alertmanager#Fire_a_test_alert_via_CLI Continuous Integration (CI)https://wikitech.wikimedia.org/wiki/Alertmanager#Continuous_Integration_(CI) https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Maintenance_Schedule This page is meant to collect the upcoming maintenance windows scheduled together with some useful info like: point of contact, impact, related task, etc. As general guideline, for any issue you can reach out to the Analytics team via Slack/Libera Chat() or email (analytics-internal@). Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems https://wikitech.wikimedia.org/wiki/Monitoring/Netbox_DNS_uncommitted_changes == What it does == What it doeshttps://wikitech.wikimedia.org/wiki/Monitoring/Netbox_DNS_uncommitted_changes#What_it_does Statuseshttps://wikitech.wikimedia.org/wiki/Monitoring/Netbox_DNS_uncommitted_changes#Statuses What to dohttps://wikitech.wikimedia.org/wiki/Monitoring/Netbox_DNS_uncommitted_changes#What_to_do https://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Summary Affected wikis at time of incidenthttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Affected_wikis_at_time_of_incident Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-25_s5_replication_lag#Actionables https://wikitech.wikimedia.org/wiki/Push_notifications The push-notifications service accepts notification requests via HTTP for batching and submission to app push provider APIs. It is deployed in Kubernetes, and its request intake API endpoints are exposed only internally to the cluster. Lifecycle of a push notification requesthttps://wikitech.wikimedia.org/wiki/Push_notifications#Lifecycle_of_a_push_notification_request Dashboardshttps://wikitech.wikimedia.org/wiki/Push_notifications#Dashboards Connecting to push-notificationshttps://wikitech.wikimedia.org/wiki/Push_notifications#Connecting_to_push-notifications Productionhttps://wikitech.wikimedia.org/wiki/Push_notifications#Production Beta Clusterhttps://wikitech.wikimedia.org/wiki/Push_notifications#Beta_Cluster Deployment processhttps://wikitech.wikimedia.org/wiki/Push_notifications#Deployment_process In case of emergencyhttps://wikitech.wikimedia.org/wiki/Push_notifications#In_case_of_emergency Service level objectives (SLOs)https://wikitech.wikimedia.org/wiki/Push_notifications#Service_level_objectives_(SLOs) See alsohttps://wikitech.wikimedia.org/wiki/Push_notifications#See_also https://wikitech.wikimedia.org/wiki/Incidents/2020-09-08_Rack_D_hosts_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-08_Rack_D_hosts_outage#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-08_Rack_D_hosts_outage#Actionables https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#What_happens_when_a_project_is_not_marked_as_active Further clueshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#Further_clues Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#Projects_and_Instances account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#account-creation-assistance adminhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#admin admin-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#admin-monitoring In use analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#In_use_analytics antiharassmenthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#antiharassment asyncwikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#asyncwiki automation-frameworkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#automation-framework bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#bastion bloghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#blog butterflyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#butterfly centralnotice-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#centralnotice-staging chathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#chat clouddb-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#clouddb-services cloudinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#cloudinfra cloudstorehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#cloudstore cloudvirt-canaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#cloudvirt-canary codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#codereview codesearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#codesearch collection-alt-rendererhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#collection-alt-renderer commons-corruption-checkerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#commons-corruption-checker commonsarchivehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#commonsarchive commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#commtech community-labs-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#community-labs-monitoring cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#cvn cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#dashiki deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#deployment-prep devtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#devtools discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#discourse discovery-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#discovery-stats downloadhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#download dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#dwl entity-detectionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#entity-detection etytreehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#etytree eventmetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#eventmetrics extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#fastcci finding-glamshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#finding-glams getstartedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#getstarted gitlab-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#gitlab-test glampipehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#glampipe globalcuhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#globalcu globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#google-api-proxy grantreviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#grantreview graphqlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#graphql gratitudehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#gratitude hashtagshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#hashtags hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#huggle huwiki-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#huwiki-dev icingahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#icinga ign2commonshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#ign2commons iiabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#iiab incubatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#incubator integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#integration k8splayhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#k8splay languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#language library-upgraderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#library-upgrader linkwatcherhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#linkwatcher lizenzhinweisgeneratorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#lizenzhinweisgenerator logginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#logging lta-trackerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#lta-tracker machine-visionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#machine-vision mailmanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mailman mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#maps mariadb104-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mariadb104-test mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#math matrixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#matrix mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mediawiki-vagrant meethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#meet metricsinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#metricsinfra mezahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#meza mix-n-matchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mix-n-match mobilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mobile monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#monitoring mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mwoffliner mwstakehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mwstake mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#mwv-apt observerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#observer ocrtoyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#ocrtoy ogvjs-integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#ogvjs-integration openocrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#openocr openrefinehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#openrefine openstackhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#openstack orchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#orch oreshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#ores ores-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#ores-staging osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#osmit packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#packaging packagist-mirrorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#packagist-mirror pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#paws petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#petscan planethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#planet pluggableauthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#pluggableauth privpol-captchahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#privpol-captcha project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#project-proxy puppethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#puppet puppet-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#puppet-diffs pushhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#push quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#quarry rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#rcm reading-web-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#reading-web-staging recommendation-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#recommendation-api redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#redirects redwarnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#redwarn sccachehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#sccache sciencesourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#sciencesource searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#search security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#security-tools sentryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#sentry serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#services shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#signwriting snugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#snuggle soweegohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#soweego sre-sandboxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#sre-sandbox In use srwiki-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#In_use_srwiki-dev ssohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#sso strikerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#striker suggestbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#suggestbot swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#swift techbloghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#techblog testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#testlabs thumborhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#thumbor toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#toolsbeta toolserver-legacyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#toolserver-legacy traffichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#traffic twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#twl utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#utrs In use -videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#In_use_-video videocuttoolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#videocuttool videowikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#videowiki visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#visualeditor wcdohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wcdo wdqs-scalinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wdqs-scaling webperfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#webperf wikiapiaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikiapiary wikibase-registryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikibase-registry wikidata-autodeschttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidata-autodesc wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidata-dev wikidata-federationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidata-federation wikidata-history-query-servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidata-history-query-service wikidata-primary-sources-toolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidata-primary-sources-tool wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidata-query SHUTDOWN wikidata-realtime-dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#SHUTDOWN_wikidata-realtime-dumps wikidocumentarieshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidocumentaries wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikidumpparse wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikilabels wikilinkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikilink wikiloophttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikiloop wikimania-scholarshipshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikimania-scholarships wikisourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikisource wikispeechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikispeech wikisporehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikispore wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikistats wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wikitextexp wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wildcat wm-bothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wm-bot wmde-dashboardshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wmde-dashboards wmde-templates-alphahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wmde-templates-alpha wmf-research-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wmf-research-tools wmflabsdotorghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#wmflabsdotorg xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#xtools https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign In the interest of making and keeping Wiki Replicas a stable and performant service, a new backend architecture is needed. There is some impact in the features and usage patterns. What is changing?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#What_should_I_do? Update existing tools to ensure queries are executed against the proper database connectionhttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Update_existing_tools_to_ensure_queries_are_executed_against_the_proper_database_connection Check your existing tools and services queries for cross database JOINshttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Check_your_existing_tools_and_services_queries_for_cross_database_JOINs What are the primary changes with the new architecture?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#What_are_the_primary_changes_with_the_new_architecture? Cross database JOINs will no longer work as writtenhttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Cross_database_JOINs_will_no_longer_work_as_written Can only query a database if you are connected to it explicitlyhttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Can_only_query_a_database_if_you_are_connected_to_it_explicitly New host nameshttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#New_host_names Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Solutions_to_common_problems Help us contributing code snippets or how you migrated your codehttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Help_us_contributing_code_snippets_or_how_you_migrated_your_code How can I test the new replicas before the switchover?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_can_I_test_the_new_replicas_before_the_switchover? How do I cross reference data between wikis like I do with cross joins today?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_do_I_cross_reference_data_between_wikis_like_I_do_with_cross_joins_today? I have a tool that queries all of the wikis and I use only one connectionhttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#I_have_a_tool_that_queries_all_of_the_wikis_and_I_use_only_one_connection How will the wikis map to physical nodes/sections?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_will_the_wikis_map_to_physical_nodes/sections? How should I connect to a database in Quarry?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_should_I_connect_to_a_database_in_Quarry? I use Quarry to perform cross join queries, what do I do?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#I_use_Quarry_to_perform_cross_join_queries,_what_do_I_do? How should I connect to databases in PAWS?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_should_I_connect_to_databases_in_PAWS? Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Why_are_we_doing_this? New architecturehttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#New_architecture Impact on other serviceshttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Impact_on_other_services How can I help?https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_can_I_help? Related Ticketshttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Related_Tickets Other linkshttps://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Other_links https://wikitech.wikimedia.org/wiki/Kubernetes/Packages == Intro == Introhttps://wikitech.wikimedia.org/wiki/Kubernetes/Packages#Intro Packaginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Packages#Packaging Publishinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Packages#Publishing https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole == 2020-10-05 == 2020-10-05https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole#2020-10-05 summaryhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole#summary raw notes from etherpadhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole#raw_notes_from_etherpad https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-09-30-checkin https://wikitech.wikimedia. https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-10-07-checkin https://wikitech.wikimedia. https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-09-16-checkin https://wikitech.wikimedia. https://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain Cloud VPS instances created on or after 2020-09-08 will stop using the .eqiad. What's changinghttps://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#What's_changing Timelinehttps://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#Timeline More informationhttps://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#More_information Frequently asked questionshttps://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#Frequently_asked_questions Renaming existing instanceshttps://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#Renaming_existing_instances What about *.svc.eqiad.wmflabs?https://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#What_about_*.svc.eqiad.wmflabs? See alsohttps://wikitech.wikimedia.org/wiki/News/Phasing_out_the_.wmflabs_domain#See_also https://wikitech.wikimedia.org/wiki/Code_of_conduct https://wikitech.wikimedia.org/wiki/WQDS WQDS is a misspelling of the Wikidata Data Query Service. https://wikitech.wikimedia.org/wiki/Maps/Debugging == Reading logs == Reading logshttps://wikitech.wikimedia.org/wiki/Maps/Debugging#Reading_logs https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/10 ==Week of October 05== Week of October 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/10#Week_of_October_05 Week of October 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/10#Week_of_October_12 Week of October 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/10#Week_of_October_19 Week of October 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/10#Week_of_October_26 https://wikitech.wikimedia.org/wiki/Wmflib Wmflib may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Python/Wmflib A Python package that contains custom modules to interact with the WMF production infrastructure. SRE Infrastructure Foundationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Infrastructure_Foundations https://wikitech.wikimedia.org/wiki/Media_storage/Backups == General architecture == General architecturehttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#General_architecture Manual search query, recovery and deletionhttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Manual_search_query,_recovery_and_deletion Querying fileshttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Querying_files Recovering fileshttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Recovering_files Example (see for a typical session)https://wikitech.wikimedia.org/wiki/Media_storage/Backups#Example_(see_for_a_typical_session) Deleting fileshttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Deleting_files Batch query, recovery and deletionhttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Batch_query,_recovery_and_deletion Logshttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Logs File search methodshttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#File_search_methods File properties explanationhttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#File_properties_explanation How to access the web UI of miniohttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#How_to_access_the_web_UI_of_minio MinIO user setup for the first timehttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#MinIO_user_setup_for_the_first_time Software and WMF deployment and configurationhttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Software_and_WMF_deployment_and_configuration Further readinghttps://wikitech.wikimedia.org/wiki/Media_storage/Backups#Further_reading https://wikitech.wikimedia.org/wiki/Incidents/2020-10-06_cloud-vps See also: https://lists.wikimedia. Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-10-06_cloud-vps#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-10-06_cloud-vps#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2020-09-07_mobilefrontend-sec ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-07_mobilefrontend-sec#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-09-07_mobilefrontend-sec#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS Some ideas specific ideas about NFS. Dumps clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#Dumps_cluster Primary clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#Primary_cluster idea 1: serve NFS from a network namespace connected to a new cloud subnethttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_1:_serve_NFS_from_a_network_namespace_connected_to_a_new_cloud_subnet idea 1: pros & conshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_1:_pros_&_cons idea 2: manila with LVM driver using DHSSfalse ===https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_2:_manila_with_LVM_driver_using_DHSSfalse_=== idea 2: pros & conshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_2:_pros_&_cons idea 3: manila with generic driver using DHSStrue ===https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_3:_manila_with_generic_driver_using_DHSStrue_=== idea 3: pros & conshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_3:_pros_&_cons idea 4: manila with cephfs driver using DHSSfalse, using NFS as transport and thin NFS server ===https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_4:_manila_with_cephfs_driver_using_DHSSfalse,_using_NFS_as_transport_and_thin_NFS_server_=== idea 4: pros & conshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_4:_pros_&_cons idea 5: serve NFS from inside the cloud 'by hand' without manila or cephhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_5:_serve_NFS_from_inside_the_cloud_'by_hand'_without_manila_or_ceph idea 5: pros & conshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_5:_pros_&_cons idea 6: manila with generic driver using DHSSfalse ===https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_6:_manila_with_generic_driver_using_DHSSfalse_=== idea 6: pros & conshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#idea_6:_pros_&_cons Manila general noteshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#Manila_general_notes See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/NAT_loophole/NFS#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Buildpacks See Wikimedia Cloud Services team/EnhancementProposals/Toolforge push to deploy for the high-level overview of buildpacks. Updating buildpackshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Buildpacks#Updating_buildpacks packhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Buildpacks#pack https://wikitech.wikimedia.org/wiki/Orchestrator ==Operations== Operationshttps://wikitech.wikimedia.org/wiki/Orchestrator#Operations Current deploymenthttps://wikitech.wikimedia.org/wiki/Orchestrator#Current_deployment Adding a section to orchestratorhttps://wikitech.wikimedia.org/wiki/Orchestrator#Adding_a_section_to_orchestrator Upgrading orchestratorhttps://wikitech.wikimedia.org/wiki/Orchestrator#Upgrading_orchestrator Packaginghttps://wikitech.wikimedia.org/wiki/Orchestrator#Packaging Updating orchestrator packaging to a new upstream versionhttps://wikitech.wikimedia.org/wiki/Orchestrator#Updating_orchestrator_packaging_to_a_new_upstream_version Creating a new orchestrator releasehttps://wikitech.wikimedia.org/wiki/Orchestrator#Creating_a_new_orchestrator_release Building orchestrator packageshttps://wikitech.wikimedia.org/wiki/Orchestrator#Building_orchestrator_packages Uploading new orchestrator packageshttps://wikitech.wikimedia.org/wiki/Orchestrator#Uploading_new_orchestrator_packages Troubleshootinghttps://wikitech.wikimedia.org/wiki/Orchestrator#Troubleshooting Entry in database_resolve that maps to a bare hostnamehttps://wikitech.wikimedia.org/wiki/Orchestrator#Entry_in_database_resolve_that_maps_to_a_bare_hostname There appears to be 'fake lag'https://wikitech.wikimedia.org/wiki/Orchestrator#There_appears_to_be_'fake_lag' Common day to day operationshttps://wikitech.wikimedia.org/wiki/Orchestrator#Common_day_to_day_operations Moving replicas aroundhttps://wikitech.wikimedia.org/wiki/Orchestrator#Moving_replicas_around See alsohttps://wikitech.wikimedia.org/wiki/Orchestrator#See_also External linkhttps://wikitech.wikimedia.org/wiki/Orchestrator#External_link https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Test The Analytics team runs a Hadoop test cluster in production. This seems controversial since we could use Cloud virtual machines instead, but due to the complexity of the Hadoop set up (Kerberos auth, TLS encryption, Kafka topics to sample to generate data, etc.. Hosts and their roleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Test#Hosts_and_their_roles UI quicklinkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Test#UI_quicklinks Oozie coordinator testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Test#Oozie_coordinator_testing Hadoop upgrade - jobs to testhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Test#Hadoop_upgrade_-_jobs_to_test https://wikitech.wikimedia.org/wiki/Incidents/2020-10-30_fr.wikipedia.org-slow-main-page == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-10-30_fr.wikipedia.org-slow-main-page#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-10-30_fr.wikipedia.org-slow-main-page#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-10-30_fr.wikipedia.org-slow-main-page#Actionables https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-10-checkin = 2020-11-10 WMCS network checkin = 2020-11-10 WMCS network checkinhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-10-checkin#2020-11-10_WMCS_network_checkin status updates from arturohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-10-checkin#status_updates_from_arturo Questionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-10-checkin#Questions https://wikitech.wikimedia.org/wiki/Set_up_browser_tests_using_the_Mediawiki_docker_set_up ==Before your start== Before your starthttps://wikitech.wikimedia.org/wiki/Set_up_browser_tests_using_the_Mediawiki_docker_set_up#Before_your_start Files required in your Mediawiki home directoryhttps://wikitech.wikimedia.org/wiki/Set_up_browser_tests_using_the_Mediawiki_docker_set_up#Files_required_in_your_Mediawiki_home_directory Run the testshttps://wikitech.wikimedia.org/wiki/Set_up_browser_tests_using_the_Mediawiki_docker_set_up#Run_the_tests https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy EventLogging was Wikimedia's original analytics focused event data system. It used Draft-3 JSONSchemas on meta. Differences from EventLogging the legacy backendhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Differences_from_EventLogging_the_legacy_backend FAQhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#FAQ How do I find schemas?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#How_do_I_find_schemas? How do I edit schemas?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#How_do_I_edit_schemas? How do I create new schemas?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#How_do_I_create_new_schemas? How do I produce event data?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#How_do_I_produce_event_data? How do I query my data?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#How_do_I_query_my_data? Migration to Event Platformhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Migration_to_Event_Platform What does Event Platform 'migration' mean?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#What_does_Event_Platform_'migration'_mean? How does this relate to the Metrics Platform?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#How_does_this_relate_to_the_Metrics_Platform? Is my schema legacy or not?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Is_my_schema_legacy_or_not? Is my schema migrated or not?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Is_my_schema_migrated_or_not? Changeshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Changes Datahttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Data Client IP addresses are no longer collected by defaulthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Client_IP_addresses_are_no_longer_collected_by_default timestamp field semanticshttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#timestamp_field_semantics Systemhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#System Schema Locationhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Schema_Location Automatically augmented event datahttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Automatically_augmented_event_data Backendhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Backend Frontendhttps://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Frontend Other questions?https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy#Other_questions? https://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host == Prerequisites: == Prerequisites:https://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Prerequisites: Decommissioning workflow:https://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Decommissioning_workflow: Create a tracking tickethttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Create_a_tracking_ticket Depool the hosthttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Depool_the_host Remove the host from dbctlhttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Remove_the_host_from_dbctl Remove all other puppet entrieshttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Remove_all_other_puppet_entries Run the decommissioning scripthttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Run_the_decommissioning_script Merge puppet changehttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Merge_puppet_change Remove host from zarcillohttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Remove_host_from_zarcillo Remove host from orchestratorhttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Remove_host_from_orchestrator Update the task and send it to dcopshttps://wikitech.wikimedia.org/wiki/MariaDB/Decommissioning_a_DB_Host#Update_the_task_and_send_it_to_dcops https://wikitech.wikimedia.org/wiki/Phabricator/Ban_IP_address You are probably searching for edge blocking an IP: Varnish#Blacklist_an_IP. Look for phabricator_abusers: in file /srv/private/hieradata/common. https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/11 ==Week of November 02== Week of November 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/11#Week_of_November_02 Week of November 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/11#Week_of_November_09 Week of November 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/11#Week_of_November_16 Week of November 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/11#Week_of_November_23 Week of November 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/11#Week_of_November_30 https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content This page lists Data Lakes datasets that contain content, such as wikitext or wikibase JSON: Content datahttps://wikitech.wikimedia.org/wiki/Category:Content_data Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook ==== Current setup ==== Current setuphttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook#Current_setup OAuth 1.1a setuphttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook#OAuth_1.1a_setup Updatehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook#Update Data Reloadhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook#Data_Reload Data Reload (Via Cookbook)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook#Data_Reload_(Via_Cookbook) Query count summaryhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Wikimedia_Commons_Query_Service/Runbook#Query_count_summary https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship This page contains information related to the production / cloud network & realms relationship, policies, guidelines and best practices for planning new services and for when reworking old ones. General casehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#General_case requirementshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#requirements example: toolsdbhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_toolsdb example: cloudinfrahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_cloudinfra Generic network access cloud --> prodhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#Generic_network_access_cloud_-->_prod example: dumpshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_dumps example: wikishttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_wikis Generic network access prod --> cloudhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#Generic_network_access_prod_-->_cloud example: puppet catalog compilerhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_puppet_catalog_compiler example: SALhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_SAL Using isolation mechanismshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#Using_isolation_mechanisms example: openstack native serviceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#example:_openstack_native_services See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Production_Cloud_services_relationship#See_also https://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug This is the runbook for release management of the WikimediaDebug browser extension. Linkshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Links Release processhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Release_process Access controlhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Access_control Chrome Web Storehttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Chrome_Web_Store Firefox Addonshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Firefox_Addons Contact addresshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Contact_address Troubleshootinghttps://wikitech.wikimedia.org/wiki/Release_Engineering/Runbook/WikimediaDebug#Troubleshooting https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-25-checkin = 2020-11-25 WMCS network checkin = 2020-11-25 WMCS network checkinhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-25-checkin#2020-11-25_WMCS_network_checkin status updates from arturohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-25-checkin#status_updates_from_arturo noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-25-checkin#notes actionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2020-11-25-checkin#actions https://wikitech.wikimedia.org/wiki/Similarusers Similarusers (formerly known as "Sockpuppet" or the "Sockpuppet API") is a service running in Kubernetes. It can be used to identify relative similarity between users on wikis. What it doeshttps://wikitech.wikimedia.org/wiki/Similarusers#What_it_does How it workshttps://wikitech.wikimedia.org/wiki/Similarusers#How_it_works Service Documentationhttps://wikitech.wikimedia.org/wiki/Similarusers#Service_Documentation Where it runshttps://wikitech.wikimedia.org/wiki/Similarusers#Where_it_runs Deployinghttps://wikitech.wikimedia.org/wiki/Similarusers#Deploying Testinghttps://wikitech.wikimedia.org/wiki/Similarusers#Testing How it's monitoredhttps://wikitech.wikimedia.org/wiki/Similarusers#How_it's_monitored Related pageshttps://wikitech.wikimedia.org/wiki/Similarusers#Related_pages https://wikitech.wikimedia.org/wiki/Mysql.py mysql.py is a wrapper around the mysql command line client from mariadb, which is tuned for WMF production admin convenience. Example usagehttps://wikitech.wikimedia.org/wiki/Mysql.py#Example_usage Developmenthttps://wikitech.wikimedia.org/wiki/Mysql.py#Development https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy = Kubernetes Infrastructure upgrade policy = Kubernetes Infrastructure upgrade policyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Kubernetes_Infrastructure_upgrade_policy Introductionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Introduction Problem statementhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Problem_statement Backgroundhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Background Kubernetes release cadence and supporthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Kubernetes_release_cadence_and_support Calico release cadence and supporthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Calico_release_cadence_and_support Helm release cadence and supporthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Helm_release_cadence_and_support Helmfile release cadence and supporthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Helmfile_release_cadence_and_support Problems with the upgrade processhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Problems_with_the_upgrade_process Policy proposalhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Policy_proposal Version choiceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Version_choices Using existing upstream binarieshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Using_existing_upstream_binaries Utilizing production builder hostshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Utilizing_production_builder_hosts Tracking component version requirementshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Infrastructure_upgrade_policy#Tracking_component_version_requirements https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post The Cloud Services team is planning to introduce new "push-to-deploy" functionality to Toolforge, a hosting platform (PaaS) for the Wikimedia movement. If you're not already familiar with it, Toolforge is used to perform analytics, administer bots, run webservices, and create tools. Historyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post#History Problemshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post#Problems Visionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post#Vision Enter buildpackshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post#Enter_buildpacks Statushttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post#Status Next stepshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_push_to_deploy/Blog_post#Next_steps https://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users/Gerrit Renaming users in Gerrit involves fiddling in git quite a bit since Gerrit uses git as a database. cn rename scripthttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users/Gerrit#cn_rename_script uid rename account scripthttps://wikitech.wikimedia.org/wiki/SRE/LDAP/Renaming_users/Gerrit#uid_rename_account_script https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42 == 2020-11-30 == 2020-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-30 2020-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-27 2020-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-26 2020-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-25 2020-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-24 2020-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-23 2020-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-21 2020-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-20 2020-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-19 2020-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-18 2020-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-17 2020-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-16 2020-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-15 2020-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-13 2020-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-12 2020-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-11 2020-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-10 2020-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-09 2020-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-08 2020-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-06 2020-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-05 2020-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-04 2020-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-03 2020-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-02 2020-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-11-01 2020-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-31 2020-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-30 2020-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-29 2020-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-28 2020-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-27 2020-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-26 2020-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-25 2020-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-23 2020-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-22 2020-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-21 2020-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-20 2020-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-19 2020-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-17 2020-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-16 2020-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-15 2020-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-14 2020-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-13 2020-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-12 2020-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-10 2020-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-09 2020-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-08 2020-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-07 2020-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-06 2020-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-05 2020-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-03 2020-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-02 2020-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-10-01 2020-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-30 2020-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-29 2020-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-28 2020-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-27 2020-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-26 2020-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-25 2020-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-24 2020-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-23 2020-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-22 2020-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-21 2020-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-20 2020-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-19 2020-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-18 2020-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-17 2020-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-16 2020-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-15 2020-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-14 2020-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-13 2020-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-12 2020-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-11 2020-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-10 2020-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-09 2020-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-08 2020-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-07 2020-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-06 2020-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-05 2020-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-04 2020-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-03 2020-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-02 2020-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-09-01 2020-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-31 2020-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-30 2020-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-29 2020-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-28 2020-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-27 2020-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-26 2020-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-25 2020-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-24 2020-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-23 2020-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-22 2020-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-21 2020-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-20 2020-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-19 2020-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-18 2020-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-17 2020-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-16 2020-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-15 2020-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-14 2020-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-13 2020-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-12 2020-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-11 2020-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-10 2020-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-09 2020-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-08 2020-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-07 2020-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-06 2020-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-05 2020-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-04 2020-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-03 2020-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_42#2020-08-01 https://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration#Summary Repercussionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration#Repercussions Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration#Timeline Post-mortemhttps://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration#Post-mortem Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration#Actionables More long-term solutionshttps://wikitech.wikimedia.org/wiki/Incidents/2020-12-02_netflow-hive-migration#More_long-term_solutions https://wikitech.wikimedia.org/wiki/Graphite1004 == Connecting == Connectinghttps://wikitech.wikimedia.org/wiki/Graphite1004#Connecting https://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old This is a documentation for developers for adding [features] to a Wikimedia wiki. For requesting these features as a community member, see [the Growth experiments on your wiki] instead. Preparationhttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old#Preparation Some time ahead...https://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old#Some_time_ahead... Server configuration (operations/mediawiki-config)https://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old#Server_configuration_(operations/mediawiki-config) Wiki configurationhttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old#Wiki_configuration Deploymenthttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old#Deployment Validation of translations (back-up from old docs)https://wikitech.wikimedia.org/wiki/GrowthExperiments_setup/Old#Validation_of_translations_(back-up_from_old_docs) https://wikitech.wikimedia.org/wiki/Phabricator/Slowness = Phabricator is Slow Troubleshooting = Phabricator is Slow Troubleshootinghttps://wikitech.wikimedia.org/wiki/Phabricator/Slowness#Phabricator_is_Slow_Troubleshooting Increased network traffichttps://wikitech.wikimedia.org/wiki/Phabricator/Slowness#Increased_network_traffic Apache Access Logshttps://wikitech.wikimedia.org/wiki/Phabricator/Slowness#Apache_Access_Logs Banning an IP or User-Agenthttps://wikitech.wikimedia.org/wiki/Phabricator/Slowness#Banning_an_IP_or_User-Agent https://wikitech.wikimedia.org/wiki/Maps/Maintenance = Maps maintenance = Maps maintenancehttps://wikitech.wikimedia.org/wiki/Maps/Maintenance#Maps_maintenance Known issueshttps://wikitech.wikimedia.org/wiki/Maps/Maintenance#Known_issues Maintenance activities responsibility and supporthttps://wikitech.wikimedia.org/wiki/Maps/Maintenance#Maintenance_activities_responsibility_and_support Application layerhttps://wikitech.wikimedia.org/wiki/Maps/Maintenance#Application_layer Infrastructurehttps://wikitech.wikimedia.org/wiki/Maps/Maintenance#Infrastructure https://wikitech.wikimedia.org/wiki/Services/Monitoring/tileratorui Tileratorui is a service that provides a management UI to the Tilerator service. This service being unavailable has no user-facing impact and will not affect maps as a product, but should be investigated as a potential sign of other issues. https://wikitech.wikimedia.org/wiki/Services/Monitoring/tilerator tilerator is a Maps service for generating map tiles from OSM data in postgres and then storing them in cassandra. The service being down could be an indication of issues with either postgres or with cassandra. https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator == The coordinator hosts == The coordinator hostshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator#The_coordinator_hosts Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator#Services an-coord1003https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator#an-coord1003 an-coord1004https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator#an-coord1004 Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator#Hive Failoverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Coordinator#Failover https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-01-12-checkin = 2021-01-12 WMCS network checkin = 2021-01-12 WMCS network checkinhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-01-12-checkin#2021-01-12_WMCS_network_checkin agendahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-01-12-checkin#agenda noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-01-12-checkin#notes https://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport There are types of changes that should be deployed via the train, types of changes that should be deployed via backport windows, and types of changes that should be deployed via dedicated deployment windows. This document is an attempt to codify the criteria used to determine the method by which a change should be deployed. Trainhttps://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport#Train Backports or Dedicated windowshttps://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport#Backports_or_Dedicated_windows https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation We currently use Puppet to automate most of our tasks, but it has it's limitations. We still need a tool to automate, collect and review all our operational procedures. Problem statementhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Problem_statement Proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Proposal Collaborationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Collaboration Structurehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Structure Cuminhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Cumin Wmflibhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Wmflib Spicerackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Spicerack Cookbookshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Cookbooks Execution of the cookbookshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Execution_of_the_cookbooks Local setuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Local_setup cookbook naming proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#cookbook_naming_proposal Notehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Operational_Automation#Note https://wikitech.wikimedia.org/wiki/API_Portal The API Portal is an API documentation and OAuth credential management wiki run by the Wikimedia Foundation. Terminologyhttps://wikitech.wikimedia.org/wiki/API_Portal#Terminology Permissionshttps://wikitech.wikimedia.org/wiki/API_Portal#Permissions Routinghttps://wikitech.wikimedia.org/wiki/API_Portal#Routing Adding an APIhttps://wikitech.wikimedia.org/wiki/API_Portal#Adding_an_API Self-service processhttps://wikitech.wikimedia.org/wiki/API_Portal#Self-service_process Architecturehttps://wikitech.wikimedia.org/wiki/API_Portal#Architecture Componentshttps://wikitech.wikimedia.org/wiki/API_Portal#Components Content strategyhttps://wikitech.wikimedia.org/wiki/API_Portal#Content_strategy Duplicationhttps://wikitech.wikimedia.org/wiki/API_Portal#Duplication User agents in exampleshttps://wikitech.wikimedia.org/wiki/API_Portal#User_agents_in_examples API key management and OAuth integrationhttps://wikitech.wikimedia.org/wiki/API_Portal#API_key_management_and_OAuth_integration Configurationhttps://wikitech.wikimedia.org/wiki/API_Portal#Configuration Navigationhttps://wikitech.wikimedia.org/wiki/API_Portal#Navigation Designhttps://wikitech.wikimedia.org/wiki/API_Portal#Design Content widthhttps://wikitech.wikimedia.org/wiki/API_Portal#Content_width Workflowhttps://wikitech.wikimedia.org/wiki/API_Portal#Workflow Skin and extension taskshttps://wikitech.wikimedia.org/wiki/API_Portal#Skin_and_extension_tasks Columnshttps://wikitech.wikimedia.org/wiki/API_Portal#Columns Priorities for bugs and technical issueshttps://wikitech.wikimedia.org/wiki/API_Portal#Priorities_for_bugs_and_technical_issues Local developmenthttps://wikitech.wikimedia.org/wiki/API_Portal#Local_development Workaroundshttps://wikitech.wikimedia.org/wiki/API_Portal#Workarounds Email confirmationhttps://wikitech.wikimedia.org/wiki/API_Portal#Email_confirmation Backgroundhttps://wikitech.wikimedia.org/wiki/API_Portal#Background Original scope (March 2020)https://wikitech.wikimedia.org/wiki/API_Portal#Original_scope_(March_2020) Original content strategy (March 2020)https://wikitech.wikimedia.org/wiki/API_Portal#Original_content_strategy_(March_2020) Organizationhttps://wikitech.wikimedia.org/wiki/API_Portal#Organization Outlinehttps://wikitech.wikimedia.org/wiki/API_Portal#Outline Content typeshttps://wikitech.wikimedia.org/wiki/API_Portal#Content_types Acceptance testing (November 2020)https://wikitech.wikimedia.org/wiki/API_Portal#Acceptance_testing_(November_2020) MVP validation (February 2021)https://wikitech.wikimedia.org/wiki/API_Portal#MVP_validation_(February_2021) Using OAuth clients created via Metahttps://wikitech.wikimedia.org/wiki/API_Portal#Using_OAuth_clients_created_via_Meta Using OAuth clients created via API Portalhttps://wikitech.wikimedia.org/wiki/API_Portal#Using_OAuth_clients_created_via_API_Portal Scope v2 (August 2021)https://wikitech.wikimedia.org/wiki/API_Portal#Scope_v2_(August_2021) Maintainershttps://wikitech.wikimedia.org/wiki/API_Portal#Maintainers Referenceshttps://wikitech.wikimedia.org/wiki/API_Portal#References https://wikitech.wikimedia.org/wiki/Klaxon |label3=Puppet classes FAQhttps://wikitech.wikimedia.org/wiki/Klaxon#FAQ What kinds of emergencies should I use Klaxon for?https://wikitech.wikimedia.org/wiki/Klaxon#What_kinds_of_emergencies_should_I_use_Klaxon_for? What shouldn't I use Klaxon for?https://wikitech.wikimedia.org/wiki/Klaxon#What_shouldn't_I_use_Klaxon_for? Who receives pages submitted to Klaxon?https://wikitech.wikimedia.org/wiki/Klaxon#Who_receives_pages_submitted_to_Klaxon? Who is allowed to send pages using Klaxon?https://wikitech.wikimedia.org/wiki/Klaxon#Who_is_allowed_to_send_pages_using_Klaxon? Should I ever put confidential data or sensitive information in Klaxon?https://wikitech.wikimedia.org/wiki/Klaxon#Should_I_ever_put_confidential_data_or_sensitive_information_in_Klaxon? Klaxon is hosted on Wikimedia infrastructure, and relies upon our [sign-on|SSO] service also hosted there – isn't that a problem?https://wikitech.wikimedia.org/wiki/Klaxon#Klaxon_is_hosted_on_Wikimedia_infrastructure,_and_relies_upon_our_[sign-on|SSO]_service_also_hosted_there_–_isn't_that_a_problem? Klaxon looks not entirely unlike a status page – should it be used for that purpose?https://wikitech.wikimedia.org/wiki/Klaxon#Klaxon_looks_not_entirely_unlike_a_status_page_–_should_it_be_used_for_that_purpose? Why do you keep talking about "pages" and "paging"?https://wikitech.wikimedia.org/wiki/Klaxon#Why_do_you_keep_talking_about_"pages"_and_"paging"? https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/12 ==Week of December 07== Week of December 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/12#Week_of_December_07 Week of December 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/12#Week_of_December_14 Week of December 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/12#Week_of_December_21 Week of December 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2020/12#Week_of_December_28 https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2021#By_month https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter The analytics clients include a hosted version of JupyterHub, allowing easy analysis of internal data using Jupyter notebooks. Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Access Prerequisiteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Prerequisites SSH tunnelhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#SSH_tunnel Logging inhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Logging_in Authenticating via Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Authenticating_via_Kerberos Querying datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Querying_data In Pythonhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#In_Python In Rhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#In_R Conda environmentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Conda_environments Installing packageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Installing_packages Sharing Notebookshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Sharing_Notebooks Copying files on the analytics clientshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Copying_files_on_the_analytics_clients GitHub or GitLabhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#GitHub_or_GitLab HTML fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#HTML_files Quartohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Quarto Nbviewerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Nbviewer Troubleshootinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Troubleshooting Trouble installing R packageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Trouble_installing_R_packages Browser disconnectshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Browser_disconnects Notebook is unresponsive, or kernel restarts when running a large queryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Notebook_is_unresponsive,_or_kernel_restarts_when_running_a_large_query Viewing Jupyter Notebook Server logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Viewing_Jupyter_Notebook_Server_logs Viewing JupyterHub logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Viewing_JupyterHub_logs "An error occurred while trying to connect to the Java server"https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#"An_error_occurred_while_trying_to_connect_to_the_Java_server" Tipshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Tips Sending emails from within a notebookhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Sending_emails_from_within_a_notebook Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Administration Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#References https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions These are conventions for Wikimedia diagrams in technical writing, as created using the [open-source software. In a nut shellhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#In_a_nut_shell Exampleshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Examples Stepshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Steps Create new diagramhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Create_new_diagram Load the "Lato" fonthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Load_the_"Lato"_font Save and share the diagramhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Save_and_share_the_diagram Export and upload to Wikimedia Commonshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Export_and_upload_to_Wikimedia_Commons Style referencehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Style_reference Text formathttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Text_format Shape formathttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Shape_format Arrow styleshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/diagrams.net_conventions#Arrow_styles https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43 == 2020-12-29 == 2020-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-29 2020-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-28 2020-12-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-24 2020-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-23 2020-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-22 2020-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-21 2020-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-18 2020-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-17 2020-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-16 2020-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-15 2020-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-14 2020-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-11 2020-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-10 2020-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-09 2020-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-08 2020-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-07 2020-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-05 2020-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-04 2020-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-03 2020-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-02 2020-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_43#2020-12-01 https://wikitech.wikimedia.org/wiki/SLO Service level objectives and service level indicators are [Site Reliability Engineering|SRE]'s primary tools for measuring reliability and tuning our priorities accordingly. Introductionhttps://wikitech.wikimedia.org/wiki/SLO#Introduction Service level indicatorshttps://wikitech.wikimedia.org/wiki/SLO#Service_level_indicators Service level objectiveshttps://wikitech.wikimedia.org/wiki/SLO#Service_level_objectives Error budgetshttps://wikitech.wikimedia.org/wiki/SLO#Error_budgets Why isn't the objective 100%?https://wikitech.wikimedia.org/wiki/SLO#Why_isn't_the_objective_100%? Published SLOshttps://wikitech.wikimedia.org/wiki/SLO#Published_SLOs Runbookhttps://wikitech.wikimedia.org/wiki/SLO#Runbook SLO reportinghttps://wikitech.wikimedia.org/wiki/SLO#SLO_reporting External linkshttps://wikitech.wikimedia.org/wiki/SLO#External_links https://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster == SLO Worksheet - etcd Main == SLO Worksheet - etcd Mainhttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#SLO_Worksheet_-_etcd_Main Servicehttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Architectural Hard Dependencieshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Hard_Dependencies Soft Dependencieshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Soft_Dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Request_Classes Service Level Indicators (SLI)https://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Service_Level_Indicators_(SLI) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#Service_Level_Objectives Referenceshttps://wikitech.wikimedia.org/wiki/SLO/etcd_main_cluster#References https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter/Administration = System Overview = System Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter/Administration#System_Overview conda-analyticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter/Administration#conda-analytics https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/01 ==Week of January 04== Week of January 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/01#Week_of_January_04 Week of January 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/01#Week_of_January_11 Week of January 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/01#Week_of_January_18 Week of January 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/01#Week_of_January_25 https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis This page describes a network change in the Cloud VPS service, which affects how processes running inside the cloud will reach WMF-hosted wiki services, including wikidata, commons, etc. What is changing ?https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#What_is_changing_? What is not changing ?https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#What_is_not_changing_? Timelinehttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#What_should_I_do? If you are a Cloud VPS project owner / userhttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#If_you_are_a_Cloud_VPS_project_owner_/_user If you are a Toolforge developer / userhttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#If_you_are_a_Toolforge_developer_/_user If you are a CheckUserhttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#If_you_are_a_CheckUser If you are a WMF engineer or SRE involved with the wikishttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#If_you_are_a_WMF_engineer_or_SRE_involved_with_the_wikis Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#Solutions_to_common_problems Tools with restricted Oauth or passwordhttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#Tools_with_restricted_Oauth_or_password MediaWiki has a strict limit on bad loginshttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#MediaWiki_has_a_strict_limit_on_bad_logins NAT overflowhttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#NAT_overflow Why are we doing this?https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#Why_are_we_doing_this? See alsohttps://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis#See_also https://wikitech.wikimedia.org/wiki/Bast3005 bast3005 was the main bastion for the Esams cluster. It replaced bast3004 per [and was in turn replaced by bast3006] ([Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast3005#Services https://wikitech.wikimedia.org/wiki/Bast4003 bast4003 is a bastion for Ulsfo. It replaced bast4002 per [It was replaced by bast4004] per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast4003#Services https://wikitech.wikimedia.org/wiki/Bast5002 bast5002 is the main bastion for Eqsin. It replaced bast5001 per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast5002#Services https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-03-checkin = 2021-02-03 WMCS network checkin = 2021-02-03 WMCS network checkinhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-03-checkin#2021-02-03_WMCS_network_checkin agendahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-03-checkin#agenda noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-03-checkin#notes cloudVPS NAThttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-03-checkin#cloudVPS_NAT wiki replicashttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-03-checkin#wiki_replicas https://wikitech.wikimedia.org/wiki/Add_Link/Diagram:_Fetching_and_completing_link_recommendation_tasks Compatible with https://sequencediagram.org https://wikitech.wikimedia.org/wiki/Add_Link/Datasets We publish datasets needed to run the link recommendation service to Datasets.wikimedia. Downloading the datasetshttps://wikitech.wikimedia.org/wiki/Add_Link/Datasets#Downloading_the_datasets https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs This page contains information on a potential design to support grid-like jobs on Toolforge kubernetes, the end goal being to help in GridEngine deprecation. Proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Proposal The two components approachhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#The_two_components_approach k8s abstraction that matches GridEngine experiencehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#k8s_abstraction_that_matches_GridEngine_experience Authhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Auth Not using the frameworkhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Not_using_the_framework The containers problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#The_containers_problem Implementation detailshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Implementation_details timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#timeline about logshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#about_logs URLhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#URL Feature mappinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Feature_mapping API docshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#API_docs POST /api/v1/run/https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#POST_/api/v1/run/ GET /api/v1/show/{name}/https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#GET_/api/v1/show/{name}/ DELETE /api/v1/delete/{name}https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#DELETE_/api/v1/delete/{name} GET /api/v1/list/https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#GET_/api/v1/list/ DELETE /api/v1/flush/https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#DELETE_/api/v1/flush/ GET /api/v1/containers/https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#GET_/api/v1/containers/ Ingress & TLShttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Ingress_&_TLS in kubernetes 1.17https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#in_kubernetes_1.17 in kubernetes 1.18https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#in_kubernetes_1.18 Developmenthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#Development notes on k8s objectshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#notes_on_k8s_objects development environmenthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#development_environment source codehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#source_code See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs#See_also https://wikitech.wikimedia.org/wiki/Klaxon/Administration == Development and deployment == Development and deploymenthttps://wikitech.wikimedia.org/wiki/Klaxon/Administration#Development_and_deployment VictorOps integrationhttps://wikitech.wikimedia.org/wiki/Klaxon/Administration#VictorOps_integration Noteshttps://wikitech.wikimedia.org/wiki/Klaxon/Administration#Notes https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#What_happens_when_a_project_is_not_marked_as_active Further clueshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#Further_clues Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#Projects_and_Instances account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#account-creation-assistance adminhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#admin admin-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#admin-monitoring analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#analytics annotationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#annotation antiharassmenthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#antiharassment auditlogginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#auditlogging automation-frameworkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#automation-framework bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#bastion capacity-exchangehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#capacity-exchange centralnotice-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#centralnotice-staging chathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#chat citelearnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#citelearn clouddb-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#clouddb-services cloudinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#cloudinfra cloudinfra-nfshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#cloudinfra-nfs cloudstorehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#cloudstore cloudvirt-canaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#cloudvirt-canary codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#codereview codesearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#codesearch collection-alt-rendererhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#collection-alt-renderer commons-corruption-checkerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#commons-corruption-checker commonsarchivehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#commonsarchive commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#commtech community-labs-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#community-labs-monitoring cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#cvn cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#dashiki data-engineeringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#data-engineering dbbackups-dashboardhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#dbbackups-dashboard deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#deployment-prep devtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#devtools discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#discourse downloadhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#download dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#dwl entity-detectionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#entity-detection etytreehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#etytree eventmetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#eventmetrics extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#fastcci fr-tech-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#fr-tech-dev getstartedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#getstarted gitlab-runnershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#gitlab-runners gitlab-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#gitlab-test glampipehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#glampipe globalcuhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#globalcu globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#google-api-proxy graphqlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#graphql gratitudehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#gratitude hashtagshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#hashtags hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#huggle huwiki-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#huwiki-dev iiabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#iiab image-suggestion-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#image-suggestion-api incubatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#incubator integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#integration ircwebchathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#ircwebchat k8splayhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#k8splay languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#language library-upgraderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#library-upgrader linkwatcherhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#linkwatcher logginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#logging lta-trackerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#lta-tracker machine-learninghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#machine-learning mailmanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mailman mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#maps maps-experimentshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#maps-experiments mariadb104-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mariadb104-test maszhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#masz mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#math matrixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#matrix mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mediawiki-vagrant meethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#meet metricsinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#metricsinfra mix-n-matchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mix-n-match mobilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mobile monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#monitoring mwclihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mwcli mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mwoffliner mwstakehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mwstake mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#mwv-apt observerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#observer ocrtoyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#ocrtoy openocrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#openocr openrefinehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#openrefine openstackhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#openstack still (unfortunately) oreshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#still_(unfortunately)_ores still (unfortunately) ores-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#still_(unfortunately)_ores-staging osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#osmit packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#packaging packagist-mirrorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#packagist-mirror pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#paws petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#petscan pipelinelib-experimentalhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#pipelinelib-experimental pkihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#pki pluggableauthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#pluggableauth policy-test-projecthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#policy-test-project privpol-captchahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#privpol-captcha project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#project-proxy puppet-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#puppet-dev puppet-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#puppet-diffs pushhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#push quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#quarry rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#rcm recommendation-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#recommendation-api redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#redirects redwarnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#redwarn research-collaborations-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#research-collaborations-api schematreerecommenderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#schematreerecommender sciencesourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#sciencesource searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#search security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#security-tools sentryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#sentry serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#services shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#signwriting snugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#snuggle soweegohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#soweego spi-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#spi-tools sre-sandboxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#sre-sandbox ssohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#sso strikerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#striker suggestbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#suggestbot swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#swift testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#testlabs thumborhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#thumbor toolhubhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#toolhub toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#toolsbeta traffichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#traffic trovehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#trove twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#twl utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#utrs videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#video videocuttoolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#videocuttool videowikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#videowiki visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#visualeditor wcdohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wcdo webperfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#webperf wikiapiaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikiapiary wikibase-registryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikibase-registry wikicitehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikicite wikicommunityhealthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikicommunityhealth wikidata-autodeschttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidata-autodesc wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidata-dev wikidata-history-query-servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidata-history-query-service wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidata-query wikidata-realtime-dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidata-realtime-dumps wikidocumentarieshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidocumentaries wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikidumpparse wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikilabels wikilearnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikilearn wikilinkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikilink wikiloophttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikiloop wikinewsiehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikinewsie wikipathwayshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikipathways wikisourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikisource wikisphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikisp wikispeechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikispeech wikisporehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikispore wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikistats wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikitextexp wikiwhohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wikiwho wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wildcat wm-bothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wm-bot wmcz-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wmcz-stats wmde-dashboardshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wmde-dashboards wmde-templates-alphahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wmde-templates-alpha wmf-research-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wmf-research-tools wmflabsdotorghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#wmflabsdotorg xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge#xtools https://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021 == Observations of differences between MediaWiki servers on stretch vs buster, before and after , January 2021 == Observations of differences between MediaWiki servers on stretch vs buster, before and after , January 2021https://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Observations_of_differences_between_MediaWiki_servers_on_stretch_vs_buster,_before_and_after_,_January_2021 TCP errorshttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#TCP_errors Are there more TCP errors ?https://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Are_there_more_TCP_errors_? No, not reallyhttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#No,_not_really disk utilizationhttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#disk_utilization Did disk utilization go up ?https://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Did_disk_utilization_go_up_? No, seems like spikes are unrelatedhttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#No,_seems_like_spikes_are_unrelated performance (avg response time)https://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#performance_(avg_response_time) Is it actually getting slower?https://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Is_it_actually_getting_slower? Compare another set of servershttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Compare_another_set_of_servers Apphttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#App APIhttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#API Let's check the same hardware before and afterhttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Let's_check_the_same_hardware_before_and_after Beforehttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#Before Afterhttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#After sourceshttps://wikitech.wikimedia.org/wiki/Appserver-buster-upgrade-2021#sources https://wikitech.wikimedia.org/wiki/Incidents/2021-02-01_swift-codfw == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-01_swift-codfw#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-01_swift-codfw#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar Below is an extended forecast for the days on which deployment slots on the calendar won't be made and weeks in which the deployment train will not run. Calendarhttps://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar#Calendar https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts __FORCETOC__ HDFS Namenode RPC length queuehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Namenode_RPC_length_queue HDFS topology checkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_topology_check No active HDFS Namenode runninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#No_active_HDFS_Namenode_running HDFS FSImage too oldhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_FSImage_too_old HDFS corrupt blockshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_corrupt_blocks HDFS missing blockshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_missing_blocks HDFS total files and heap sizehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_total_files_and_heap_size HDFS Capacity Remaininghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Capacity_Remaining Paginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Paging Criticalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Critical Warninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Warning Unhealthy Yarn Nodemanagershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Unhealthy_Yarn_Nodemanagers HDFS Namenode backup agehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Namenode_backup_age HDFS Namenode processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Namenode_process HDFS ZKFC processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_ZKFC_process HDFS Datanode processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Datanode_process Checking status of individual Datanodeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Checking_status_of_individual_Datanodes HDFS Datanode JVM Heap Usagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Datanode_JVM_Heap_Usage HDFS Journalnode processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#HDFS_Journalnode_process Yarn Resourcemanager processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Yarn_Resourcemanager_process Yarn Nodemanager processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Yarn_Nodemanager_process Yarn Nodemanager JVM Heap Usagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Yarn_Nodemanager_JVM_Heap_Usage Mapreduce Historyserver processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop/Alerts#Mapreduce_Historyserver_process https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop == Workshop Modules == Workshop Moduleshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Workshop_Modules Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Overview Getting Startedhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Getting_Started Setting Uphttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Setting_Up Workshop Outlinehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Workshop_Outline Previous Workhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Previous_Work Additional Resourceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop#Additional_Resources https://wikitech.wikimedia.org/wiki/Network_Error_Logging == Intro == Introhttps://wikitech.wikimedia.org/wiki/Network_Error_Logging#Intro Dashboardshttps://wikitech.wikimedia.org/wiki/Network_Error_Logging#Dashboards Serving the necessary response headershttps://wikitech.wikimedia.org/wiki/Network_Error_Logging#Serving_the_necessary_response_headers Our report receiver implementationhttps://wikitech.wikimedia.org/wiki/Network_Error_Logging#Our_report_receiver_implementation https://wikitech.wikimedia.org/wiki/Cinder Cinder is a Block Storage service for OpenStack. It virtualizes the management of block storage devices and provides end users with a self service API to request and consume those resources without requiring any knowledge of where their storage is actually deployed or on what type of device. See alsohttps://wikitech.wikimedia.org/wiki/Cinder#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/02 ==Week of February 01== Week of February 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/02#Week_of_February_01 Week of February 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/02#Week_of_February_08 Week of February 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/02#Week_of_February_15 Week of February 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/02#Week_of_February_22 https://wikitech.wikimedia.org/wiki/Standalone-slapd Setup an openldap instance which mimics what is being used in production in cloud VPS Installationhttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Installation Enabling the memberof overlayhttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Enabling_the_memberof_overlay Add default OUshttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Add_default_OUs Add the custom schemas used in production:https://wikitech.wikimedia.org/wiki/Standalone-slapd#Add_the_custom_schemas_used_in_production: Create a userhttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Create_a_user Delete a userhttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Delete_a_user Modifying an attributehttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Modifying_an_attribute Adding a grouphttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Adding_a_group Searching in LDAPhttps://wikitech.wikimedia.org/wiki/Standalone-slapd#Searching_in_LDAP https://wikitech.wikimedia.org/wiki/Dumps/SQL-XML_Dumps/Swapping_NFS_servers Sometimes you may want to swap the primary and fallback NFS servers for the XML/SQL dumps. If they are both operational, here is the procedure used to do it. https://wikitech.wikimedia.org/wiki/Incidents/2021-01-16_appserver_latency == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-01-16_appserver_latency#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-01-16_appserver_latency#Actionables https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Manual_maintenance This page describes the maintenance tasks that are currently manual. This page is not meant to be a documentation but rather track the actions done/required by members of the [Search Platform] team. Workaround for missing deletes in the current updaterhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Manual_maintenance#Workaround_for_missing_deletes_in_the_current_updater Streaming updater: test with wdqs1009https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Manual_maintenance#Streaming_updater:_test_with_wdqs1009 How to recover ithttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Manual_maintenance#How_to_recover_it How to stop ithttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Manual_maintenance#How_to_stop_it Downstream consumer (wdqs1009)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Manual_maintenance#Downstream_consumer_(wdqs1009) https://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema The Observability team embarked on a project to adopt a Common Logging Schema in 2020. After evaluating options, the Observability team determined that adopting the Elastic Common Schema (ECS) had the best chance of success with the lowest barrier to entry. Goalshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Goals Rationalehttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Rationale Documentationhttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Documentation Generating ECS-compliant Eventshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Generating_ECS-compliant_Events Required Fieldshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Required_Fields Migration Processhttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Migration_Process Featureshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Features Timestamphttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Timestamp Dot-Expansionhttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Dot-Expansion Type field removalhttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Type_field_removal Grok failureshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Grok_failures Allow only ECS top-level fieldshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Allow_only_ECS_top-level_fields Dropped fields trackinghttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Dropped_fields_tracking Planned Featureshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Planned_Features Level Normalizationhttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Level_Normalization Maintenancehttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Maintenance Deploying an updated schemahttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Deploying_an_updated_schema Deploying a new version of ECShttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#Deploying_a_new_version_of_ECS Referenceshttps://wikitech.wikimedia.org/wiki/Logstash/Common_Logging_Schema#References https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-24-checkin = 2021-02-24 WMCS network checkin = 2021-02-24 WMCS network checkinhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-24-checkin#2021-02-24_WMCS_network_checkin agendahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-24-checkin#agenda noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh/2021-02-24-checkin#notes https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_1 == Step 1 Outcomes == Step 1 Outcomeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_1#Step_1_Outcomes Step 1 - Run a batch application on k8shttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_1#Step_1_-_Run_a_batch_application_on_k8s Hands-on: download or code the application and run it locally.https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_1#Hands-on:_download_or_code_the_application_and_run_it_locally. Hands-on: run the application under dockerhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_1#Hands-on:_run_the_application_under_docker Hands-on: Run the application under Minikubehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_1#Hands-on:_Run_the_application_under_Minikube https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2 == Step 2 Outcomes == Step 2 Outcomeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2#Step_2_Outcomes Step 2 - Run a service application on k8shttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2#Step_2_-_Run_a_service_application_on_k8s Hands on: Make a docker image that serves a simple “Hello World” webpage.https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2#Hands_on:_Make_a_docker_image_that_serves_a_simple_“Hello_World”_webpage. Hands-on: make a Dockerfile for apachehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2#Hands-on:_make_a_Dockerfile_for_apache Hands-on: run service on minikubehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2#Hands-on:_run_service_on_minikube Hands-on: more replicas on minikubehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_2#Hands-on:_more_replicas_on_minikube https://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines This page contains information related to the production and cloud public network & realms relationship, policies, guidelines and best practices for planning new services and for when reworking old ones. Case 1: general casehttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#Case_1:_general_case requirementshttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#requirements example: toolsdbhttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_toolsdb example: cloudinfrahttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_cloudinfra Case 2: generic network access cloud --> prodhttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#Case_2:_generic_network_access_cloud_-->_prod example: dumpshttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_dumps example: wikishttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_wikis Case 3: generic network access prod --> cloudhttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#Case_3:_generic_network_access_prod_-->_cloud example: puppet catalog compilerhttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_puppet_catalog_compiler example: SALhttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_SAL Case 4: cloud-dedicated hardwarehttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#Case_4:_cloud-dedicated_hardware example: openstack native serviceshttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#example:_openstack_native_services See alsohttps://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Service_predictions_for_cross_realm_situation This page contains information and some predictions on how cloud-related services will go when we migrate them for compliance with the Cross-Realm_traffic_guidelines. See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Service_predictions_for_cross_realm_situation#See_also https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3 == Step 3 Outcomes== Step 3 Outcomeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3#Step_3_Outcomes Step 3: Infrastructure as Code in K8s - YAMLhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3#Step_3:_Infrastructure_as_Code_in_K8s_-_YAML Hands-on: run the wpchksumbot via YAMLhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3#Hands-on:_run_the_wpchksumbot_via_YAML Hands-on: cronjob wpchksumbothttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3#Hands-on:_cronjob_wpchksumbot Hands-on: a simple web serverhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3#Hands-on:_a_simple_web_server Hands-on: a load balanced, database backed servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_3#Hands-on:_a_load_balanced,_database_backed_service https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_4 == Step 4: More on YAML and scale == Step 4: More on YAML and scalehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_4#Step_4:_More_on_YAML_and_scale Hands-on: Horizontal Pod Autoscaling (HPA)https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_4#Hands-on:_Horizontal_Pod_Autoscaling_(HPA) Hands-on: checking YAMLhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_4#Hands-on:_checking_YAML Hands-on: the dashboard and Lenshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_4#Hands-on:_the_dashboard_and_Lens https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_5 == Step 5: Configurations == Step 5: Configurationshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_5#Step_5:_Configurations Hands-on: refactor variables/secrets from the bookapphttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_5#Hands-on:_refactor_variables/secrets_from_the_bookapp https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6 == Step 6: A “real” cluster == Step 6: A “real” clusterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Step_6:_A_“real”_cluster Hands-on: create a cluster with kubesprayhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_create_a_cluster_with_kubespray Hands-on: run a simple workloadhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_run_a_simple_workload Hands-on: run a simple service workloadhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_run_a_simple_service_workload Hands-on: Browser access to our servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_Browser_access_to_our_service Hands-on: use kubectl locallyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_use_kubectl_locally Hands-on: use kubectl locally with Floating IPshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_use_kubectl_locally_with_Floating_IPs Hands-on: use Google’s Google Kubernetes Engine (GKE)https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_6#Hands-on:_use_Google’s_Google_Kubernetes_Engine_(GKE) https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_7 == Step 7: Packages == Step 7: Packageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_7#Step_7:_Packages Hands-on: tag different builds of the simpleapache applicationhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_7#Hands-on:_tag_different_builds_of_the_simpleapache_application Hands-on: helm for simpleapachehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_7#Hands-on:_helm_for_simpleapache Hands-on: helm on the bookapphttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_7#Hands-on:_helm_on_the_bookapp https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_8 == Step 8: K8s Manageability and Security == Step 8: K8s Manageability and Securityhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_8#Step_8:_K8s_Manageability_and_Security Hands-on: Container image updateshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_8#Hands-on:_Container_image_updates Hands-on: Run the container as non-roothttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_8#Hands-on:_Run_the_container_as_non-root Hands-on: Namespaceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_8#Hands-on:_Namespaces https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_9 == Step 9: Wikimedia Foundation Style Kubernetes == Step 9: Wikimedia Foundation Style Kuberneteshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_9#Step_9:_Wikimedia_Foundation_Style_Kubernetes Hands-on: The Blubber Tutorial - https://wikitech.wikimedia.org/wiki/Blubber/Tutorialhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_9#Hands-on:_The_Blubber_Tutorial_-_https://wikitech.wikimedia.org/wiki/Blubber/Tutorial Hands-on: Running on minikubehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_9#Hands-on:_Running_on_minikube Hands-on: The Deployment Pipeline Tutorial - https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorialhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_9#Hands-on:_The_Deployment_Pipeline_Tutorial_-_https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Tutorial https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing#Overview Remote Testing with k6.iohttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing#Remote_Testing_with_k6.io Assessing Baseline Metricshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing#Assessing_Baseline_Metrics Local Testing with k6.iohttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing#Local_Testing_with_k6.io Output Analysishttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing#Output_Analysis Appendix:https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Load_Testing#Appendix: https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10 == Step 10: Running your own service under WMF Kubernetes == Step 10: Running your own service under WMF Kuberneteshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Step_10:_Running_your_own_service_under_WMF_Kubernetes Hands-on: download and testhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_download_and_test Hands-on: dockerizehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_dockerize test session startshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#test_session_starts 9 passed in 0.05shttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#9_passed_in_0.05s Hands-on: WMF dockerizehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_WMF_dockerize Hands-on: Get the code into the WMF Deployment Pipelinehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_Get_the_code_into_the_WMF_Deployment_Pipeline 4 passed in 0.12 secondshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#4_passed_in_0.12_seconds Hands-on: improve the testinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_improve_the_testing 9 passed in 0.12 secondshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#9_passed_in_0.12_seconds Hands-on: get the image into the production repository and test ithttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_get_the_image_into_the_production_repository_and_test_it Hands-on: Security Reviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_Security_Review Hands-on: Configuring helm for production releaseshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_Configuring_helm_for_production_releases Hands-on: Create a helmfilehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Step_10#Hands-on:_Create_a_helmfile https://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG This guide will explain how to create a new DAG that uses Pyspark for its tasks. It's not the only way - you can define JVM based tasks too - see airflow/dags/glent_weekly. Create a task definitionhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Create_a_task_definition Implementationhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Implementation Testshttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Tests Create a DAG definitionhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Create_a_DAG_definition Implementation and configurationhttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Implementation_and_configuration Testinghttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Testing Deploymenthttps://wikitech.wikimedia.org/wiki/Discovery/Analytics/Creating_a_new_DAG#Deployment https://wikitech.wikimedia.org/wiki/Translations:How_to_contribute/Page_display_title/en How to contribute https://wikitech.wikimedia.org/wiki/Client_errors The mw-client-error dashboard in Logstash gives an overview of JavaScript errors occurring in the MediaWiki software across deployed wikis. Error logging is currently enabled for all Wikipedia sites, Wikidata, MediaWiki and the beta cluster and test instances. Alertshttps://wikitech.wikimedia.org/wiki/Client_errors#Alerts Debugging errorshttps://wikitech.wikimedia.org/wiki/Client_errors#Debugging_errors Finding the source of the error using file urlhttps://wikitech.wikimedia.org/wiki/Client_errors#Finding_the_source_of_the_error_using_file_url Finding the source of the error using stack tracehttps://wikitech.wikimedia.org/wiki/Client_errors#Finding_the_source_of_the_error_using_stack_trace Debugging generic stack traceshttps://wikitech.wikimedia.org/wiki/Client_errors#Debugging_generic_stack_traces Using user agenthttps://wikitech.wikimedia.org/wiki/Client_errors#Using_user_agent Using messagehttps://wikitech.wikimedia.org/wiki/Client_errors#Using_message Using URL and user identifier (session id/IP)https://wikitech.wikimedia.org/wiki/Client_errors#Using_URL_and_user_identifier_(session_id/IP) Fixing errorshttps://wikitech.wikimedia.org/wiki/Client_errors#Fixing_errors Infrastructurehttps://wikitech.wikimedia.org/wiki/Client_errors#Infrastructure https://wikitech.wikimedia.org/wiki/PKI/CA_Operations The root CA is an offline signing CA. The root key is only stored on the root ca server and in (TODO: some offline location). Intermediate Certificateshttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Intermediate_Certificates Adding a new intermediatehttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Adding_a_new_intermediate Renewing a new intermediatehttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Renewing_a_new_intermediate Signing Profileshttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Signing_Profiles Adding a new signing profilehttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Adding_a_new_signing_profile Revoking certificateshttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Revoking_certificates OCSPhttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#OCSP New server/HW refreshhttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#New_server/HW_refresh Alt DNS nameshttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Alt_DNS_names Boot strappinghttps://wikitech.wikimedia.org/wiki/PKI/CA_Operations#Boot_strapping https://wikitech.wikimedia.org/wiki/Incidents/2021-02-26_sudo == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-26_sudo#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-26_sudo#Timeline Cleanup GMailhttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-26_sudo#Cleanup_GMail Remediation considerationshttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-26_sudo#Remediation_considerations Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-26_sudo#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-02-05_wmflabs_certs_expired ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-05_wmflabs_certs_expired#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-02-05_wmflabs_certs_expired#Actionables https://wikitech.wikimedia.org/wiki/Maps/Tilerator Tilerator has been deprecated in favour of Tegola Map Tile Pre-Generation Service for Maps/Kartotherianhttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Map_Tile_Pre-Generation_Service_for_Maps/Kartotherian Configurationhttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Configuration Single index concepthttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Single_index_concept Monitoring Jobshttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Monitoring_Jobs Job auto-balancinghttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Job_auto-balancing Adding jobshttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Adding_jobs Job Parametershttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Job_Parameters Pyramid modehttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Pyramid_mode Parsing updates filehttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Parsing_updates_file Job Filtershttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Job_Filters Queue cleanup and rebalancinghttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Queue_cleanup_and_rebalancing Copying source infohttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Copying_source_info Viewing and dynamically changes sourceshttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Viewing_and_dynamically_changes_sources Viewing defined variableshttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Viewing_defined_variables Using the tileshell shell scripthttps://wikitech.wikimedia.org/wiki/Maps/Tilerator#Using_the_tileshell_shell_script https://wikitech.wikimedia.org/wiki/PKI/Policy == ROOT CA == ROOT CAhttps://wikitech.wikimedia.org/wiki/PKI/Policy#ROOT_CA Certificate Parametershttps://wikitech.wikimedia.org/wiki/PKI/Policy#Certificate_Parameters Intermediate CAhttps://wikitech.wikimedia.org/wiki/PKI/Policy#Intermediate_CA When to create a new intermediate CAhttps://wikitech.wikimedia.org/wiki/PKI/Policy#When_to_create_a_new_intermediate_CA certificate parameters (defaults)https://wikitech.wikimedia.org/wiki/PKI/Policy#certificate_parameters_(defaults) Default signing policieshttps://wikitech.wikimedia.org/wiki/PKI/Policy#Default_signing_policies OCSP profilehttps://wikitech.wikimedia.org/wiki/PKI/Policy#OCSP_profile Server profilehttps://wikitech.wikimedia.org/wiki/PKI/Policy#Server_profile OCSP Responderhttps://wikitech.wikimedia.org/wiki/PKI/Policy#OCSP_Responder CA Bundleshttps://wikitech.wikimedia.org/wiki/PKI/Policy#CA_Bundles https://wikitech.wikimedia.org/wiki/PKI/Clients We currently use CFSSL to provide and manage PKI solutions. Clients are able to make use of the CFSSL API endpoint available at https://pki. Puppet integrationhttps://wikitech.wikimedia.org/wiki/PKI/Clients#Puppet_integration Creating certificateshttps://wikitech.wikimedia.org/wiki/PKI/Clients#Creating_certificates profile::pki::get_certhttps://wikitech.wikimedia.org/wiki/PKI/Clients#profile::pki::get_cert Hierahttps://wikitech.wikimedia.org/wiki/PKI/Clients#Hiera Puppethttps://wikitech.wikimedia.org/wiki/PKI/Clients#Puppet Proxy Signinghttps://wikitech.wikimedia.org/wiki/PKI/Clients#Proxy_Signing CLI Interactionshttps://wikitech.wikimedia.org/wiki/PKI/Clients#CLI_Interactions Kubernetes Integrationhttps://wikitech.wikimedia.org/wiki/PKI/Clients#Kubernetes_Integration https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/03 ==Week of March 01== Week of March 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/03#Week_of_March_01 Week of March 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/03#Week_of_March_08 Week of March 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/03#Week_of_March_15 Week of March 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/03#Week_of_March_22 Week of March 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/03#Week_of_March_29 https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization This page describes the event sanitization processes used with Event Platform data for retaining certain event data in Hive beyond the 90 day retention period per WMF's [Policy] and [retention guidelines|Data Retention Guidelines]. Data retentionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#Data_retention Hivehttps://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#Hive Hive event sanitization jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#Hive_event_sanitization_job Allowlistshttps://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#Allowlists Modifying the allowlisthttps://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#Modifying_the_allowlist F.A.Q.https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#F.A.Q. What is the default purging strategy for new schemas?https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#What_is_the_default_purging_strategy_for_new_schemas? Should I allowlist all fields of my schema every time I modify it?https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#Should_I_allowlist_all_fields_of_my_schema_every_time_I_modify_it? When are allowlist changes effective?https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#When_are_allowlist_changes_effective? If I add a new field to an existing schema, what will happen?https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#If_I_add_a_new_field_to_an_existing_schema,_what_will_happen? If I remove fields from my schema, should I remove them from the allowlist?https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#If_I_remove_fields_from_my_schema,_should_I_remove_them_from_the_allowlist? What happens when I rename fields in a schema?https://wikitech.wikimedia.org/wiki/Data_Platform/Event_Sanitization#What_happens_when_I_rename_fields_in_a_schema? https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation Incident response | Dashboards | Runbooks | Architecture | User guides Data Persistencehttps://wikitech.wikimedia.org/wiki/Category:Data_Persistence https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Databases/Runbooks https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Databases/Architecture https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Databases/User_guides https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Databases Category:Data Persistence Data Persistencehttps://wikitech.wikimedia.org/wiki/Category:Data_Persistence https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Backups/Runbooks https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Backups/Architecture You may also be interested in: https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Backups Main Phabricator project: https://wikitech.wikimedia.org/wiki/PKI/Cloud At the time of writing there is no central cloud PKI service however there is a pki project which is intended to be used in development environments and tries to mimic the behaviour of the pki service in production. In order to make changes to this project you will need to either ask one of the project admins or be an admin yourself. Adding a new project to pki-intermediatehttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Adding_a_new_project_to_pki-intermediate Adding the auth key to the projecthttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Adding_the_auth_key_to_the_project Authorising puppet agents for a specific projecthttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Authorising_puppet_agents_for_a_specific_project Using the pki servicehttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Using_the_pki_service Creating new intermediate CA'shttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Creating_new_intermediate_CA's Debugginghttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Debugging Create your Own cloud PKI instancehttps://wikitech.wikimedia.org/wiki/PKI/Cloud#Create_your_Own_cloud_PKI_instance https://wikitech.wikimedia.org/wiki/Metrics_Platform The Metrics Platform (MP) is a suite of tools that helps Wikimedia teams make data-driven decisions about product experiences. You can use the Metrics Platform to create instrumentation that captures click rates, conversion rates, and other metrics. Workflowshttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Workflows Guideshttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Guides Templateshttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Templates API docshttps://wikitech.wikimedia.org/wiki/Metrics_Platform#API_docs Referencehttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Reference Metahttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Meta Metrics Platform maintainer documentationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Metrics_Platform_maintainer_documentation Decision recordshttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Decision_records Supporthttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Support Contributinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Contributing Abouthttps://wikitech.wikimedia.org/wiki/Metrics_Platform#About When to use Metrics Platformhttps://wikitech.wikimedia.org/wiki/Metrics_Platform#When_to_use_Metrics_Platform Backgroundhttps://wikitech.wikimedia.org/wiki/Metrics_Platform#Background All pageshttps://wikitech.wikimedia.org/wiki/Metrics_Platform#All_pages https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New = Intro = Introhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Intro Versionshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Versions Prerequisiteshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Prerequisites helmfile.d structurehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#helmfile.d_structure File calico-values.yamlhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#File_calico-values.yaml File coredns-values.yamlhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#File_coredns-values.yaml File cfssl-issuer-values.yamlhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#File_cfssl-issuer-values.yaml Componentshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Components PKI intermediateshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#PKI_intermediates etcdhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#etcd Control-planehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Control-plane Servershttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Servers Puppet/hierahttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Puppet/hiera LVShttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#LVS Node (worker)https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Node_(worker) Noteshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Notes General Puppet/hiera setuphttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#General_Puppet/hiera_setup Access to restricted docker imageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Access_to_restricted_docker_images Adding Nodeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Adding_Nodes Apply RBAC rules and PSPshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Apply_RBAC_rules_and_PSPs Label Kubernetes Mastershttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Label_Kubernetes_Masters Namespaceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Namespaces Networkinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Networking Network sidehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Network_side Calico node/controllershttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Calico_node/controllers Puppethttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Puppet Cluster toolshttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Cluster_tools CoreDNShttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#CoreDNS Eventrouterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Eventrouter Istiohttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Istio cert-managerhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#cert-manager Prometheushttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#Prometheus LVM creationhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/New#LVM_creation https://wikitech.wikimedia.org/wiki/SRE/Traffic We are a remote-first, globally distributed team responsible for designing and operating a private and privacy-protecting global CDN for Wikipedia and related sister projects. Our Traffic stack handles public DNS, global request routing, TLS termination, HTTP content caching, and internal service routing for the public services of the Foundation, and is a critical layer in bringing our free content to our global audiences. What we ownhttps://wikitech.wikimedia.org/wiki/SRE/Traffic#What_we_own https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Responsibilities The Infrastructure Foundations (I/F) team focuses on building and maintaining our base platform (“metal cloud”) that forms the foundations upon which nearly everything else in our infrastructure builds upon. Responsibilitieshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Responsibilities#Responsibilities https://wikitech.wikimedia.org/wiki/GitLab |left|right}}:13px; margin:|5px 12px 5px 0|5px 0 5px 12px}}; width: 350px; Import code to GitLabhttps://wikitech.wikimedia.org/wiki/GitLab#Import_code_to_GitLab GitLab instanceshttps://wikitech.wikimedia.org/wiki/GitLab#GitLab_instances Configuring and customizing the GitLab instancehttps://wikitech.wikimedia.org/wiki/GitLab#Configuring_and_customizing_the_GitLab_instance GitLab runnershttps://wikitech.wikimedia.org/wiki/GitLab#GitLab_runners Network topologyhttps://wikitech.wikimedia.org/wiki/GitLab#Network_topology SSH fingerprintshttps://wikitech.wikimedia.org/wiki/GitLab#SSH_fingerprints How to create or migrate a repo / group / projecthttps://wikitech.wikimedia.org/wiki/GitLab#How_to_create_or_migrate_a_repo_/_group_/_project Bootstrap a new GitLab instancehttps://wikitech.wikimedia.org/wiki/GitLab#Bootstrap_a_new_GitLab_instance Ticketshttps://wikitech.wikimedia.org/wiki/GitLab#Tickets https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys/GitStructure    < liw> when we do scap prep on a new train, it seem the extension repos have detached heads, e.g. https://wikitech.wikimedia.org/wiki/W.wiki w.wiki is the official Wikimedia URL shortener, powered by [It was designed and approved in an [[mw:Requests for comment/URL shortener|RfC]. Approved domainshttps://wikitech.wikimedia.org/wiki/W.wiki#Approved_domains Dumpshttps://wikitech.wikimedia.org/wiki/W.wiki#Dumps https://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts This is a namespace for draft versions of rewritten documentation. Subpageshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts#Subpages https://wikitech.wikimedia.org/wiki/Docker-registry We run our own Docker registry at docker-registry.wikimedia. Browsinghttps://wikitech.wikimedia.org/wiki/Docker-registry#Browsing Downloading imageshttps://wikitech.wikimedia.org/wiki/Docker-registry#Downloading_images Uploading imageshttps://wikitech.wikimedia.org/wiki/Docker-registry#Uploading_images Access controlhttps://wikitech.wikimedia.org/wiki/Docker-registry#Access_control jwt-authorizerhttps://wikitech.wikimedia.org/wiki/Docker-registry#jwt-authorizer Deleting imageshttps://wikitech.wikimedia.org/wiki/Docker-registry#Deleting_images httpbbhttps://wikitech.wikimedia.org/wiki/Docker-registry#httpbb See alsohttps://wikitech.wikimedia.org/wiki/Docker-registry#See_also https://wikitech.wikimedia.org/wiki/SLO/Docker-registry Status: approved Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Service_Level_Indicators_(SLIs) Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Docker-registry#Service_Level_Objectives https://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments User:Brennen Bearnes and others from [Release Engineering Team|Release Engineering] are working on improvements to Wikimedia deployment documentation here. See [for more info. https://wikitech.wikimedia.org/wiki/Gerrit/Replica gerrit-replica is a read-only replica of the Gerrit instance we run. It is used by Phabricator and ExtensionDistributor, among others. Usagehttps://wikitech.wikimedia.org/wiki/Gerrit/Replica#Usage https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions To help our goal of being good citizens to upstream open source communities we utilize, below is a non-exhaustive list of notable upstream contributions. 2024https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#2024 Debianhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Debian Kuberneteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Kubernetes Kyvernohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Kyverno terraform-provider-openstackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#terraform-provider-openstack Openstackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Openstack 2023https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#2023 Karmahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Karma Buildpackshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Buildpacks 2022https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#2022 2021https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#2021 Linux kernelhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Linux_kernel Cloud-inithttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Cloud-init Kubernetes projectshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Kubernetes_projects Cephhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Ceph Puppet stdlibhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Puppet_stdlib Kubernetes releasehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#Kubernetes_release keepalivedhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#keepalived 2020https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Opensource_Contributions#2020 https://wikitech.wikimedia.org/wiki/SLO/API_Gateway == Organisational == Organisationalhttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Organisational What is the service?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#What_is_the_service? Who are the responsible teams?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Who_are_the_responsible_teams? Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Architectural What are the service’s hard dependencies?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#What_are_the_service’s_hard_dependencies? What are the service’s soft dependencies?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#What_are_the_service’s_soft_dependencies? What other dependencies might the service have?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#What_other_dependencies_might_the_service_have? Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Client-facing Who are the service’s clients?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Who_are_the_service’s_clients? What are the request classes?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#What_are_the_request_classes? Classes within the context of rate limitinghttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Classes_within_the_context_of_rate_limiting Service level indicatorshttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Service_level_indicators Request response error ratehttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Request_response_error_rate Operationalhttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Operational How is the service monitored?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#How_is_the_service_monitored? How complex is the service to troubleshoot?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#How_complex_is_the_service_to_troubleshoot? How is the service deployed?https://wikitech.wikimedia.org/wiki/SLO/API_Gateway#How_is_the_service_deployed? Service level objectiveshttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Service_level_objectives Reporting periodhttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Reporting_period Request error ratehttps://wikitech.wikimedia.org/wiki/SLO/API_Gateway#Request_error_rate https://wikitech.wikimedia.org/wiki/Deployments/Training )}} Get traininghttps://wikitech.wikimedia.org/wiki/Deployments/Training#Get_training Useful informationhttps://wikitech.wikimedia.org/wiki/Deployments/Training#Useful_information Usual method using scap backporthttps://wikitech.wikimedia.org/wiki/Deployments/Training#Usual_method_using_scap_backport Basic synchttps://wikitech.wikimedia.org/wiki/Deployments/Training#Basic_sync Mw/Config change More advancedhttps://wikitech.wikimedia.org/wiki/Deployments/Training#Mw/Config_change_More_advanced MediaWiki patchhttps://wikitech.wikimedia.org/wiki/Deployments/Training#MediaWiki_patch Helpful things to knowhttps://wikitech.wikimedia.org/wiki/Deployments/Training#Helpful_things_to_know Deployment server directory structurehttps://wikitech.wikimedia.org/wiki/Deployments/Training#Deployment_server_directory_structure https://wikitech.wikimedia.org/wiki/Incidents/2021-03-14_MediaWiki_API ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-03-14_MediaWiki_API#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-03-14_MediaWiki_API#Actionables https://wikitech.wikimedia.org/wiki/PKI Category:SRE Infrastructure Foundations PKIhttps://wikitech.wikimedia.org/wiki/Category:PKI SRE Infrastructure Foundationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Infrastructure_Foundations https://wikitech.wikimedia.org/wiki/PKI/Debugging = Generating certs locally = Generating certs locallyhttps://wikitech.wikimedia.org/wiki/PKI/Debugging#Generating_certs_locally Create a local CAhttps://wikitech.wikimedia.org/wiki/PKI/Debugging#Create_a_local_CA https://wikitech.wikimedia.org/wiki/Incidents/2021-03-30_Jobqueue_overload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-03-30_Jobqueue_overload#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-03-30_Jobqueue_overload#Actionables https://wikitech.wikimedia.org/wiki/Bast1003 bast1003 is the main bastion for Eqiad. It replaced bast1002 per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast1003#Services https://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_become_a_deployer Members of the Wikimedia technical community are welcome - and encouraged! - to become deployers of MediaWiki and its extensions. Accesshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_become_a_deployer#Access Communicationshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_become_a_deployer#Communications Traininghttps://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_become_a_deployer#Training https://wikitech.wikimedia.org/wiki/Search/Technical_interactions = How to interact with On Wiki Search at a technical level = How to interact with On Wiki Search at a technical levelhttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#How_to_interact_with_On_Wiki_Search_at_a_technical_level Overviewhttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Overview Pushing data to Elasticsearchhttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Pushing_data_to_Elasticsearch Introductionhttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Introduction Summaryhttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Summary Detailshttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Details On page editshttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#On_page_edits Background batch processinghttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Background_batch_processing Weighted tagshttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Weighted_tags New keywordshttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#New_keywords Schema constraintshttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Schema_constraints Sizing / scalinghttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Sizing_/_scaling Limitationshttps://wikitech.wikimedia.org/wiki/Search/Technical_interactions#Limitations https://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes The Technical Wishes team wants to collect product analytics to understand how people use the features we write.  For example, we count the number of times users toggle the syntax highlighting feature, and in which editing interfaces. Specificationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Specification Dimensionshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Dimensions Metricshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Metrics Data collectionhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Data_collection Schedulinghttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Scheduling Deprecationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Deprecation Samplinghttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Sampling Local developmenthttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Local_development EventGatehttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#EventGate Aggregationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Aggregation Analytics cluster accesshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Analytics_cluster_access Gaining access rightshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Gaining_access_rights Setting up environmenthttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Setting_up_environment 1. Configure SSH accesshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#1._Configure_SSH_access 2. Connecting to analytics clienthttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#2._Connecting_to_analytics_client 3. Configuring Kerberos accesshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#3._Configuring_Kerberos_access 4. [Optional] Installing wmfdata-pythonhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#4._[Optional]_Installing_wmfdata-python Prototype querieshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Prototype_queries Environmentshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Environments JupyterLabhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#JupyterLab PAWShttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#PAWS CLIhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#CLI Supersethttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Superset Spoof SQL queries locallyhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Spoof_SQL_queries_locally Using wmfdata-pythonhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Using_wmfdata-python Importinghttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Importing Example MariaDB (SQL)https://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Example_MariaDB_(SQL) Example Hadoop (HiveQL)https://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Example_Hadoop_(HiveQL) Analytics-ReportUpdater (CronJob)https://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Analytics-ReportUpdater_(CronJob) Installing a development branchhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Installing_a_development_branch Runninghttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Running Working on querieshttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Working_on_queries Gotchashttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Gotchas Visualization in Grafanahttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Visualization_in_Grafana Tips for designing a dashboardhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Tips_for_designing_a_dashboard Add Informationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Add_Information Displayhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Display Normalizationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Normalization Migrationhttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Migration Deploymenthttps://wikitech.wikimedia.org/wiki/WMDE/Analytics/Technical_Wishes#Deployment https://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_deploy_the_train See https://wikitech.wikimedia. https://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_pair_on_the_train = Background = Backgroundhttps://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_pair_on_the_train#Background Helpful practiceshttps://wikitech.wikimedia.org/wiki/Release_Engineering/Drafts/Deployments/How_to_pair_on_the_train#Helpful_practices https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6 == 2020-12-31 == 2020-12-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-31 2020-12-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-23 2020-12-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-22 2020-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-21 2020-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-19 2020-12-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-18 2020-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-17 2020-12-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-16 2020-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-15 2020-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-14 2020-12-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-11 2020-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-09 2020-12-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-08 2020-12-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-07 2020-12-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-05 2020-12-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-04 2020-12-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-02 2020-12-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-12-01 2020-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-30 2020-11-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-28 2020-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-27 2020-11-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-25 2020-11-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-24 2020-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-23 2020-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-20 2020-11-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-19 2020-11-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-18 2020-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-17 2020-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-16 2020-11-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-12 2020-11-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-11 2020-11-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-10 2020-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-09 2020-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-07 2020-11-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-05 2020-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-04 2020-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-11-02 2020-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-30 2020-10-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-29 2020-10-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-28 2020-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-27 2020-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-26 2020-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-21 2020-10-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-20 2020-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-19 2020-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-18 2020-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-16 2020-10-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-15 2020-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-14 2020-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-12 2020-10-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-08 2020-10-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-07 2020-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-06 2020-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-05 2020-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-03 2020-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-10-02 2020-09-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-30 2020-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-29 2020-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-28 2020-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-25 2020-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-24 2020-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-23 2020-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-22 2020-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-21 2020-09-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-18 2020-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-17 2020-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-16 2020-09-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-15 2020-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-13 2020-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-11 2020-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-09 2020-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-08 2020-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-07 2020-09-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-04 2020-09-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-03 2020-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-02 2020-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-09-01 2020-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-31 2020-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-29 2020-08-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-28 2020-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-27 2020-08-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-26 2020-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-25 2020-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-24 2020-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-22 2020-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-21 2020-08-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-20 2020-08-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-19 2020-08-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-18 2020-08-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-17 2020-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-15 2020-08-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-14 2020-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-13 2020-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-12 2020-08-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-11 2020-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-10 2020-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-07 2020-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-06 2020-08-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-05 2020-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-04 2020-08-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-08-03 2020-07-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-31 2020-07-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-30 2020-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-29 2020-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-28 2020-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-27 2020-07-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-25 2020-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-24 2020-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-23 2020-07-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-22 2020-07-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-21 2020-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-20 2020-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-17 2020-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-16 2020-07-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-15 2020-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-14 2020-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-13 2020-07-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-10 2020-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-09 2020-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-08 2020-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-07 2020-07-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-04 2020-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-03 2020-07-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-02 2020-07-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-07-01 2020-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-30 2020-06-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-29 2020-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-28 2020-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-27 2020-06-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-26 2020-06-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-25 2020-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-24 2020-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-23 2020-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-22 2020-06-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-19 2020-06-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-18 2020-06-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-17 2020-06-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-16 2020-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-15 2020-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-14 2020-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-13 2020-06-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-12 2020-06-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-11 2020-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-10 2020-06-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-09 2020-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-08 2020-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-06 2020-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-05 2020-06-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-04 2020-06-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-03 2020-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-02 2020-06-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-06-01 2020-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-30 2020-05-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-29 2020-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-28 2020-05-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-27 2020-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-26 2020-05-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-25 2020-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-21 2020-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-20 2020-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-19 2020-05-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-18 2020-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-17 2020-05-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-15 2020-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-13 2020-05-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-12 2020-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-11 2020-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-10 2020-05-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-07 2020-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-06 2020-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-05 2020-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-04 2020-05-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-05-01 2020-04-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-30 2020-04-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-29 2020-04-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-28 2020-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-27 2020-04-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-21 2020-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-20 2020-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-19 2020-04-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-17 2020-04-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-16 2020-04-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-15 2020-04-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-14 2020-04-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-13 2020-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-11 2020-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-10 2020-04-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-09 2020-04-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-08 2020-04-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-07 2020-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-06 2020-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-04 2020-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-03 2020-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-02 2020-04-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-04-01 2020-03-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-31 2020-03-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-30 2020-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-29 2020-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-25 2020-03-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-24 2020-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-23 2020-03-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-20 2020-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-19 2020-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-18 2020-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-17 2020-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-13 2020-03-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-12 2020-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-11 2020-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-10 2020-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-09 2020-03-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-05 2020-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-07 2020-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-06 2020-03-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-04 2020-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-03 2020-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-03-02 2020-02-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-29 2020-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-28 2020-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-27 2020-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-26 2020-02-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-25 2020-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-24 2020-02-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-21 2020-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-20 2020-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-19 2020-02-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-18 2020-02-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-17 2020-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-16 2020-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-15 2020-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-14 2020-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-13 2020-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-12 2020-02-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-11 2020-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-10 2020-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-07 2020-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-06 2020-02-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-05 2020-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-04 2020-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-03 2020-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-02-02 2020-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-31 2020-01-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-29 2020-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-26 2020-01-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-24 2020-01-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-23 2020-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-22 2020-01-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-21 2020-01-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-20 2020-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-17 2020-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-16 2020-01-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-15 2020-01-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-14 2020-01-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-13 2020-01-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-10 2020-01-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-09 2020-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-08 2020-01-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-07 2020-01-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-06 2020-01-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_6#2020-01-02 https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation This page details information about deprecating and removing hosts running Debian Stretch (9.x) as an operating system from the Toolforge infrastructure. What is changing?https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Timeline What should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#What_should_I_do? SSH to the bastionshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#SSH_to_the_bastions Move from Grid Engine to Kuberneteshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_from_Grid_Engine_to_Kubernetes Move a grid engine webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_a_grid_engine_webservice Move a continuous jobhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_a_continuous_job Move a cron jobhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_a_cron_job What are the primary changes with moving to Buster?https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#What_are_the_primary_changes_with_moving_to_Buster? Language runtime and library versionshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Language_runtime_and_library_versions Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Solutions_to_common_problems Executable paths with jsubhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Executable_paths_with_jsub Rebuild virtualenv for python usershttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Rebuild_virtualenv_for_python_users Example 1: Upgrading a Stretch grid engine based tool to the Buster gridhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Example_1:_Upgrading_a_Stretch_grid_engine_based_tool_to_the_Buster_grid Example 2: Upgrading a uWSGI webservice into a Kubernetes containerhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Example_2:_Upgrading_a_uWSGI_webservice_into_a_Kubernetes_container Example 3: Upgrading a Kubernetes uWSGI webservicehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Example_3:_Upgrading_a_Kubernetes_uWSGI_webservice Delete a toolhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Delete_a_tool SSH to login-buster.toolforge.org fails with 'Permission denied (publickey)'https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#SSH_to_login-buster.toolforge.org_fails_with_'Permission_denied_(publickey)' SSH to login-buster.toolforge.org fails with 'Permission denied (publickey,hostbased)'https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#SSH_to_login-buster.toolforge.org_fails_with_'Permission_denied_(publickey,hostbased)' How to determine where your job is runninghttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#How_to_determine_where_your_job_is_running Monitoring toolshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Monitoring_tools Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Why_are_we_doing_this? See alsohttps://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/04 ==Week of April 05== Week of April 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/04#Week_of_April_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/04#=== Week of April 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/04#Week_of_April_12 Week of April 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/04#Week_of_April_19 Week of April 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/04#Week_of_April_26 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation ==Overview== Overviewhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Overview Conceptshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Concepts Designhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Design Requirementshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Requirements Nice-to-haveshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Nice-to-haves Componentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Components Build Servicehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Build_Service Artifact Repositoryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Artifact_Repository Dashboards and UXhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Dashboards_and_UX Deployment Servicehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Deployment_Service Build Service Designhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Build_Service_Design Namespacinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Namespacing RBAC by subjecthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#RBAC_by_subject Pod Security Policy (later to be replaced by OPA Gatekeeper)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Pod_Security_Policy_(later_to_be_replaced_by_OPA_Gatekeeper) Storagehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Storage Secretshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Secrets Taskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Tasks Deploymenthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Deployment Harborhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Harbor PostgreSQLhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#PostgreSQL Harbor itselfhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Harbor_itself Harbor serviceshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Harbor_services Tektonhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#Tekton buildpacks-admission-controllerhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#buildpacks-admission-controller To make this useful with current Toolforge and webservicehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#To_make_this_useful_with_current_Toolforge_and_webservice why?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Buildpack_Implementation#why? https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Debugging Quick checkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Quick_check Debugging service errorshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Debugging_service_errors DNS entry not being createdhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#DNS_entry_not_being_created Checking zone transfershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Checking_zone_transfers SSH timeout to the machinehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#SSH_timeout_to_the_machine No active metadata service foundhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#No_active_metadata_service_found Per-VM debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Per-VM_debugging Very old failed instanceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Very_old_failed_instances Steady, intermittent failureshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Steady,_intermittent_failures New instanceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#New_instances Going to the new instancehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Going_to_the_new_instance Cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Cleanup Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#Related_information Referenceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedLeakedVMs#References https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on Note: some of these steps might require extra access to internal infrastructure systems, we are working on improving the runbooks, until then, take this as a guideline. Errorhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Error Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Debugging Usual errorshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Usual_errors Failed resources if any: Exec[create-volume-group]https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Failed_resources_if_any:_Exec[create-volume-group] Function lookup() did not find a value for the namehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Function_lookup()_did_not_find_a_value_for_the_name Checking up the puppetmasterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Checking_up_the_puppetmaster Hiera lookups work different in cloud than prodhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Hiera_lookups_work_different_in_cloud_than_prod Contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Contacts More infohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#More_info Related taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on#Related_tasks https://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data == User input analysis == User input analysishttps://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data#User_input_analysis Random query logger sample analysishttps://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data#Random_query_logger_sample_analysis Summaryhttps://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data#Summary DBs queried together, with frequencies and usershttps://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data#DBs_queried_together,_with_frequencies_and_users Tools/Users' number of cross-DB queries performed, and DBs queriedhttps://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data#Tools/Users'_number_of_cross-DB_queries_performed,_and_DBs_queried Resourceshttps://wikitech.wikimedia.org/wiki/News/Wikireplicas_2020_Redesign/Wiki_Replicas_Cross-DB_Query_Data#Resources https://wikitech.wikimedia.org/wiki/Incidents/2021-04-20_MediaWiki_API_slowdown == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-20_MediaWiki_API_slowdown#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-20_MediaWiki_API_slowdown#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-27_Commons_wiki_primary_db#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily The table referrer_daily contains pre-aggregated counts of how many Wikipedia pageviews were referred from common search engines on a given day. They split the data by country, language edition, browser family, and OS family. Schemahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#Schema Search Engineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#Search_Engines Availabilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#Availability Stat machineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#Stat_machines Dashboardhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#Dashboard Privacyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#Privacy See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily/Dashboard The referrer_daily dataset has many facets and ways in which someone might want to aggregate or split the data. Turnilo is currently the best solution at Wikimedia for visualizing data with these properties, but our Turnilo instance is designed for private datasets so a public instance needed to be created in order to share this dataset more broadly. Turnilo instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily/Dashboard#Turnilo_instance Data backendhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily/Dashboard#Data_backend Updatinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily/Dashboard#Updating Read Morehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily/Dashboard#Read_More See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/referrer_daily/Dashboard#See_also https://wikitech.wikimedia.org/wiki/Gerrit/Upgrade We deploy Gerrit using the upstream war file published in Maven Central, it contains Gerrit itself as well as a collection of bundled plugin, on top of that we add plugins to customize our instance. The artifacts are stored in under a deploy/wmf/stable-X. Update our mirror repositoryhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Update_our_mirror_repository Update Gerrit core branchhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Update_Gerrit_core_branch Create new brancheshttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Create_new_branches Updating existing branchhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Updating_existing_branch Update upstream bundled pluginshttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Update_upstream_bundled_plugins Fetch our additional pluginshttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Fetch_our_additional_plugins Buildhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Build Build prerequisiteshttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Build_prerequisites Gerrit corehttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Gerrit_core Build our ownhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Build_our_own Pluginshttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Plugins Add a new pluginhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Add_a_new_plugin Update artifactshttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Update_artifacts Setup git LFShttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Setup_git_LFS Gerrit .warhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Gerrit_.war TypeScript APIhttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#TypeScript_API Prepare the commithttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Prepare_the_commit Deploymenthttps://wikitech.wikimedia.org/wiki/Gerrit/Upgrade#Deployment https://wikitech.wikimedia.org/wiki/Mailman/Mailman2 == How to == How tohttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#How_to Create a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Create_a_mailing_list Step-by-step procedure using the UIhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Step-by-step_procedure_using_the_UI Disable or re-enable a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Disable_or_re-enable_a_mailing_list Real world example (from T200733)https://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Real_world_example_(from_T200733) Commandshttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Commands Remove a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Remove_a_mailing_list Remove a message from the mailing list archiveshttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Remove_a_message_from_the_mailing_list_archives Export a listing of all subscribers to a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Export_a_listing_of_all_subscribers_to_a_mailing_list Check if an email address is subscribed to any listshttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Check_if_an_email_address_is_subscribed_to_any_lists Remove an individual from all mailing listshttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Remove_an_individual_from_all_mailing_lists Reset the admin password of a listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Reset_the_admin_password_of_a_list TLDRhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#TLDR detailshttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#details Rename a mailing listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Rename_a_mailing_list Manualhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Manual Alter arbcom-l archive access listhttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Alter_arbcom-l_archive_access_list Configuration detailshttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Configuration_details Mailman setuphttps://wikitech.wikimedia.org/wiki/Mailman/Mailman2#Mailman_setup https://wikitech.wikimedia.org/wiki/Mailman/MTA Near the top of the exim4.conf file, there are several macros related to Mailman. Main configurationhttps://wikitech.wikimedia.org/wiki/Mailman/MTA#Main_configuration Routershttps://wikitech.wikimedia.org/wiki/Mailman/MTA#Routers Transportshttps://wikitech.wikimedia.org/wiki/Mailman/MTA#Transports Mailing list privacy protectionhttps://wikitech.wikimedia.org/wiki/Mailman/MTA#Mailing_list_privacy_protection Address header rewritinghttps://wikitech.wikimedia.org/wiki/Mailman/MTA#Address_header_rewriting https://wikitech.wikimedia.org/wiki/Mailman/Spam_fighting === SpamAssassin === SpamAssassinhttps://wikitech.wikimedia.org/wiki/Mailman/Spam_fighting#SpamAssassin Fighting spam in mailmanhttps://wikitech.wikimedia.org/wiki/Mailman/Spam_fighting#Fighting_spam_in_mailman Spam from non-membershttps://wikitech.wikimedia.org/wiki/Mailman/Spam_fighting#Spam_from_non-members Spam scoreshttps://wikitech.wikimedia.org/wiki/Mailman/Spam_fighting#Spam_scores DMARC Compatibilityhttps://wikitech.wikimedia.org/wiki/Mailman/Spam_fighting#DMARC_Compatibility https://wikitech.wikimedia.org/wiki/Mailman/Monitoring Logs are in /var/log/mailman3 and /var/log/mailman3/web, rotated daily with a max retention of 30 days. In the future they may end up in logstash too. mailman3_runnershttps://wikitech.wikimedia.org/wiki/Mailman/Monitoring#mailman3_runners mailman3_queue_sizehttps://wikitech.wikimedia.org/wiki/Mailman/Monitoring#mailman3_queue_size Misc stuffhttps://wikitech.wikimedia.org/wiki/Mailman/Monitoring#Misc_stuff https://wikitech.wikimedia.org/wiki/Event_Platform/Flaws Like any system, Event Platform has its flaws. This page aims to document them. meta fieldhttps://wikitech.wikimedia.org/wiki/Event_Platform/Flaws#meta_field meta.domain fieldhttps://wikitech.wikimedia.org/wiki/Event_Platform/Flaws#meta.domain_field dt fieldshttps://wikitech.wikimedia.org/wiki/Event_Platform/Flaws#dt_fields Kafka topic data center prefixeshttps://wikitech.wikimedia.org/wiki/Event_Platform/Flaws#Kafka_topic_data_center_prefixes https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove Trove is OpenStack's database-as-a-service project. It creates and manages database instances, each of which implements one database install (e. setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#setup guest imageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#guest_images guest confighttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#guest_config guest containershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#guest_containers backup containershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#backup_containers install issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#install_issues Accessing Trove guest VMshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Accessing_Trove_guest_VMs Cloud-wide Trove quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Cloud-wide_Trove_quotas Adjusting per-project Trove quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Adjusting_per-project_Trove_quotas Troubleshootinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Troubleshooting Instance is downhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Instance_is_down Out of disk spacehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Out_of_disk_space Quotashttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Quotas Reserved quota does not go downhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Reserved_quota_does_not_go_down Resize failedhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Trove#Resize_failed https://wikitech.wikimedia.org/wiki/Incidents/2021-04-26_thumbor == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-26_thumbor#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-26_thumbor#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Training/About ==About deployment trainings== About deployment trainingshttps://wikitech.wikimedia.org/wiki/Deployments/Training/About#About_deployment_trainings Prereqshttps://wikitech.wikimedia.org/wiki/Deployments/Training/About#Prereqs Getting Ready to Deployhttps://wikitech.wikimedia.org/wiki/Deployments/Training/About#Getting_Ready_to_Deploy Deploying a patchhttps://wikitech.wikimedia.org/wiki/Deployments/Training/About#Deploying_a_patch When you're donehttps://wikitech.wikimedia.org/wiki/Deployments/Training/About#When_you're_done https://wikitech.wikimedia.org/wiki/Mwlog1002 mwlog1002.eqiad. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server usage:Logginghttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Logging Servershttps://wikitech.wikimedia.org/wiki/Category:Servers Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05 ==Week of May 03== Week of May 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05#Week_of_May_03 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05#=== Week of May 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05#Week_of_May_10 Week of May 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05#Week_of_May_17 Week of May 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05#Week_of_May_24 Week of May 31https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/05#Week_of_May_31 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44 == 2021-04-30 == 2021-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-30 2021-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-29 2021-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-28 2021-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-27 2021-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-26 2021-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-25 2021-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-24 2021-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-23 2021-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-22 2021-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-21 2021-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-20 2021-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-19 2021-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-18 2021-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-17 2021-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-16 2021-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-15 2021-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-14 2021-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-13 2021-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-12 2021-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-10 2021-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-09 2021-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-08 2021-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-07 2021-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-06 2021-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-05 2021-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-04 2021-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-03 2021-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-02 2021-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-04-01 2021-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-31 2021-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-30 2021-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-29 2021-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-27 2021-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-26 2021-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-25 2021-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-24 2021-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-23 2021-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-22 2021-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-21 2021-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-20 2021-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-19 2021-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-18 2021-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-17 2021-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-16 2021-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-15 2021-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-14 2021-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-13 2021-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-12 2021-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-11 2021-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-10 2021-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-09 2021-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-08 2021-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-07 2021-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-05 2021-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-04 2021-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-03 2021-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-02 2021-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-03-01 2021-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-28 2021-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-27 2021-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-26 2021-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-25 2021-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-24 2021-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-23 2021-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-22 2021-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-21 2021-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-20 2021-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-19 2021-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-18 2021-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-17 2021-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-16 2021-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-15 2021-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-14 2021-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-13 2021-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-12 2021-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-11 2021-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-10 2021-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-09 2021-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-08 2021-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-07 2021-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-06 2021-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-05 2021-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-04 2021-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-03 2021-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-02 2021-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-02-01 2021-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-29 2021-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-28 2021-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-27 2021-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-26 2021-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-25 2021-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-23 2021-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-22 2021-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-21 2021-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-20 2021-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-19 2021-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-18 2021-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-16 2021-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-15 2021-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-14 2021-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-13 2021-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-12 2021-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-11 2021-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-09 2021-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-08 2021-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-07 2021-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-06 2021-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-05 2021-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-04 2021-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-03 2021-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-02 2021-01-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_44#2021-01-01 https://wikitech.wikimedia.org/wiki/Mwlog mwlog are a class of logging hosts which serve multiple functions. Hostshttps://wikitech.wikimedia.org/wiki/Mwlog#Hosts Serviceshttps://wikitech.wikimedia.org/wiki/Mwlog#Services udp2log/mwloghttps://wikitech.wikimedia.org/wiki/Mwlog#udp2log/mwlog Redis server for Arc Lamphttps://wikitech.wikimedia.org/wiki/Mwlog#Redis_server_for_Arc_Lamp Long-term security storagehttps://wikitech.wikimedia.org/wiki/Mwlog#Long-term_security_storage Utilitieshttps://wikitech.wikimedia.org/wiki/Mwlog#Utilities https://wikitech.wikimedia.org/wiki/Gerrit/Administration == Become an Administrator == Become an Administratorhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Become_an_Administrator Creating new repositorieshttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Creating_new_repositories Determine version of Gerrit runninghttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Determine_version_of_Gerrit_running Inspecting an account settingshttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Inspecting_an_account_settings Disabling / Blocking / Unblocking an accounthttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Disabling_/_Blocking_/_Unblocking_an_account Determine the user idhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Determine_the_user_id Disable Userhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Disable_User Unblock/Reenable Userhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Unblock/Reenable_User Flush replica cachehttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Flush_replica_cache Flush all sessionshttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Flush_all_sessions Tasks managementhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Tasks_management Garbage collectionhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Garbage_collection Replicationhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Replication Statushttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Status Forcing Replication re-runshttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Forcing_Replication_re-runs Troubleshootinghttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Troubleshooting Githubhttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#Github OREShttps://wikitech.wikimedia.org/wiki/Gerrit/Administration#ORES https://wikitech.wikimedia.org/wiki/Gerrit/Operations == Restarting == Restartinghttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Restarting Monitoringhttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Monitoring Important Graphshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Important_Graphs Gerrit metricshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Gerrit_metrics Logshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Logs Main logshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Main_logs HTTP Logshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#HTTP_Logs JVMhttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#JVM Thread Dumphttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Thread_Dump Java tracehttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Java_trace Java heap usagehttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Java_heap_usage Access h2 account_patch_reviewshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Access_h2_account_patch_reviews Firewalling Gerrithttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Firewalling_Gerrit Blocking misbehaving bots / IPshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Blocking_misbehaving_bots_/_IPs Throttling IPshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Throttling_IPs Killing ssh connectionshttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Killing_ssh_connections Switch overhttps://wikitech.wikimedia.org/wiki/Gerrit/Operations#Switch_over https://wikitech.wikimedia.org/wiki/Incidents/2021-04-06_partial_rack_codfw ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-06_partial_rack_codfw#Summary Noteshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-06_partial_rack_codfw#Notes Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-06_partial_rack_codfw#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-04-15_appserver_latency ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-15_appserver_latency#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-15_appserver_latency#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Timeline 14 April 2021https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#14_April_2021 22 April 2021https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#22_April_2021 29 April 2021https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#29_April_2021 Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-29_db_and_memc_load#Actionables https://wikitech.wikimedia.org/wiki/People1003 people1003 was a virtual machine running on Ganeti on Debian bullseye. It hosted the service People. Connectinghttps://wikitech.wikimedia.org/wiki/People1003#Connecting https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink This page describes how we deploy Apache Flink stream processing applications in WMF Kubernetes clusters. This page assumes that you have a basic understanding of how Flink schedules jobs and what JobManagers and TaskManagers are. Flink job lifecyclehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Flink_job_lifecycle Flink application deploymenthttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Flink_application_deployment Native Kubernetes Application Deployment Modehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Native_Kubernetes_Application_Deployment_Mode Periodic savepointshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Periodic_savepoints Recovery from savepointhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Recovery_from_savepoint JobManager High Availabilityhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#JobManager_High_Availability If using k8s ConfigMaps to store HA statehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#If_using_k8s_ConfigMaps_to_store_HA_state If using Zookeeper to store HA statehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#If_using_Zookeeper_to_store_HA_state Flink session clusterhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Flink_session_cluster Flink application clusterhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Flink_application_cluster Jobmanager as a k8s Deployment resourcehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Jobmanager_as_a_k8s_Deployment_resource Jobmanager as a k8s Job resourcehttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink#Jobmanager_as_a_k8s_Job_resource https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Redis Toolforge Redis is running on three nodes (tools-redis-5/6/7). One of them is a master and rest of them are replicas. Systemd unithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Redis#Systemd_unit Manual failoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Redis#Manual_failover Puppet configurationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Redis#Puppet_configuration See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Redis#See_also https://wikitech.wikimedia.org/wiki/Obsolete_or_unneeded_database_tables Table migrated from https://phabricator.wikimedia. Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Bacula/history Baculahttps://www.bacula. https://wikitech.wikimedia.org/wiki/MariaDB/Upgrading_a_section == Order of upgrades == Order of upgradeshttps://wikitech.wikimedia.org/wiki/MariaDB/Upgrading_a_section#Order_of_upgrades Upgrade procedurehttps://wikitech.wikimedia.org/wiki/MariaDB/Upgrading_a_section#Upgrade_procedure Upgrading mariadb minor versionhttps://wikitech.wikimedia.org/wiki/MariaDB/Upgrading_a_section#Upgrading_mariadb_minor_version https://wikitech.wikimedia.org/wiki/Kubernetes/Education 🎓 A collection of resources for learning Kubernetes Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes https://wikitech.wikimedia.org/wiki/Performance/Essay/Google_Web_Vitals_(2021) == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Google_Web_Vitals_(2021)#Background Collecting Google Web Vitalshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Google_Web_Vitals_(2021)#Collecting_Google_Web_Vitals Chrome User Experience reporthttps://wikitech.wikimedia.org/wiki/Performance/Essay/Google_Web_Vitals_(2021)#Chrome_User_Experience_report Synthetic performance testhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Google_Web_Vitals_(2021)#Synthetic_performance_test Collecting metrics from our usershttps://wikitech.wikimedia.org/wiki/Performance/Essay/Google_Web_Vitals_(2021)#Collecting_metrics_from_our_users https://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos == Metrics Platform Demos == Metrics Platform Demoshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#Metrics_Platform_Demos Abouthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#About Recordings and Presentershttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#Recordings_and_Presenters Next sessionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#Next_session TBDhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#TBD Previous sessionshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#Previous_sessions 2021-09-29https://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#2021-09-29 2021-09-01https://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#2021-09-01 2021-08-05https://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#2021-08-05 Notes/Q&A ====https://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#Notes/Q&A_==== 2021-06-09https://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#2021-06-09 Notes/Q&Ahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Demos#Notes/Q&A https://wikitech.wikimedia.org/wiki/MariaDB/Rebooting_a_host == Clean shutdown== Clean shutdownhttps://wikitech.wikimedia.org/wiki/MariaDB/Rebooting_a_host#Clean_shutdown Run the reboot or reimage cookbookhttps://wikitech.wikimedia.org/wiki/MariaDB/Rebooting_a_host#Run_the_reboot_or_reimage_cookbook After boothttps://wikitech.wikimedia.org/wiki/MariaDB/Rebooting_a_host#After_boot If the server or the instance crashedhttps://wikitech.wikimedia.org/wiki/MariaDB/Rebooting_a_host#If_the_server_or_the_instance_crashed https://wikitech.wikimedia.org/wiki/MariaDB/pt-heartbeat pt-heartbeat is a service running on MariaDB servers acting as masters. A process on the source server writes a timestamped row to the heartbeat table every second. See alsohttps://wikitech.wikimedia.org/wiki/MariaDB/pt-heartbeat#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow ) - See Data Platform/Systems/Airflow/Kubernetes for more details. Airflow setup and conventionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Airflow_setup_and_conventions Authenticationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Authentication Host-based instanceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Host-based_instances Kubernetes instanceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Kubernetes_instances Metadata Databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Metadata_Database Airflow DAGshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Airflow_DAGs Host-based DAG deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Host-based_DAG_deployment Kubernetes based DAG deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Kubernetes_based_DAG_deployment Skeinhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Skein I'm getting paged for a Skein certificate about to expirehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#I'm_getting_paged_for_a_Skein_certificate_about_to_expire See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#See_also Airflow Instanceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Airflow_Instances Airflow on Kuberneteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Airflow_on_Kubernetes Airflow Upgradeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Airflow_Upgrades Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Administration Overview of Data Engineering's Airflow deploymentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Overview_of_Data_Engineering's_Airflow_deployments Creating a new Airflow Instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Creating_a_new_Airflow_Instance Prepare airflow-dags for deployment to the new instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Prepare_airflow-dags_for_deployment_to_the_new_instance Create the instance specific dags folderhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Create_the_instance_specific_dags_folder Create the instance specific scap repositoryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Create_the_instance_specific_scap_repository Create a scap deployment sourcehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Create_a_scap_deployment_source Create the Airflow PostgreSQL Databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Create_the_Airflow_PostgreSQL_Database Configure the Airflow instance in Puppethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Configure_the_Airflow_instance_in_Puppet Add service user to the Yarn production queuehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Add_service_user_to_the_Yarn_production_queue Incident reports & known issueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow#Incident_reports_&_known_issues https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations SRE Infrastructure Foundations▼ SRE Infrastructure Foundationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Infrastructure_Foundations https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Ownership {| class="wikitable" width=100% Old documentationhttps://wikitech.wikimedia.org/wiki/Category:Old_documentation SRE Infrastructure Foundationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Infrastructure_Foundations https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/About Empowering Reliable Infrastructure and Streamlined Operations SRE Infrastructure Foundationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Infrastructure_Foundations https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Contact =Communication channels= Communication channelshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Contact#Communication_channels IRChttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Contact#IRC https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Team {{user info SRE Infrastructure Foundationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Infrastructure_Foundations https://wikitech.wikimedia.org/wiki/MariaDB/Multiinstance Our database hosts can run either a single mariadb instance (single-instance) or multiple (multi-instance). This affects how they are addressed over the network, and the systemd setup within the host itself. Single-instance hostshttps://wikitech.wikimedia.org/wiki/MariaDB/Multiinstance#Single-instance_hosts Multi-instance hostshttps://wikitech.wikimedia.org/wiki/MariaDB/Multiinstance#Multi-instance_hosts Determining if a host is single- or multi-instancehttps://wikitech.wikimedia.org/wiki/MariaDB/Multiinstance#Determining_if_a_host_is_single-_or_multi-instance Cleaning up a removed section from a multiinstance hosthttps://wikitech.wikimedia.org/wiki/MariaDB/Multiinstance#Cleaning_up_a_removed_section_from_a_multiinstance_host https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template This is a template for Cloud VPS runbooks. Replace this paragraph with a general overview of what this runbook covers. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Old_incidents Examples of runbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Runbook_template#Examples_of_runbooks https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host == Host preparation == Host preparationhttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Host_preparation Downtime the host in Icingahttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Downtime_the_host_in_Icinga Adding a new hosthttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Adding_a_new_host Replacing a failed hosthttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Replacing_a_failed_host Section and replication configurationhttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Section_and_replication_configuration Add the host to a section:https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Add_the_host_to_a_section: Configure the correct replication mode:https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Configure_the_correct_replication_mode: Add the host to dbctl config (example)https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Add_the_host_to_dbctl_config_(example) Add the host to Mediawiki's database loadbalancer configuration (example)https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Add_the_host_to_Mediawiki's_database_loadbalancer_configuration_(example) Data populationhttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Data_population Cloninghttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Cloning Restoring from backuphttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Restoring_from_backup Replication from masterhttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Replication_from_master Enabling notifications (example):https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Enabling_notifications_(example): Add it to zarcillo DBhttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Add_it_to_zarcillo_DB Next stepshttps://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Next_steps https://wikitech.wikimedia.org/wiki/Shellbox Shellbox is a library for remote command execution, and a server for secure command execution. It was primarily implemented to sandbox lilypond (used by the [extension]) and provide a way for MediaWiki to utilize external binaries without needing them to be in the same container. Architecturehttps://wikitech.wikimedia.org/wiki/Shellbox#Architecture Shellboxeshttps://wikitech.wikimedia.org/wiki/Shellbox#Shellboxes Monitoringhttps://wikitech.wikimedia.org/wiki/Shellbox#Monitoring Logshttps://wikitech.wikimedia.org/wiki/Shellbox#Logs Deploying a new versionhttps://wikitech.wikimedia.org/wiki/Shellbox#Deploying_a_new_version Smoke testhttps://wikitech.wikimedia.org/wiki/Shellbox#Smoke_test Source codehttps://wikitech.wikimedia.org/wiki/Shellbox#Source_code https://wikitech.wikimedia.org/wiki/MariaDB/Start_and_stop == Start / Stop == Start / Stophttps://wikitech.wikimedia.org/wiki/MariaDB/Start_and_stop#Start_/_Stop Buffer pool dumphttps://wikitech.wikimedia.org/wiki/MariaDB/Start_and_stop#Buffer_pool_dump InnoDB Shutdown Speedhttps://wikitech.wikimedia.org/wiki/MariaDB/Start_and_stop#InnoDB_Shutdown_Speed Stopping a replica: avoiding replication corruptionhttps://wikitech.wikimedia.org/wiki/MariaDB/Start_and_stop#Stopping_a_replica:_avoiding_replication_corruption https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_guidelines == General guidelines == General guidelineshttps://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_guidelines#General_guidelines Includeshttps://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_guidelines#Includes Documentation review (pages requiring comprehensive review)https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_guidelines#Documentation_review_(pages_requiring_comprehensive_review) Footer (all pages)https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_guidelines#Footer_(all_pages) Special pageshttps://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_guidelines#Special_pages https://wikitech.wikimedia.org/wiki/MariaDB/Primary_switchover == Prerequisites shared for all MW sections == Prerequisites shared for all MW sectionshttps://wikitech.wikimedia.org/wiki/MariaDB/Primary_switchover#Prerequisites_shared_for_all_MW_sections Which section are you switching over?https://wikitech.wikimedia.org/wiki/MariaDB/Primary_switchover#Which_section_are_you_switching_over? https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Documentation_navigation Data Persistence https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/06 ==Week of June 07== Week of June 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/06#Week_of_June_07 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/06#=== Week of June 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/06#Week_of_June_14 Week of June 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/06#Week_of_June_21 Week of June 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/06#Week_of_June_28 https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Documentation == SRE Infrastructure Foundations documentation == SRE Infrastructure Foundations documentationhttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Documentation#SRE_Infrastructure_Foundations_documentation https://wikitech.wikimedia.org/wiki/SLO/Template_instructions A service level objective (SLO) is an agreement, among everyone who works on a service, about how reliable that service needs to be. Getting startedhttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions#Getting_started Referenceshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions#References https://wikitech.wikimedia.org/wiki/SLO/Template To get started, make a copy of this page, named after your service, as a subpage of SLO. (For example, "SLO/Foobaroid". Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Template#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/Template#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/Template#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Template#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Template#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Template#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Template#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/Template#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/Template#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/Template#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/Template#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/Template#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/Template#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/Template#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Template#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/Template#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Template#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/SLO/Template#Reconciliation https://wikitech.wikimedia.org/wiki/Search/WeightedTags = Definition = Definitionhttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Definition Adding new datahttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Adding_new_data Producing the data using the Event Platformhttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Producing_the_data_using_the_Event_Platform Example 1: using MediaWiki and the WeightedTagsUpdater servicehttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Example_1:_using_MediaWiki_and_the_WeightedTagsUpdater_service Example 2: using Changeprop with ORES article/draft topichttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Example_2:_using_Changeprop_with_ORES_article/draft_topic CirrusSearch Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#CirrusSearch_Update_Pipeline Resetting the data from MediaWikihttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Resetting_the_data_from_MediaWiki Querying the datahttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Querying_the_data Shape of the data in elasticsearchhttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Shape_of_the_data_in_elasticsearch Querying the tagshttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Querying_the_tags Known tag familieshttps://wikitech.wikimedia.org/wiki/Search/WeightedTags#Known_tag_families https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Currently_working_on ==Welcome to our Progress Tracker!== Welcome to our Progress Tracker!https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Currently_working_on#Welcome_to_our_Progress_Tracker! https://wikitech.wikimedia.org/wiki/Single_Sign_On Wikimedia Production Web UIs use Single Sign On (SSO) (via Apereo CAS) for user authentication. The SSO portal is hosted at https://idp. What you needhttps://wikitech.wikimedia.org/wiki/Single_Sign_On#What_you_need Enabling 2FA using a YubiKeyhttps://wikitech.wikimedia.org/wiki/Single_Sign_On#Enabling_2FA_using_a_YubiKey Getting a YubiKeyhttps://wikitech.wikimedia.org/wiki/Single_Sign_On#Getting_a_YubiKey Using your YubiKeyhttps://wikitech.wikimedia.org/wiki/Single_Sign_On#Using_your_YubiKey What sites are SSO enabled?https://wikitech.wikimedia.org/wiki/Single_Sign_On#What_sites_are_SSO_enabled? https://wikitech.wikimedia.org/wiki/SRE/Observability/Team ==Meet the Team== Meet the Teamhttps://wikitech.wikimedia.org/wiki/SRE/Observability/Team#Meet_the_Team https://wikitech.wikimedia.org/wiki/SRE/Observability/Contact Reach out: https://wikitech.wikimedia.org/wiki/SRE/Observability/Documentation == SRE Observability documentation == SRE Observability documentationhttps://wikitech.wikimedia.org/wiki/SRE/Observability/Documentation#SRE_Observability_documentation Alertshttps://wikitech.wikimedia.org/wiki/SRE/Observability/Documentation#Alerts Logshttps://wikitech.wikimedia.org/wiki/SRE/Observability/Documentation#Logs Metricshttps://wikitech.wikimedia.org/wiki/SRE/Observability/Documentation#Metrics https://wikitech.wikimedia.org/wiki/SRE/Observability/Ownership AlertingTools and process of setting up and managing notifications and alerts to proactively detect and respond to incidents, anomalies, or other relevant events that may impact the reliability or availability of our systems and services. Our alerting helps to ensure that potential issues or problems are identified and addressed promptly. https://wikitech.wikimedia.org/wiki/SLO/Varnish Status: approved Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Clients Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/Varnish#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Varnish#Service_Level_Objectives https://wikitech.wikimedia.org/wiki/SRE/Observability/About SRE Observability▼ The Observability team What is observability?https://wikitech.wikimedia.org/wiki/SRE/Observability/About#What_is_observability? https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks This page contains basic resources for developers who want to author and publish runbooks for Cloud VPS on Wikitech. Before you beginhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#Before_you_begin What is a runbook?https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#What_is_a_runbook? When should you use a runbook?https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#When_should_you_use_a_runbook? Tips for building useful runbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#Tips_for_building_useful_runbooks Cloud VPS runbook templateshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#Cloud_VPS_runbook_templates Where to publish runbooks for Cloud VPShttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#Where_to_publish_runbooks_for_Cloud_VPS Existing runbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#Existing_runbooks See Alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks#See_Also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/System_Users The Analytics Cluster is more multi tenant than any other system in WMF production. It is often used by individual users to do analysis and run jobs, but there is often a need for productionized jobs to run as a user that is not tied to a real person's user account. Examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/System_Users#Example WIP Instructions for creating a new analytics system user and groups in Puppethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/System_Users#WIP_Instructions_for_creating_a_new_analytics_system_user_and_groups_in_Puppet https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing A scalable machine learning model serving infrastructure on Kubernetes using KServe. It is part of a broader project aimed to [Machine Learning] at Wikimedia. Componentshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Components Serving (Lift Wing)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Serving_(Lift_Wing) Training (Train Wing)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Training_(Train_Wing) Model Storagehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Model_Storage Hosting a modelhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Hosting_a_model Ownership of a modelhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Ownership_of_a_model Hosting stages for a model server on Lift Winghttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Hosting_stages_for_a_model_server_on_Lift_Wing Requesting to update a modelhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Requesting_to_update_a_model Usagehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Usage Streamshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Streams Current Inference Serviceshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Current_Inference_Services Revscoring models (migrated from ORES)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Revscoring_models_(migrated_from_ORES) Article topichttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Article_topic Vandalism detectionhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Vandalism_detection Language modelshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Language_models Content Translation Recommendationshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Content_Translation_Recommendations Article Descriptionshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Article_Descriptions Logo Detectionhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Logo_Detection Contributing to the projecthttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Contributing_to_the_project Tables of contentshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Tables_of_contents https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Not_switching This is a list of services/hosts that are currently not switching. You should also look at the list of [class="wikitable" https://wikitech.wikimedia.org/wiki/Xhgui2001 Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Xhgui1001 Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Monitoring/Latency Icinga has alerts for increased latency at the Mediawiki appserver level. https://wikitech.wikimedia.org/wiki/Collaborative_tmux_sessions Sometimes you want another pair of eyes when troubleshooting or working in production machines. The tools screen and tmux are being used to create collaborative terminal sessions. tldr;https://wikitech.wikimedia.org/wiki/Collaborative_tmux_sessions#tldr; Create sessions with fixed sizehttps://wikitech.wikimedia.org/wiki/Collaborative_tmux_sessions#Create_sessions_with_fixed_size Share session between usershttps://wikitech.wikimedia.org/wiki/Collaborative_tmux_sessions#Share_session_between_users Share session using socketshttps://wikitech.wikimedia.org/wiki/Collaborative_tmux_sessions#Share_session_using_sockets "Share" session using root/sudohttps://wikitech.wikimedia.org/wiki/Collaborative_tmux_sessions#"Share"_session_using_root/sudo https://wikitech.wikimedia.org/wiki/Maintenance_server The Maintenance server is where we run scheduled and ad-hoc MediaWiki maintenance scripts from the command-line. Serverhttps://wikitech.wikimedia.org/wiki/Maintenance_server#Server Connectinghttps://wikitech.wikimedia.org/wiki/Maintenance_server#Connecting Runbookhttps://wikitech.wikimedia.org/wiki/Maintenance_server#Runbook Access recent runshttps://wikitech.wikimedia.org/wiki/Maintenance_server#Access_recent_runs Run a maintenance script on a wikihttps://wikitech.wikimedia.org/wiki/Maintenance_server#Run_a_maintenance_script_on_a_wiki Run a custom maintenance scripthttps://wikitech.wikimedia.org/wiki/Maintenance_server#Run_a_custom_maintenance_script Historyhttps://wikitech.wikimedia.org/wiki/Maintenance_server#History Former serviceshttps://wikitech.wikimedia.org/wiki/Maintenance_server#Former_services Hostshttps://wikitech.wikimedia.org/wiki/Maintenance_server#Hosts See alsohttps://wikitech.wikimedia.org/wiki/Maintenance_server#See_also https://wikitech.wikimedia.org/wiki/Maintenance_scripts promptly, so that we can ensure the new system meets your needs before that happens.}} Starting a maintenance scripthttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Starting_a_maintenance_script Tailing stdouthttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Tailing_stdout Input on stdinhttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Input_on_stdin Input from a filehttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Input_from_a_file Shelling out to mwscript-k8shttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Shelling_out_to_mwscript-k8s Interacting with jobshttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Interacting_with_jobs Listing jobshttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Listing_jobs Showing script outputhttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Showing_script_output Terminating a jobhttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Terminating_a_job Not yet supportedhttps://wikitech.wikimedia.org/wiki/Maintenance_scripts#Not_yet_supported https://wikitech.wikimedia.org/wiki/Incidents/2021-06-29_trwikivoyage_primary_db ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-29_trwikivoyage_primary_db#Summary Detailshttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-29_trwikivoyage_primary_db#Details Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-29_trwikivoyage_primary_db#Actionables https://wikitech.wikimedia.org/wiki/Mwlog2002 mwlog2002.eqiad. Codfw data centerhttps://wikitech.wikimedia.org/wiki/Category:Codfw_data_center Server usage:Logginghttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Logging Servershttps://wikitech.wikimedia.org/wiki/Category:Servers Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Projects [Operations Phabricator Project] https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Coordination Planning and executing a DC switchover in a non-emergency requires coordinating between various SRE subteams, RelEng, CommRel and others. While we aim to make this a non-event from a user perspective, we're not there yet from an operational perspective. Schedulinghttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Coordination#Scheduling Taskshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Coordination#Tasks Noteshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Coordination#Notes https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Sw_raid_rebuild_directions When a defective disk is swapped out on a sw raid, it is not automatically rebuilt. Rebuilding requires adding the new disk in with the following procedure (uses wdqs2007 disk replacement [this task] as an example): https://wikitech.wikimedia.org/wiki/Drmrs_data_center drmrs (pronounced dreamers, or the Marseille DC) is a caching data center located in Marseille, France. Photo galleryhttps://wikitech.wikimedia.org/wiki/Drmrs_data_center#Photo_gallery Further readinghttps://wikitech.wikimedia.org/wiki/Drmrs_data_center#Further_reading See alsohttps://wikitech.wikimedia.org/wiki/Drmrs_data_center#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/07 ==Week of July 05== Week of July 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/07#Week_of_July_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/07#=== Week of July 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/07#Week_of_July_12 Week of July 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/07#Week_of_July_19 Week of July 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/07#Week_of_July_26 https://wikitech.wikimedia.org/wiki/Incidents/2021-06-15_Eqsin_network ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-15_Eqsin_network#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-15_Eqsin_network#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-06-30_Ulsfo_traffic_surge ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-30_Ulsfo_traffic_surge#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-06-30_Ulsfo_traffic_surge#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError === Error / Incident === Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Debugging Check cluster health detailshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Check_cluster_health_details Daemon crash debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Daemon_crash_debugging Clearing the crashhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Clearing_the_crash Damaged PG or Inconsistent PGhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Damaged_PG_or_Inconsistent_PG Slow operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Slow_operations Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Related_information Example taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInError#Example_tasks https://wikitech.wikimedia.org/wiki/Incidents/2021-07-14_eventgate-analytics_latency_spike_caused_MW_app_server_overload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-14_eventgate-analytics_latency_spike_caused_MW_app_server_overload#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-14_eventgate-analytics_latency_spike_caused_MW_app_server_overload#Actionables https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks This page contains basic resources for developers who want to author and publish runbooks for Data Services on Wikitech. Before you beginhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#Before_you_begin What is a runbook?https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#What_is_a_runbook? When should you use a runbook?https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#When_should_you_use_a_runbook? Tips for building useful runbookshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#Tips_for_building_useful_runbooks Data Services runbook templateshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#Data_Services_runbook_templates Where to publish runbooks for Data Serviceshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#Where_to_publish_runbooks_for_Data_Services Existing runbookshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#Existing_runbooks See Alsohttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks#See_Also https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template This is a template for Data Services runbooks. Admin permissions headerhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#Admin_permissions_header Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#Debugging Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#Related_information What else to includehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#What_else_to_include Exampleshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Runbook_template#Examples https://wikitech.wikimedia.org/wiki/Juniper_virtual_chassis_member_replace This page describes how to replace a member QFX or EX switch configured in a virtual-chassis. Assumptionshttps://wikitech.wikimedia.org/wiki/Juniper_virtual_chassis_member_replace#Assumptions Procedurehttps://wikitech.wikimedia.org/wiki/Juniper_virtual_chassis_member_replace#Procedure Prep Member Switchhttps://wikitech.wikimedia.org/wiki/Juniper_virtual_chassis_member_replace#Prep_Member_Switch Prep virtual-chassis confighttps://wikitech.wikimedia.org/wiki/Juniper_virtual_chassis_member_replace#Prep_virtual-chassis_config Enable revenue portshttps://wikitech.wikimedia.org/wiki/Juniper_virtual_chassis_member_replace#Enable_revenue_ports https://wikitech.wikimedia.org/wiki/Maps/Maps_experiments Because maps-experiments is not configured in deployment-prep (they are different projects in Cloud VPS) a hack is needed to deploy kartotherian code to maps-master01. The problem is that the deploy instance in deployment-prep doesn't recognize connections to maps-experiments project, but we can fetch the needed code the other way around. https://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-16_asw-a2-codfw_network#Actionables https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Refresh_sssd_caches How to clear sssd caches (hosts, groups, etc). Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Refresh_sssd_caches#Overview Fixinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Refresh_sssd_caches#Fixing https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin Apache Gobblin is Hadoop ingestion software used at WMF primarily to import data from Kafka into HDFS. Gobblin jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Gobblin_jobs gobblin-wmfhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#gobblin-wmf Releasing new Gobblin versionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Releasing_new_Gobblin_versions Monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Monitoring Reading State Storehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Reading_State_Store Technical findingshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Technical_findings Pulling from Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Pulling_from_Kafka Gobblin metric detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Gobblin#Gobblin_metric_details https://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-07-26_ruwikinews_DynamicPageList#Actionables https://wikitech.wikimedia.org/wiki/Maps/External_usage maps.wikimedia. https://wikitech.wikimedia.org/wiki/Dragonfly Dragonfly is a peer-to-peer-based file distribution system we use for distributing docker image layers to Kubernetes worker nodes. It was added to our infrastructure to overcome the issue of overloaded Docker-registry nodes when big deployments (in terms of number of replicas) that also use big docker images (in terms of layer size) are rolled out (read: MediaWiki). Operationshttps://wikitech.wikimedia.org/wiki/Dragonfly#Operations Monitoring / logginghttps://wikitech.wikimedia.org/wiki/Dragonfly#Monitoring_/_logging Where to look for logshttps://wikitech.wikimedia.org/wiki/Dragonfly#Where_to_look_for_logs Disable the use of Dragonfly on a Kubernetes nodehttps://wikitech.wikimedia.org/wiki/Dragonfly#Disable_the_use_of_Dragonfly_on_a_Kubernetes_node Packaginghttps://wikitech.wikimedia.org/wiki/Dragonfly#Packaging Importing a new versionhttps://wikitech.wikimedia.org/wiki/Dragonfly#Importing_a_new_version Building a new versionhttps://wikitech.wikimedia.org/wiki/Dragonfly#Building_a_new_version Publishing a new versionhttps://wikitech.wikimedia.org/wiki/Dragonfly#Publishing_a_new_version Patcheshttps://wikitech.wikimedia.org/wiki/Dragonfly#Patches Resourceshttps://wikitech.wikimedia.org/wiki/Dragonfly#Resources https://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore This section describes backup configuration and restore procedure for GitLab instance. Backupshttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Backups Backup retentionhttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Backup_retention Backup partitionshttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Backup_partitions Storing backups in baculahttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Storing_backups_in_bacula Restorehttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Restore Fetch backups from baculahttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Fetch_backups_from_bacula Restore backup to GitLabhttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Restore_backup_to_GitLab Automated restorehttps://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Automated_restore Manual restore:https://wikitech.wikimedia.org/wiki/GitLab/Backup_and_Restore#Manual_restore: https://wikitech.wikimedia.org/wiki/GitLab/Failover GitLab has a active host and one or more replicas. The replicas are cold-standby currently, meaning they don't serve any production traffic and hold up to 24h old data. Prerequisiteshttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Prerequisites Planned Failoverhttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Planned_Failover Before failoverhttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Before_failover Changes to prepare in advancehttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Changes_to_prepare_in_advance During failover (using cookbook)https://wikitech.wikimedia.org/wiki/GitLab/Failover#During_failover_(using_cookbook) During failover (manual steps)https://wikitech.wikimedia.org/wiki/GitLab/Failover#During_failover_(manual_steps) After failoverhttps://wikitech.wikimedia.org/wiki/GitLab/Failover#After_failover Unplanned Failoverhttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Unplanned_Failover Get as new data as possiblehttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Get_as_new_data_as_possible During failoverhttps://wikitech.wikimedia.org/wiki/GitLab/Failover#During_failover Aborting Failover/Rollbackhttps://wikitech.wikimedia.org/wiki/GitLab/Failover#Aborting_Failover/Rollback I've already merged some changeshttps://wikitech.wikimedia.org/wiki/GitLab/Failover#I've_already_merged_some_changes I've merged the DNS changehttps://wikitech.wikimedia.org/wiki/GitLab/Failover#I've_merged_the_DNS_change I've merged the puppet changehttps://wikitech.wikimedia.org/wiki/GitLab/Failover#I've_merged_the_puppet_change I haven't merged anything yethttps://wikitech.wikimedia.org/wiki/GitLab/Failover#I_haven't_merged_anything_yet https://wikitech.wikimedia.org/wiki/GitLab/Monitoring |left|right}}:13px; margin:|5px 12px 5px 0|5px 0 5px 12px}}; width: 350px; Metrics and dashboardshttps://wikitech.wikimedia.org/wiki/GitLab/Monitoring#Metrics_and_dashboards Alertinghttps://wikitech.wikimedia.org/wiki/GitLab/Monitoring#Alerting https://wikitech.wikimedia.org/wiki/MariaDB/Alerting == IRC == IRChttps://wikitech.wikimedia.org/wiki/MariaDB/Alerting#IRC https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater_Rollout_Plan Moved to phabricator at phab:T288231 https://wikitech.wikimedia.org/wiki/GrowthExperiments_setup This is a documentation for developers for adding [features] to a Wikimedia wiki. For requesting these features as a community member, see [the Growth experiments on your wiki] instead. Preparationhttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup#Preparation Dark mode deploymenthttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup#Dark_mode_deployment Prepare patcheshttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup#Prepare_patches Deploymenthttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup#Deployment Verificationhttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup#Verification See alsohttps://wikitech.wikimedia.org/wiki/GrowthExperiments_setup#See_also https://wikitech.wikimedia.org/wiki/GitLab/Replica gitlab-replica-a.wikimedia. Manual sync of replicahttps://wikitech.wikimedia.org/wiki/GitLab/Replica#Manual_sync_of_replica Transfer of backup to replicahttps://wikitech.wikimedia.org/wiki/GitLab/Replica#Transfer_of_backup_to_replica Restore of backup on replicahttps://wikitech.wikimedia.org/wiki/GitLab/Replica#Restore_of_backup_on_replica Automated sync of replicahttps://wikitech.wikimedia.org/wiki/GitLab/Replica#Automated_sync_of_replica Usagehttps://wikitech.wikimedia.org/wiki/GitLab/Replica#Usage https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/OKR =Our objectives and areas of focus= Our objectives and areas of focushttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/OKR#Our_objectives_and_areas_of_focus https://wikitech.wikimedia.org/wiki/SRE/Traffic/Currently_working_on See our Workboard containing the work in progress and queued tasks https://wikitech.wikimedia.org/wiki/SRE/Traffic/Team wikimedia.org Wikimedia Foundation staffhttps://wikitech.wikimedia.org/wiki/Category:Wikimedia_Foundation_staff https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08 ==Week of August 02== Week of August 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08#Week_of_August_02 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08#=== Week of August 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08#Week_of_August_09 Week of August 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08#Week_of_August_16 Week of August 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08#Week_of_August_23 Week of August 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/08#Week_of_August_30 https://wikitech.wikimedia.org/wiki/SRE/Observability/Currently_working_on Our [containing the work in progress and queued tasks] https://wikitech.wikimedia.org/wiki/SRE/Service_Operations/About SRE Service Operations▼ https://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Intake_Standards Architecture: We are happy to talk to you about the operational architecture of your system, and discuss implementation options such as database, caching, shelling out or the operational aspects of running on kubernetes. The best way to start that conversation is to open a Phabricator task. https://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Ownership https://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Team wikimedia.org https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Distributed_storage/Dashboards * Swift cluster resource utilization: eqiad codfw https://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation == SRE Service Operations documentation == SRE Service Operations documentationhttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation#SRE_Service_Operations_documentation https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Distributed_storage https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Atlas_Anchor == Initial Setup Directions == Initial Setup Directionshttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Atlas_Anchor#Initial_Setup_Directions Firmware Imagehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Atlas_Anchor#Firmware_Image Boot From USB to (re)Install Anchorhttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Atlas_Anchor#Boot_From_USB_to_(re)Install_Anchor Validate System is Onlinehttps://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Atlas_Anchor#Validate_System_is_Online https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Manual_maintenance == Monthly == Monthlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Manual_maintenance#Monthly Annualhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Manual_maintenance#Annual https://wikitech.wikimedia.org/wiki/SRE/Mailing_Lists Please use sre@wikimedia.org for team-wide communications, plus the subteam ones for subteam-specific communication. SRE Organization:https://wikitech.wikimedia.org/wiki/SRE/Mailing_Lists#SRE_Organization: SRE Teams:https://wikitech.wikimedia.org/wiki/SRE/Mailing_Lists#SRE_Teams: All SREs in Technologyhttps://wikitech.wikimedia.org/wiki/SRE/Mailing_Lists#All_SREs_in_Technology Problems that we are trying to solve:https://wikitech.wikimedia.org/wiki/SRE/Mailing_Lists#Problems_that_we_are_trying_to_solve: https://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services Pontoon is designed to be a realistic testbed for production, but smaller. Trade offs change too: we can exchange some reliability and availability for a simpler system that’s easy to understand and operate, with all the relevant functionality intact. What's a service?https://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services#What's_a_service? Load Balancinghttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services#Load_Balancing Service Discoveryhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services#Service_Discovery Public serviceshttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services#Public_services Frontendhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services#Frontend Enable SD and LB in your stackhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Services#Enable_SD_and_LB_in_your_stack https://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-04-03_mailman2_attachments#Actionables https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Distributed_storage/Architecture https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45 == 2021-07-31 == 2021-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-31 2021-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-30 2021-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-29 2021-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-28 2021-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-27 2021-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-26 2021-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-24 2021-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-23 2021-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-22 2021-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-21 2021-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-20 2021-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-19 2021-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-16 2021-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-15 2021-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-14 2021-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-13 2021-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-12 2021-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-09 2021-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-08 2021-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-07 2021-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-06 2021-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-05 2021-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-04 2021-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-03 2021-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-02 2021-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-07-01 2021-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-30 2021-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-29 2021-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-28 2021-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-27 2021-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-26 2021-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-25 2021-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-24 2021-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-23 2021-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-22 2021-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-21 2021-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-18 2021-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-17 2021-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-16 2021-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-15 2021-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-14 2021-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-12 2021-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-11 2021-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-10 2021-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-09 2021-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-08 2021-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-07 2021-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-05 2021-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-04 2021-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-03 2021-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-02 2021-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-06-01 2021-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-31 2021-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-29 2021-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-28 2021-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-27 2021-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-26 2021-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-25 2021-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-24 2021-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-23 2021-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-22 2021-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-21 2021-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-20 2021-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-19 2021-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-18 2021-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-17 2021-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-16 2021-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-15 2021-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-14 2021-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-13 2021-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-12 2021-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-11 2021-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-10 2021-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-09 2021-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-08 2021-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-07 2021-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-06 2021-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-05 2021-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-04 2021-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-03 2021-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-02 2021-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_45#2021-05-01 https://wikitech.wikimedia.org/wiki/Add_Image This page contains information about the infrastructure used for the Add Image structured task project ([For project information, see mw:Growth/Personalized first day/Structured tasks/Add an image]. (Parts of the infrastructure are used for other image recommendation features, too; currently this page is written from the POV of maintaining Growth team features. High-level summaryhttps://wikitech.wikimedia.org/wiki/Add_Image#High-level_summary Infobox exclusionhttps://wikitech.wikimedia.org/wiki/Add_Image#Infobox_exclusion Enabling image recommendations on a new wikihttps://wikitech.wikimedia.org/wiki/Add_Image#Enabling_image_recommendations_on_a_new_wiki Section-level imageshttps://wikitech.wikimedia.org/wiki/Add_Image#Section-level_images Troubleshootinghttps://wikitech.wikimedia.org/wiki/Add_Image#Troubleshooting Example API responsehttps://wikitech.wikimedia.org/wiki/Add_Image#Example_API_response See alsohttps://wikitech.wikimedia.org/wiki/Add_Image#See_also https://wikitech.wikimedia.org/wiki/Kubernetes/Logging == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#Introduction Control-plane logginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#Control-plane_logging Cluster components logginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#Cluster_components_logging Workload/Pod logginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#Workload/Pod_logging rsyslogdhttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#rsyslogd Common issueshttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#Common_issues Exceptionshttps://wikitech.wikimedia.org/wiki/Kubernetes/Logging#Exceptions https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner |left|right}}:13px; margin:|5px 12px 5px 0|5px 0 5px 12px}}; width: 350px; GitLab Runner typeshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner#GitLab_Runner_types Permission matrixhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner#Permission_matrix Adding new runners (end-users)https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner#Adding_new_runners_(end-users) Adding new runners (administrators)https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner#Adding_new_runners_(administrators) Evaluation and Designhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner#Evaluation_and_Design https://wikitech.wikimedia.org/wiki/News/Stretch_deprecation This page keeps track of our ongoing effort towards Debian Stretch deprecation, which happened upstream on July 6, 2021. Tell me exactly what I need to dohttps://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Tell_me_exactly_what_I_need_to_do Cloud VPS project maintainershttps://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Cloud_VPS_project_maintainers Toolforge tool maintainershttps://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Toolforge_tool_maintainers Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Why_are_we_doing_this? Timelines. What will change? What has changed already?https://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Timelines._What_will_change?_What_has_changed_already? Cloud VPS projectshttps://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Cloud_VPS_projects Toolforgehttps://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#Toolforge See alsohttps://wikitech.wikimedia.org/wiki/News/Stretch_deprecation#See_also https://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-01_partial_parsoid_outage#Actionables https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters We have multiple Kubernetes clusters deployed in what we call the "production" realm. This page does not describe kubernetes clusters maintained in other realms, e. WikiKubehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#WikiKube Goalhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#Goal Datacentershttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#Datacenters Traffic Flowhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#Traffic_Flow staginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#staging ml-servehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#ml-serve dse-k8shttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#dse-k8s auxhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#aux Creating a new clusterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters#Creating_a_new_cluster https://wikitech.wikimedia.org/wiki/SRE/Documentation Looking for SRE documentation? Here are the team specific pages: https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Contact * Email: sre-data-persistence@wikimedia.org https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/About About Us▼ https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Ownership * MariaDB https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Currently_working_on Tickets: https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/OKR TBD https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Intake_Standards TBD https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Team [| [[meta:User:MArostegui_(WMF)|Manuel] | [Beth] | [| [[meta:User:ASarabadani_(WMF)|Amir] | [(WMF)|Eric] | [| [[meta:User:KOfori (WMF)|Kwaku] https://wikitech.wikimedia.org/wiki/GitLab/Upgrade |left|right}}:13px; margin:|5px 12px 5px 0|5px 0 5px 12px}}; width: 350px; WMF upgrade pathhttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#WMF_upgrade_path Upgrade GitLab Debian packagehttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Upgrade_GitLab_Debian_package Prerequisiteshttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Prerequisites Automated Upgrade (sre.gitlab.upgrade cookbook)https://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Automated_Upgrade_(sre.gitlab.upgrade_cookbook) Manual Upgradehttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Manual_Upgrade Preparationshttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Preparations Upgrading GitLabhttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Upgrading_GitLab GitLab Runnerhttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#GitLab_Runner Upgrading GitLab Shared Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Upgrading_GitLab_Shared_Runners Upgrading GitLab Trusted Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Upgrading_GitLab_Trusted_Runners Upgrading GitLab Cloud Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Upgrading_GitLab_Cloud_Runners Steps after upgradinghttps://wikitech.wikimedia.org/wiki/GitLab/Upgrade#Steps_after_upgrading https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/ORES [is a machine learning platform maintained by WMF. We use ORES extensively in Wikidata and have developed parts of it related to Wikidata. How to build item quality modelhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/ORES#How_to_build_item_quality_model Preparing the model for deploymenthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/ORES#Preparing_the_model_for_deployment Run the model on a dumphttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/ORES#Run_the_model_on_a_dump https://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-06_Wikifeeds#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/09 ==Week of September 06== Week of September 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/09#Week_of_September_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/09#=== Week of September 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/09#Week_of_September_13 Week of September 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/09#Week_of_September_20 Week of September 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/09#Week_of_September_27 https://wikitech.wikimedia.org/wiki/Incidents/2021-09-13_cirrussearch_restart == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-13_cirrussearch_restart#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-13_cirrussearch_restart#Actionables https://wikitech.wikimedia.org/wiki/Durum durum 🌾 (named after [wheat]) is a service that allows Wikimedia DNS users to check if they have correctly configured and are using Wikimedia DNS as their [over HTTPS|DNS-over-HTTPS] (DoH) and [over TLS|DNS-over-TLS] (DoT) resolver. Introductionhttps://wikitech.wikimedia.org/wiki/Durum#Introduction How does this work?https://wikitech.wikimedia.org/wiki/Durum#How_does_this_work? APIhttps://wikitech.wikimedia.org/wiki/Durum#API Why the UUID?https://wikitech.wikimedia.org/wiki/Durum#Why_the_UUID? Noteshttps://wikitech.wikimedia.org/wiki/Durum#Notes https://wikitech.wikimedia.org/wiki/Scap/Scap3_check_scripts Scap3 can run check scripts for each phase of deployment. NRPE checkshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_check_scripts#NRPE_checks https://wikitech.wikimedia.org/wiki/Scap/Scap3_config_deployment Scap3 can be used to deploy a service's configuration files. What happens on the deployment serverhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_config_deployment#What_happens_on_the_deployment_server What happens on targetshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_config_deployment#What_happens_on_targets https://wikitech.wikimedia.org/wiki/Scap/Scap3_deployment_groups This feature was introduced in differential revision D16 https://wikitech.wikimedia.org/wiki/Scap/Scap3_limit === Filter deploy hosts with --limit-hosts === Filter deploy hosts with --limit-hostshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_limit#Filter_deploy_hosts_with_--limit-hosts https://wikitech.wikimedia.org/wiki/Scap/Scap3_structured_logging The structured logging feature of scap3 was introduced in differential revision D18 Exampleshttps://wikitech.wikimedia.org/wiki/Scap/Scap3_structured_logging#Examples Tail behaviorhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_structured_logging#Tail_behavior Latest log file behaviorhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_structured_logging#Latest_log_file_behavior Single log file behaviorhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_structured_logging#Single_log_file_behavior https://wikitech.wikimedia.org/wiki/Scap/Release This page is documentation for releasing a new version of Scap to Wikimedia Production. Buildinghttps://wikitech.wikimedia.org/wiki/Scap/Release#Building Roll out to betahttps://wikitech.wikimedia.org/wiki/Scap/Release#Roll_out_to_beta Roll out to productionhttps://wikitech.wikimedia.org/wiki/Scap/Release#Roll_out_to_production Rollbackhttps://wikitech.wikimedia.org/wiki/Scap/Release#Rollback Target host bootstrappinghttps://wikitech.wikimedia.org/wiki/Scap/Release#Target_host_bootstrapping https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/ Portal:Cloud VPS subpages. https://wikitech.wikimedia.org/wiki/Maps/OSM = OpenStreetMaps Extract Transform Load (ETL) procedure = OpenStreetMaps Extract Transform Load (ETL) procedurehttps://wikitech.wikimedia.org/wiki/Maps/OSM#OpenStreetMaps_Extract_Transform_Load_(ETL)_procedure Database requirementshttps://wikitech.wikimedia.org/wiki/Maps/OSM#Database_requirements Imposm3 mapping and DB schemahttps://wikitech.wikimedia.org/wiki/Maps/OSM#Imposm3_mapping_and_DB_schema Import OSM datahttps://wikitech.wikimedia.org/wiki/Maps/OSM#Import_OSM_data Rendering Mapshttps://wikitech.wikimedia.org/wiki/Maps/OSM#Rendering_Maps Layers Functionshttps://wikitech.wikimedia.org/wiki/Maps/OSM#Layers_Functions Updating Layers Functionshttps://wikitech.wikimedia.org/wiki/Maps/OSM#Updating_Layers_Functions https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting Kubernetes has a lot of moving parts and offers wide configuration options. So misconfiguration can happen. Troubleshooting a deploymenthttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment Troubleshooting a podhttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_pod Get a container's logshttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Get_a_container's_logs Get a pod's status, exit code, and other eventshttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Get_a_pod's_status,_exit_code,_and_other_events Exec into a pod and run commandshttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Exec_into_a_pod_and_run_commands Strace a pod main container processhttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Strace_a_pod_main_container_process Get a pod's IP and run sanity-checkhttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Get_a_pod's_IP_and_run_sanity-check Additional Resourceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Additional_Resources https://wikitech.wikimedia.org/wiki/Event_Platform/Event_Utilities Wikimedia Event Utilities are code libraries for interacting with Wikimedia's Event Platform, including Stream config, schemas and producing events to Kafka, and stream processing abstractions to aide building and deploying stream processing applications. [Event Utilities]https://wikitech.wikimedia.org/wiki/Event_Platform/Event_Utilities#[Event_Utilities] eventutilties-core (java)https://wikitech.wikimedia.org/wiki/Event_Platform/Event_Utilities#eventutilties-core_(java) eventutilities-flink (java)https://wikitech.wikimedia.org/wiki/Event_Platform/Event_Utilities#eventutilities-flink_(java) eventutiltlies-pythonhttps://wikitech.wikimedia.org/wiki/Event_Platform/Event_Utilities#eventutiltlies-python https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Events == Accessing Event Data == Accessing Event Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Events#Accessing_Event_Data https://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021) == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Background Current statushttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Current_status Collected metricshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Collected_metrics Missing metricshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Missing_metrics Alternativeshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Alternatives Changing toolhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Changing_tool Crafting a new more generic toolhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Crafting_a_new_more_generic_tool Cleanup the current versionhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Cleanup_the_current_version Tuning the navigation timing extensionhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Tuning_the_navigation_timing_extension Remove unused metricshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Remove_unused_metrics Tune some of the metrics we collect to only collect bare minimumhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Tune_some_of_the_metrics_we_collect_to_only_collect_bare_minimum Add missing metricshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Add_missing_metrics New schema: perfbeacon?https://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#New_schema:_perfbeacon? Outstanding issueshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Outstanding_issues Next stepshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Future_of_the_NavigationTiming_extension_(2021)#Next_steps https://wikitech.wikimedia.org/wiki/SONiC == Evaluation == Evaluationhttps://wikitech.wikimedia.org/wiki/SONiC#Evaluation Productionhttps://wikitech.wikimedia.org/wiki/SONiC#Production Cheat-sheethttps://wikitech.wikimedia.org/wiki/SONiC#Cheat-sheet https://wikitech.wikimedia.org/wiki/Deployments/Train/Repos As of 2021-09-22 a train deployment is: https://wikitech.wikimedia.org/wiki/Maps/v2/Architecture == Maps V2 - Architecture == Maps V2 - Architecturehttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Maps_V2_-_Architecture Introhttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Intro Notable changeshttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Notable_changes Componentshttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Components Postgres/PostGIShttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Postgres/PostGIS Imposmhttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Imposm Kartotherianhttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Kartotherian Tegolahttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Tegola EventPlatformhttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#EventPlatform Kuberneteshttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Kubernetes Diagramhttps://wikitech.wikimedia.org/wiki/Maps/v2/Architecture#Diagram https://wikitech.wikimedia.org/wiki/HTTPS/2021_Let%27s_Encrypt_root_expiry https://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks == Common maps tasks == Common maps taskshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Common_maps_tasks Access map nodeshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Access_map_nodes Deploy new codehttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Deploy_new_code Kartotherianhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Kartotherian Package the codehttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Package_the_code Submit changes to production with scaphttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Submit_changes_to_production_with_scap Tegolahttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Tegola Configuration changeshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Configuration_changes Postgreshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Postgres Imposmhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Imposm EventGatehttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#EventGate Enable/disable import processhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Enable/disable_import_process Run a planet importhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Run_a_planet_import Pooling/depooling nodeshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Pooling/depooling_nodes Get a DB shellhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Get_a_DB_shell Run an example queryhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Run_an_example_query Reindex DBhttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Reindex_DB Example HTTP requestshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Example_HTTP_requests Example tegola commandshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Example_tegola_commands Clean-up Kafka queuehttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Clean-up_Kafka_queue List tiles on Openstack Swifthttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#List_tiles_on_Openstack_Swift Load balance maps requestshttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Load_balance_maps_requests Check tile pregeneration statushttps://wikitech.wikimedia.org/wiki/Maps/v2/Common_tasks#Check_tile_pregeneration_status https://wikitech.wikimedia.org/wiki/Maps/v2 == Subpages == Subpageshttps://wikitech.wikimedia.org/wiki/Maps/v2#Subpages https://wikitech.wikimedia.org/wiki/Maps/v2/Metrics == Metrics == Metricshttps://wikitech.wikimedia.org/wiki/Maps/v2/Metrics#Metrics Maps nodeshttps://wikitech.wikimedia.org/wiki/Maps/v2/Metrics#Maps_nodes Host overviewhttps://wikitech.wikimedia.org/wiki/Maps/v2/Metrics#Host_overview Tegolahttps://wikitech.wikimedia.org/wiki/Maps/v2/Metrics#Tegola App metricshttps://wikitech.wikimedia.org/wiki/Maps/v2/Metrics#App_metrics Kartotherianhttps://wikitech.wikimedia.org/wiki/Maps/v2/Metrics#Kartotherian https://wikitech.wikimedia.org/wiki/Maps/v2/Logs === Log files in the server === Log files in the serverhttps://wikitech.wikimedia.org/wiki/Maps/v2/Logs#Log_files_in_the_server Kartotherianhttps://wikitech.wikimedia.org/wiki/Maps/v2/Logs#Kartotherian Tegola serverhttps://wikitech.wikimedia.org/wiki/Maps/v2/Logs#Tegola_server Tegola pregenerationhttps://wikitech.wikimedia.org/wiki/Maps/v2/Logs#Tegola_pregeneration https://wikitech.wikimedia.org/wiki/Maps/v2/Infrastructure == Infrastructure == Infrastructurehttps://wikitech.wikimedia.org/wiki/Maps/v2/Infrastructure#Infrastructure Noteshttps://wikitech.wikimedia.org/wiki/Maps/v2/Infrastructure#Notes Maps nodeshttps://wikitech.wikimedia.org/wiki/Maps/v2/Infrastructure#Maps_nodes Kuberneteshttps://wikitech.wikimedia.org/wiki/Maps/v2/Infrastructure#Kubernetes Diagramhttps://wikitech.wikimedia.org/wiki/Maps/v2/Infrastructure#Diagram https://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#Summary Impacthttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#Impact Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#Detection Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#What_went_poorly? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#How_many_people_were_involved_in_the_remediation? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-12_Esams_upload#Actionables https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project === Overview === Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Overview Create a project internal NFS serverhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Create_a_project_internal_NFS_server Get the new service fqdn namehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Get_the_new_service_fqdn_name Update yaml config in Puppethttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Update_yaml_config_in_Puppet Find out the GID for the projecthttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Find_out_the_GID_for_the_project Add entry to the yamlhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Add_entry_to_the_yaml Enabling on the VMshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Enabling_on_the_VMs Historical notes for bare-metal pre-NFS servershttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Historical_notes_for_bare-metal_pre-NFS_servers Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Enable_NFS_for_a_project#Related_information https://wikitech.wikimedia.org/wiki/Incidents/2021-09-29_eqiad-kubernetes ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-29_eqiad-kubernetes#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-29_eqiad-kubernetes#Actionables https://wikitech.wikimedia.org/wiki/Mtail mtail is a tool for extracting metrics from application logs to be exported into a timeseries database or timeseries calculator for alerting and dashboarding. https://wikitech.wikimedia.org/wiki/Portada Wikitech es el hogar de la documentación técnica de la infraestructura y los servicios de [Foundation]. Esto incluye clústeres de producción, Servicios en la nube de Wikimedia, alojamiento Toolforge y el Beta Cluster. https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas Wikireplicas need work sometimes, fail, etc. This details how to depool a wiki replica database server. Depoolinghttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas#Depooling web vs analytics considerationshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas#web_vs_analytics_considerations Depooling using conftool on cumin hostshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas#Depooling_using_conftool_on_cumin_hosts Depooling using confctl shortcuts on the hosts themselveshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas#Depooling_using_confctl_shortcuts_on_the_hosts_themselves Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Depool_wikireplicas#Related_information https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/GridEngine_plans_and_timeline This page contains information about WMCS plans and timeline for Toolforge GridEngine. Timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/GridEngine_plans_and_timeline#Timeline Use case continuityhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/GridEngine_plans_and_timeline#Use_case_continuity Reasoninghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/GridEngine_plans_and_timeline#Reasoning See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/GridEngine_plans_and_timeline#See_also https://wikitech.wikimedia.org/wiki/Out-of-band_network All of our sites have a dedicated Out Of Band (OOB) network, consisting of internet access (DIA), routers and switches physically separated from our production network. Prerequisiteshttps://wikitech.wikimedia.org/wiki/Out-of-band_network#Prerequisites Step by stephttps://wikitech.wikimedia.org/wiki/Out-of-band_network#Step_by_step SSH Algorithmshttps://wikitech.wikimedia.org/wiki/Out-of-band_network#SSH_Algorithms No DNShttps://wikitech.wikimedia.org/wiki/Out-of-band_network#No_DNS See alsohttps://wikitech.wikimedia.org/wiki/Out-of-band_network#See_also https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cloudswift This page contains information on our plans to introduce the cloudswift service to Cloud VPS, a new Openstack API for object storage. Whyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cloudswift#Why How it workshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cloudswift#How_it_works Proposed setuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cloudswift#Proposed_setup Additional noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cloudswift#Additional_notes See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cloudswift#See_also https://wikitech.wikimedia.org/wiki/Machine_Learning This is a placeholder page for the Wikimedia Foundation's Machine Learning team. Contact the ML teamhttps://wikitech.wikimedia.org/wiki/Machine_Learning#Contact_the_ML_team Docs availablehttps://wikitech.wikimedia.org/wiki/Machine_Learning#Docs_available https://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage The act of reimaging refers to the clean installation of the OS (operating system) on a host. It could be either the first installation of a new fresh host (imaging) or the upgrade of a host to a newer OS version (reimaging). Physical hostshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Physical_hosts How to run ithttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#How_to_run_it Check available optionshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Check_available_options Reimage of a generic host that doesn't need any specific optionshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Reimage_of_a_generic_host_that_doesn't_need_any_specific_options Reimage of a generic host behind LVShttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Reimage_of_a_generic_host_behind_LVS Reimage of a MediaWiki hosthttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Reimage_of_a_MediaWiki_host Image of a new or previously decommissioned hosthttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Image_of_a_new_or_previously_decommissioned_host Operations performed by the cookbookhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Operations_performed_by_the_cookbook Pre-reimage validation operationshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Pre-reimage_validation_operations Reimage operationshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Reimage_operations Monitoring progress in the consolehttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Monitoring_progress_in_the_console Virtual hostshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Virtual_hosts DHCP Automationhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#DHCP_Automation Workflowhttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Workflow Key conceptshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Key_concepts Example snippethttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Example_snippet What to do if...https://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#What_to_do_if... The reimage failshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#The_reimage_fails Debian Installer Can't Detect NICshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Debian_Installer_Can't_Detect_NICs IPMI failshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#IPMI_fails DHCP issueshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#DHCP_issues Icinga configuration correctness alert fireshttps://wikitech.wikimedia.org/wiki/Server_Lifecycle/Reimage#Icinga_configuration_correctness_alert_fires https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups This page contains several options we are currently considering for introducing cinder backups. Contexthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Context Storage sizehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Storage_size Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Options Option 1: use cinder backup API + POSIX backup driver on cloudbackups servershttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Option_1:_use_cinder_backup_API_+_POSIX_backup_driver_on_cloudbackups_servers Proshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Pros Conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Cons Option 2: use backy2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Option_2:_use_backy2 Discarded optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#Discarded_options using cinder backup API + swifthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#using_cinder_backup_API_+_swift See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/cinder_backups#See_also https://wikitech.wikimedia.org/wiki/Incidents/2021-10-08_network_provider ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-08_network_provider#Summary_and_Metadata Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-08_network_provider#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-08_network_provider#Actionables https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/10 ==Week of October 04== Week of October 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/10#Week_of_October_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/10#=== Week of October 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/10#Week_of_October_18 Week of October 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/10#Week_of_October_25 https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop EdgeTrafficDrop is a Prometheus Alertmanager alert defined in traffic.yaml on the operations/alerts repo. Things to dohttps://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop#Things_to_do https://wikitech.wikimedia.org/wiki/Db-kill db-kill is an emergency-only tool, that simplifies the killing of long running queries on a host. It kills (until manually stopped) queries running for over 10 seconds or sleeping over 10 seconds on the given mysql instance. Detailshttps://wikitech.wikimedia.org/wiki/Db-kill#Details Usagehttps://wikitech.wikimedia.org/wiki/Db-kill#Usage Argumentshttps://wikitech.wikimedia.org/wiki/Db-kill#Arguments Codehttps://wikitech.wikimedia.org/wiki/Db-kill#Code https://wikitech.wikimedia.org/wiki/Maps/v2/Troubleshooting Placeholder page to add a common troubleshooting for Maps, Tegola, and future services Monitoringhttps://wikitech.wikimedia.org/wiki/Maps/v2/Troubleshooting#Monitoring https://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas This is a page to document and discuss ideas for improving / replacing the train deployment process. We must replace this broken process with something healthy.https://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#We_must_replace_this_broken_process_with_something_healthy. Small incremental changeshttps://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#Small_incremental_changes Deploy smaller batches more frequentlyhttps://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#Deploy_smaller_batches_more_frequently Just stop cutting train branches! Everything must be landed in production via backports to the existing production branch.https://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#Just_stop_cutting_train_branches!_Everything_must_be_landed_in_production_via_backports_to_the_existing_production_branch. Use commit metadata to raise visibility of risky patcheshttps://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#Use_commit_metadata_to_raise_visibility_of_risky_patches Large and disruptive changeshttps://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#Large_and_disruptive_changes Deploy Batches of Patches, one per teamhttps://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#Deploy_Batches_of_Patches,_one_per_team See alsohttps://wikitech.wikimedia.org/wiki/Deployments/Train/Ideas#See_also https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/ceph_client_refactor This page contains a puppet refactor proposal for the ceph client code. Problem statementhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/ceph_client_refactor#Problem_statement Proposed solutionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/ceph_client_refactor#Proposed_solution abstractionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/ceph_client_refactor#abstraction code organization proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/ceph_client_refactor#code_organization_proposal See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/ceph_client_refactor#See_also https://wikitech.wikimedia.org/wiki/OpenSearch OpenSearch is the core data storage component of the Observability Logging stack. It replaced ElasticSearch and Kibana in 2021. Buildinghttps://wikitech.wikimedia.org/wiki/OpenSearch#Building Environmenthttps://wikitech.wikimedia.org/wiki/OpenSearch#Environment OpenSearchhttps://wikitech.wikimedia.org/wiki/OpenSearch#OpenSearch OpenSearch Dashboardshttps://wikitech.wikimedia.org/wiki/OpenSearch#OpenSearch_Dashboards Operationshttps://wikitech.wikimedia.org/wiki/OpenSearch#Operations Rolling restarting OpenSearch daemons in a clusterhttps://wikitech.wikimedia.org/wiki/OpenSearch#Rolling_restarting_OpenSearch_daemons_in_a_cluster Rolling reboot OpenSearch hosts in a clusterhttps://wikitech.wikimedia.org/wiki/OpenSearch#Rolling_reboot_OpenSearch_hosts_in_a_cluster Troubleshootinghttps://wikitech.wikimedia.org/wiki/OpenSearch#Troubleshooting https://wikitech.wikimedia.org/wiki/Incidents/2021-09-04_appserver_latency ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-04_appserver_latency#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-04_appserver_latency#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-09-18_appserver_latency ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-18_appserver_latency#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-18_appserver_latency#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-09-26_appserver_latency ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-26_appserver_latency#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-09-26_appserver_latency#Actionables https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration We export data to acoustic once a day from our CiviCRM database. We also import data back in on a more frequent schedule. List of Scheduled jobs & apihttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#List_of_Scheduled_jobs_&_api Exporting data to Acoustichttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Exporting_data_to_Acoustic Database Update exporthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Database_Update_export How the script workshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#How_the_script_works sql fileshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#sql_files DB tableshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#DB_tables Running the scripthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Running_the_script Who is included in the update?https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Who_is_included_in_the_update? What is included in the update?https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#What_is_included_in_the_update? Export fieldshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Export_fields CiviCRM Communication Fieldshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#CiviCRM_Communication_Fields On Contact Recordhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#On_Contact_Record On Email Recordhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#On_Email_Record Communication Custom Group - Related to Contacthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Communication_Custom_Group_-_Related_to_Contact Unsubscribes and opt out exporthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Unsubscribes_and_opt_out_export Who do we opt out?https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Who_do_we_opt_out? Contacts can become opted out by the following wayshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Contacts_can_become_opted_out_by_the_following_ways How we generate the listhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#How_we_generate_the_list How do opted out contacts get opted in againhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#How_do_opted_out_contacts_get_opted_in_again Useful Acoustic linkshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Useful_Acoustic_links Matching Gifts Exporthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Matching_Gifts_Export Pushing group data to Acoustichttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Pushing_group_data_to_Acoustic Importing back from Acoustichttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Importing_back_from_Acoustic Mailing datahttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Mailing_data Remind me later contactshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Remind_me_later_contacts Recipient datahttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Recipient_data Put on holdhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Put_on_hold Unsubscribehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Unsubscribe Forgettinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Forgetting Sandboxhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Sandbox Acoustic security & accountshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Acoustic_security_&_accounts Running silverpop code locallyhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Running_silverpop_code_locally On docker buildshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#On_docker_builds Pre docker noteshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Pre_docker_notes Troubleshootinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_Integrated_Processes/Acoustic_Integration#Troubleshooting https://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/Drupal_modules These modules interface with CiviCRM. They are found in the [repo, under sites/all/modules]. Executionhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/Drupal_modules#Execution https://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/CiviCRM_extensions CiviCRM extensions (checked in to drupal/sites/default/civicrm/extensions/ in the CRM repo): https://wikitech.wikimedia.org/wiki/SLO/logstash == SLO Worksheet - Logstash == SLO Worksheet - Logstashhttps://wikitech.wikimedia.org/wiki/SLO/logstash#SLO_Worksheet_-_Logstash Servicehttps://wikitech.wikimedia.org/wiki/SLO/logstash#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/logstash#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/logstash#Architectural Hard Dependencieshttps://wikitech.wikimedia.org/wiki/SLO/logstash#Hard_Dependencies Soft Dependencieshttps://wikitech.wikimedia.org/wiki/SLO/logstash#Soft_Dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/logstash#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/logstash#Clients Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/logstash#Service_Level_Indicators_(SLIs) Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/logstash#Monitoring Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/logstash#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/logstash#Service_Level_Objectives https://wikitech.wikimedia.org/wiki/Incidents/2021-10-22_eqiad_return_path_timeouts ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-22_eqiad_return_path_timeouts#Summary_and_Metadata Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-22_eqiad_return_path_timeouts#Timeline Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-22_eqiad_return_path_timeouts#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-22_eqiad_return_path_timeouts#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-10-25_s3_db_recentchanges_replica ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-25_s3_db_recentchanges_replica#Summary_and_Metadata Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-25_s3_db_recentchanges_replica#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-25_s3_db_recentchanges_replica#Scorecard https://wikitech.wikimedia.org/wiki/Kubernetes/Benefits Designing and writing an application to run inside Kubernetes can easily be more difficult than putting together something that just runs in a VM or on a baremetal server. However there are plenty of benefits to using Kubernetes at Wikimedia that make the tradeoff worth it, including: https://wikitech.wikimedia.org/wiki/Miscweb miscweb is a new service on kubernetes. Sites running on miscweb k8shttps://wikitech.wikimedia.org/wiki/Miscweb#Sites_running_on_miscweb_k8s Where does the code live?https://wikitech.wikimedia.org/wiki/Miscweb#Where_does_the_code_live? How to deploy changeshttps://wikitech.wikimedia.org/wiki/Miscweb#How_to_deploy_changes Update the container imagehttps://wikitech.wikimedia.org/wiki/Miscweb#Update_the_container_image Deploy to Kubernets/wikikubehttps://wikitech.wikimedia.org/wiki/Miscweb#Deploy_to_Kubernets/wikikube Staginghttps://wikitech.wikimedia.org/wiki/Miscweb#Staging Productionhttps://wikitech.wikimedia.org/wiki/Miscweb#Production Deploy a single release/servicehttps://wikitech.wikimedia.org/wiki/Miscweb#Deploy_a_single_release/service Toubleshootinghttps://wikitech.wikimedia.org/wiki/Miscweb#Toubleshooting Service nameshttps://wikitech.wikimedia.org/wiki/Miscweb#Service_names LVS / discoveryhttps://wikitech.wikimedia.org/wiki/Miscweb#LVS_/_discovery Metrics and dashboardshttps://wikitech.wikimedia.org/wiki/Miscweb#Metrics_and_dashboards How this service was madehttps://wikitech.wikimedia.org/wiki/Miscweb#How_this_service_was_made How to switch microsites hosted on legacy VMs from one datacenter to anotherhttps://wikitech.wikimedia.org/wiki/Miscweb#How_to_switch_microsites_hosted_on_legacy_VMs_from_one_datacenter_to_another https://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageTest_alert This is the runbook for WebPageTest alerts. Metahttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageTest_alert#Meta WebPageTest alert firedhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageTest_alert#WebPageTest_alert_fired Performance regressionhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageTest_alert#Performance_regression Browser performance regressionhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageTest_alert#Browser_performance_regression Test server performance regressionhttps://wikitech.wikimedia.org/wiki/Performance/Guides/WebPageTest_alert#Test_server_performance_regression https://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert This is the runbook for Synthetic tool alerts that will fire when one of the tools are down or we are missing data from that tool. Metahttps://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert#Meta WebPageReplay missing datahttps://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert#WebPageReplay_missing_data WebPageReplay CPU benchmark alerthttps://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert#WebPageReplay_CPU_benchmark_alert WebPageReplay TTFB alerthttps://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert#WebPageReplay_TTFB_alert CRUX missing datahttps://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert#CRUX_missing_data sitespeed.io missing datahttps://wikitech.wikimedia.org/wiki/Performance/Runbook/SyntheticToolAlert#sitespeed.io_missing_data https://wikitech.wikimedia.org/wiki/Performance/Guides/RUM_Alert This is the runbook for RUM alerts (real user measurements performance alerts). Metahttps://wikitech.wikimedia.org/wiki/Performance/Guides/RUM_Alert#Meta RUM performance regression alerthttps://wikitech.wikimedia.org/wiki/Performance/Guides/RUM_Alert#RUM_performance_regression_alert https://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite == Summary and Metadata == Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Summary_and_Metadata Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-10-29_graphite#Scorecard https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Alerts This page provides troubleshooting guidelines and runbooks to use in the event of alerts from our Monitoring systems, Hive Metastore Heap Usagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hive/Alerts#Hive_Metastore_Heap_Usage https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46 == 2021-10-31 == 2021-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-31 2021-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-30 2021-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-29 2021-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-28 2021-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-27 2021-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-26 2021-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-25 2021-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-23 2021-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-22 2021-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-21 2021-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-20 2021-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-19 2021-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-18 2021-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-16 2021-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-15 2021-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-14 2021-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-13 2021-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-12 2021-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-11 2021-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-09 2021-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-08 2021-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-07 2021-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-06 2021-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-05 2021-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-04 2021-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-03 2021-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-02 2021-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-10-01 2021-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-30 2021-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-29 2021-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-28 2021-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-27 2021-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-26 2021-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-25 2021-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-24 2021-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-23 2021-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-22 2021-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-21 2021-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-20 2021-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-18 2021-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-17 2021-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-16 2021-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-15 2021-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-14 2021-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-13 2021-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-12 2021-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-11 2021-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-10 2021-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-09 2021-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-08 2021-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-07 2021-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-06 2021-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-05 2021-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-04 2021-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-03 2021-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-02 2021-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-09-01 2021-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-31 2021-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-30 2021-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-29 2021-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-28 2021-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-27 2021-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-26 2021-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-25 2021-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-24 2021-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-23 2021-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-21 2021-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-20 2021-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-19 2021-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-18 2021-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-17 2021-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-16 2021-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-15 2021-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-14 2021-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-13 2021-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-12 2021-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-11 2021-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-10 2021-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-09 2021-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-06 2021-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-05 2021-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-04 2021-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-03 2021-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_46#2021-08-02 https://wikitech.wikimedia.org/wiki/Wmfdb Wmfdb is a library and set of utilities for database automation. It's (as of 2021-11) in very early development. https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Alerts We have a number of alerts set up in Icinga and Alertmanager that relate to Druid and its ingestion jobs. Druid Netflow Supervisorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Alerts#Druid_Netflow_Supervisor Druid webrequest_sampled_live Supervisorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Alerts#Druid_webrequest_sampled_live_Supervisor Druid Segments Unavailablehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Druid/Alerts#Druid_Segments_Unavailable https://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails We send a letter for recurring donations once a year rather than as each donation is received. Sending to an individual contacthttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Sending_to_an_individual_contact Bulk sendinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Bulk_sending MakeJobhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#MakeJob Sendhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Send Scheduled jobshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Scheduled_jobs Pre-coffee guide to running the jobshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Pre-coffee_guide_to_running_the_jobs Tracking what has been senthttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Tracking_what_has_been_sent Finishing uphttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Finishing_up Duplicate handlinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Duplicate_handling Messages and tokenshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Messages_and_tokens Outstanding issueshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/End_of_year_emails#Outstanding_issues https://wikitech.wikimedia.org/wiki/Fundraising/SmashPig = Standalone Installation = Standalone Installationhttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#Standalone_Installation CiviCRM Extensionhttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#CiviCRM_Extension Maintenance Scriptshttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#Maintenance_Scripts ConsumePendingQueuehttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#ConsumePendingQueue CreateIpnMessagesFromPendingDbhttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#CreateIpnMessagesFromPendingDb DeleteExpiredPendingMessageshttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#DeleteExpiredPendingMessages DumpConfighttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#DumpConfig EmptyQueueToDumphttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#EmptyQueueToDump InitializeSequencehttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#InitializeSequence PopulateQueueFromDumphttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#PopulateQueueFromDump QueueJobRunnerhttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#QueueJobRunner QueuePeekhttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#QueuePeek RequeueDelayedMessageshttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#RequeueDelayedMessages TestFailMailhttps://wikitech.wikimedia.org/wiki/Fundraising/SmashPig#TestFailMail https://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-04_large_file_upload_timeouts#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Summary_and_Metadata Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Timeline September 15https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#September_15 October 27https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#October_27 November 2https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#November_2 November 3https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#November_3 November 4https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#November_4 November 5https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#November_5 November 6https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#November_6 November 8https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#November_8 Epiloguehttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Epilogue Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Links_to_relevant_documentation Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-05_TOC_language_converter#Actionables https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Presto/Query_Logger Currently work in progress. Will be as specified in https://phabricator. Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform Data platform systemshttps://wikitech.wikimedia.org/wiki/Category:Data_platform_systems Prestohttps://wikitech.wikimedia.org/wiki/Category:Presto https://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/How_to = Steps = Stepshttps://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/How_to#Steps Announcement templatehttps://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/How_to#Announcement_template Reminder templatehttps://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/How_to#Reminder_template Bulk emailing instructionshttps://wikitech.wikimedia.org/wiki/Annual_Toolforge_Survey/How_to#Bulk_emailing_instructions https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric [potential data catalog solutions]. This relates to the [Term Plan: Data-as-a-Service objective]. Requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric#Requirements General Considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric#General_Considerations Candidateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric#Candidates Other Candidateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric#Other_Candidates Evaluation Deploymentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric#Evaluation_Deployments https://wikitech.wikimedia.org/wiki/Incidents/2021-11-10_cirrussearch_commonsfile_outage ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-10_cirrussearch_commonsfile_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-10_cirrussearch_commonsfile_outage#Timeline References:https://wikitech.wikimedia.org/wiki/Incidents/2021-11-10_cirrussearch_commonsfile_outage#References: Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-10_cirrussearch_commonsfile_outage#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-10_cirrussearch_commonsfile_outage#Actionables https://wikitech.wikimedia.org/wiki/MariaDB/Switch_Datacenter == The week before the switchover == The week before the switchoverhttps://wikitech.wikimedia.org/wiki/MariaDB/Switch_Datacenter#The_week_before_the_switchover The day of the switchoverhttps://wikitech.wikimedia.org/wiki/MariaDB/Switch_Datacenter#The_day_of_the_switchover Before the switchoverhttps://wikitech.wikimedia.org/wiki/MariaDB/Switch_Datacenter#Before_the_switchover After the switchoverhttps://wikitech.wikimedia.org/wiki/MariaDB/Switch_Datacenter#After_the_switchover https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests This page explains the network checklist/testing functions that we have in place to verify normal network operations for Cloud VPS / Toolforge. Componentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests#Components adding new testshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests#adding_new_tests Checklisthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests#Checklist Cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests#Cookbook https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests# systemd timer executionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests#systemd_timer_execution See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Network/Tests#See_also https://wikitech.wikimedia.org/wiki/PHP_packaging We currently use modified Debian packages to install PHP on appservers and in Docker images. These packages are available from apt. Differences from Debianhttps://wikitech.wikimedia.org/wiki/PHP_packaging#Differences_from_Debian Initial forkinghttps://wikitech.wikimedia.org/wiki/PHP_packaging#Initial_forking Modifying a packagehttps://wikitech.wikimedia.org/wiki/PHP_packaging#Modifying_a_package https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11 ==Week of November 01== Week of November 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11#Week_of_November_01 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11#=== Week of November 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11#Week_of_November_08 Week of November 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11#Week_of_November_15 Week of November 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11#Week_of_November_22 Week of November 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/11#Week_of_November_29 https://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer ==== What is the Pending Table? ==== What is the Pending Table?https://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#What_is_the_Pending_Table? Removing data from the Pending Table on the Smashpig Databasehttps://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#Removing_data_from_the_Pending_Table_on_the_Smashpig_Database What transaction is considered an orphan?https://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#What_transaction_is_considered_an_orphan? What is the OrphanSlayer?https://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#What_is_the_OrphanSlayer? How does the OrphanSlayer work?https://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#How_does_the_OrphanSlayer_work? UML diagramhttps://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#UML_diagram Notehttps://wikitech.wikimedia.org/wiki/Fundraising_tech/orphan_slayer#Note https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration Installation + Configuration script for ML-Sandbox. Summaryhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Summary Minikubehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Minikube Helmhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Helm Istiohttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Istio Knativehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Knative Imageshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Images KServehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#KServe Miniohttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Minio Noteshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Notes Delete clusterhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Configuration#Delete_cluster https://wikitech.wikimedia.org/wiki/Thumbor/Runbook == Testing a specific thumbnail == Testing a specific thumbnailhttps://wikitech.wikimedia.org/wiki/Thumbor/Runbook#Testing_a_specific_thumbnail Pooling a new serverhttps://wikitech.wikimedia.org/wiki/Thumbor/Runbook#Pooling_a_new_server https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen === Core Service and Dependency Setup === Core Service and Dependency Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen#Core_Service_and_Dependency_Setup Ingestion Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen#Ingestion_Configuration Progress Statushttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen#Progress_Status Perceptionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen#Perceptions Outcomehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen#Outcome Razzi's take on Amundsenhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Amundsen#Razzi's_take_on_Amundsen https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo A guide to the species of failmail encountered in our systems Fail Mail Storm - lots of different jobs failing at oncehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Fail_Mail_Storm_-_lots_of_different_jobs_failing_at_once Using innotophttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Using_innotop Figuring out who the user ishttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Figuring_out_who_the_user_is Using processlisthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Using_processlist Turning off the fail mail per payment processorhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Turning_off_the_fail_mail_per_payment_processor Fail Mail (civi1001) run-job: XXX failed with code 1https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Fail_Mail_(civi1001)_run-job:_XXX_failed_with_code_1 Fail Mail (civi1001) run-job: Check forget me processing failed with code 1https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Fail_Mail_(civi1001)_run-job:_Check_forget_me_processing_failed_with_code_1 Aborting! Previous process (XXX) is still alive. Remove lockfile manually if in error: /tmp/.lockhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Aborting!_Previous_process_(XXX)_is_still_alive._Remove_lockfile_manually_if_in_error:_/tmp/.lock Error validating Amazon message. Firewall problem?https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Error_validating_Amazon_message._Firewall_problem? INVALID_MESSAGE Cannot create contribution, civi error!https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#INVALID_MESSAGE_Cannot_create_contribution,_civi_error! MISSING_PREDECESSOR Message -XXXXXX indicates a pending DB entry with order ID YYYY, but none was foundhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#MISSING_PREDECESSOR_Message_-XXXXXX_indicates_a_pending_DB_entry_with_order_ID_YYYY,_but_none_was_found Fail Mail: BAD_AUDIT_LINE (paypal-audit)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Fail_Mail:_BAD_AUDIT_LINE_(paypal-audit) CIVI_REQ_FIELD Positive amount requiredhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#CIVI_REQ_FIELD_Positive_amount_required EMAIL_SYSTEM_FAILURE: civi1001 (thank_you)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#EMAIL_SYSTEM_FAILURE:_civi1001_(thank_you) Get recipient data from Silverpop failed with code 1https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Get_recipient_data_from_Silverpop_failed_with_code_1 Possibly Extincthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#Possibly_Extinct 2019-08-28 Fredge Multiqueue Consumer failed with code 1https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#2019-08-28_Fredge_Multiqueue_Consumer_failed_with_code_1 2018-09-06 INVALID_RECURRING Subscription account does not existhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Failmail_zoo#2018-09-06_INVALID_RECURRING_Subscription_account_does_not_exist https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Overview Payment Methodshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Payment_Methods Credit Cardshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Credit_Cards 3DShttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#3DS iDEALhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#iDEAL iDEAL Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#iDEAL_Recurring Apple Payhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Apple_Pay In App (Native) Donationshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#In_App_(Native)_Donations getPaymentMethodshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#getPaymentMethods submitPaymenthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#submitPayment Apple Pay Testing Links (TBC)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Apple_Pay_Testing_Links_(TBC) Google Payhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Google_Pay Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Recurring Auto Rescuehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Auto_Rescue Confighttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Config Subscription Modelshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Subscription_Models One time donation with no monthly converthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#One_time_donation_with_no_monthly_convert One time donation with monthly convert or the first payment of a recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#One_time_donation_with_monthly_convert_or_the_first_payment_of_a_recurring Subsequent recurring charges (not the first one)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Subsequent_recurring_charges_(not_the_first_one) IPN messageshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#IPN_messages RECURRING_CONTRACThttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#RECURRING_CONTRACT OFFER_CLOSEDhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#OFFER_CLOSED Auditshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Audits Adding data to the reportshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Adding_data_to_the_reports File schedulinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#File_scheduling Pending Tablehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Pending_Table Jobs Queuehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Jobs_Queue Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Adyen_Checkout#Testing https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes = Intro = Introhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Intro Adding a nodehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Adding_a_node Step 0: DNShttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Step_0:_DNS Step 1: Add node to BGPhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Step_1:_Add_node_to_BGP Step 2: Node installationhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Step_2:_Node_installation Add node specific hiera datahttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Add_node_specific_hiera_data Step 3: Add to conftool/LVShttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Step_3:_Add_to_conftool/LVS Done! You made it!https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Done!_You_made_it! Removing a nodehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Removing_a_node Drain workloadhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Drain_workload Decommissionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Decommission Delete the node from Kubernetes APIhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_nodes#Delete_the_node_from_Kubernetes_API https://wikitech.wikimedia.org/wiki/Logstash/Extended_Retention === Policy === Policyhttps://wikitech.wikimedia.org/wiki/Logstash/Extended_Retention#Policy Request Processhttps://wikitech.wikimedia.org/wiki/Logstash/Extended_Retention#Request_Process Audit Processhttps://wikitech.wikimedia.org/wiki/Logstash/Extended_Retention#Audit_Process Common Logging Schema fields indicating PIIhttps://wikitech.wikimedia.org/wiki/Logstash/Extended_Retention#Common_Logging_Schema_fields_indicating_PII https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Structured_data/Commons_entity The structured_data.commons_entity table (available on Hive) is a conversion of the commonswiki structured-data entities JSON dumps in parquet. Current Schema[edit | edit source]https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Structured_data/Commons_entity#Current_Schema[edit_|_edit_source] Sample queries[edit | edit source]https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Structured_data/Commons_entity#Sample_queries[edit_|_edit_source] Changes and known problems since 2020-02[edit | edit source]https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Structured_data/Commons_entity#Changes_and_known_problems_since_2020-02[edit_|_edit_source] See also[edit | edit source]https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Structured_data/Commons_entity#See_also[edit_|_edit_source] https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline == Banners == Bannershttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#Banners beacon/impressionhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#beacon/impression Banner historyhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#Banner_history Impression rateshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#Impression_rates Landing pageshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#Landing_pages Older Content moved from main pagehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#Older_Content_moved_from_main_page Banner Impression/Landing Page Stats Collectionhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#Banner_Impression/Landing_Page_Stats_Collection utm_sourcehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#utm_source utm_mediumhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#utm_medium utm_campaignhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#utm_campaign utm_keyhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Stats_pipeline#utm_key https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Overview Payment Methodshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Payment_Methods Credit Cardshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Credit_Cards Donor Flowhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Donor_Flow API Callshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#API_Calls iDEALhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#iDEAL Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Recurring Monthly Converthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Monthly_Convert Auditshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Audits Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Ingenico#Testing https://wikitech.wikimedia.org/wiki/Incidents/2021-11-25_eventgate-main_outage ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-25_eventgate-main_outage#Summary_and_Metadata Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-25_eventgate-main_outage#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-25_eventgate-main_outage#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-11-23_Core_Network_Routing == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-23_Core_Network_Routing#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-23_Core_Network_Routing#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-23_Core_Network_Routing#Scorecard https://wikitech.wikimedia.org/wiki/API_catalog The API catalog is a list of Wikimedia APIs. About the API cataloghttps://wikitech.wikimedia.org/wiki/API_catalog#About_the_API_catalog Add an APIhttps://wikitech.wikimedia.org/wiki/API_catalog#Add_an_API MVPhttps://wikitech.wikimedia.org/wiki/API_catalog#MVP Early adoptershttps://wikitech.wikimedia.org/wiki/API_catalog#Early_adopters API definitionhttps://wikitech.wikimedia.org/wiki/API_catalog#API_definition Examplehttps://wikitech.wikimedia.org/wiki/API_catalog#Example Schemahttps://wikitech.wikimedia.org/wiki/API_catalog#Schema Frequently asked questionshttps://wikitech.wikimedia.org/wiki/API_catalog#Frequently_asked_questions Questions and feedbackhttps://wikitech.wikimedia.org/wiki/API_catalog#Questions_and_feedback https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Overview How to run locallyhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#How_to_run_locally Schedule and Fileshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Schedule_and_Files Payment Processor Specific Informationhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Payment_Processor_Specific_Information Adyenhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Adyen Amazonhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Amazon Dlocal (formerly Astropay)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Dlocal_(formerly_Astropay) Braintreehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Braintree Fundraiseuphttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Fundraiseup PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#PayPal Loghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Log File Wranglinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#File_Wrangling Adding a New Payment Processorhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Audits#Adding_a_New_Payment_Processor https://wikitech.wikimedia.org/wiki/Incidents/2021-11-18_codfw_ipv6_network ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-18_codfw_ipv6_network#Summary_and_Metadata Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-18_codfw_ipv6_network#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-18_codfw_ipv6_network#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx == Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Links_to_relevant_documentation Links to related ticketshttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Links_to_related_tickets Links to related changeshttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Links_to_related_changes Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-12-03_mx#Actionables https://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org kohl.wikimedia. Kate's Toolshttps://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org#Kate's_Tools MediaWiki webloghttps://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org#MediaWiki_weblog Network operation centerhttps://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org#Network_operation_center Nagioshttps://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org#Nagios See alsohttps://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org#See_also External linkshttps://wikitech.wikimedia.org/wiki/Kohl.wikimedia.org#External_links https://wikitech.wikimedia.org/wiki/Auto_schema This is the documentation on auto_schema. A set of python scripts to reduce the toil of schema changes for DBAs. Schema changeshttps://wikitech.wikimedia.org/wiki/Auto_schema#Schema_changes Runninghttps://wikitech.wikimedia.org/wiki/Auto_schema#Running logginghttps://wikitech.wikimedia.org/wiki/Auto_schema#logging Logichttps://wikitech.wikimedia.org/wiki/Auto_schema#Logic Depoolinghttps://wikitech.wikimedia.org/wiki/Auto_schema#Depooling With or without replicationhttps://wikitech.wikimedia.org/wiki/Auto_schema#With_or_without_replication Downtiminghttps://wikitech.wikimedia.org/wiki/Auto_schema#Downtiming Check functionhttps://wikitech.wikimedia.org/wiki/Auto_schema#Check_function Morehttps://wikitech.wikimedia.org/wiki/Auto_schema#More Futurehttps://wikitech.wikimedia.org/wiki/Auto_schema#Future https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Atlas === Core Service and Dependency Setup === Core Service and Dependency Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Atlas#Core_Service_and_Dependency_Setup Ingestion Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Atlas#Ingestion_Configuration Progress Statushttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Atlas#Progress_Status Perceptionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Atlas#Perceptions Outcomehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/Atlas#Outcome https://wikitech.wikimedia.org/wiki/Gitlab1001 gitlab1001 was the production Gitlab server (along with Gitlab2001 in codfw). Connectinghttps://wikitech.wikimedia.org/wiki/Gitlab1001#Connecting Ticketshttps://wikitech.wikimedia.org/wiki/Gitlab1001#Tickets https://wikitech.wikimedia.org/wiki/Gitlab2001 gitlab1001 is the production Gitlab server (along with Gitlab1001 in eqiad). Connectinghttps://wikitech.wikimedia.org/wiki/Gitlab2001#Connecting Ticketshttps://wikitech.wikimedia.org/wiki/Gitlab2001#Tickets https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/12 ==Week of December 06== Week of December 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/12#Week_of_December_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/12#=== Week of December 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/12#Week_of_December_13 Week of December 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/12#Week_of_December_20 Week of December 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2021/12#Week_of_December_27 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework This page contains information about operating the Toolforge Jobs Framework, an architecture to support grid-like jobs on Toolforge kubernetes. Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Overview Authhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Auth Ingress & TLShttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Ingress_&_TLS About logshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#About_logs Endpointshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Endpoints Deployment and maintenancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Deployment_and_maintenance jobs-framework-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#jobs-framework-api deploymenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#deployment maintenancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#maintenance jobs-framework-clihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#jobs-framework-cli jobs-framework-emailerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#jobs-framework-emailer Prebuilt image managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Prebuilt_image_management Building Toolforge specific imageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Building_Toolforge_specific_images Managing images available for toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#Managing_images_available_for_tools API docshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#API_docs POST /api/v1/run/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#POST_/api/v1/run/ GET /api/v1/show/{name}/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#GET_/api/v1/show/{name}/ DELETE /api/v1/delete/{name}https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#DELETE_/api/v1/delete/{name} GET /api/v1/list/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#GET_/api/v1/list/ DELETE /api/v1/flush/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#DELETE_/api/v1/flush/ GET /api/v1/containers/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#GET_/api/v1/containers/ See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Jobs_framework#See_also https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon#Overview Payment Methodshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon#Payment_Methods Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon#Recurring Auditshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon#Audits Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon#Testing Errorshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Amazon#Errors https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Overview Queueshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Queues Componentshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Components Performancehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Performance Donationshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Donations Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Recurring Pendinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Pending Payments Inithttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Payments_Init Contribution trackinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues#Contribution_tracking https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing === First steps for all === First steps for allhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#First_steps_for_all Adyenhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#Adyen Amazonhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#Amazon AstroPayhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#AstroPay Ingenicohttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#Ingenico PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#PayPal Last steps for allhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#Last_steps_for_all Refundshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Testing#Refunds https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2022#By_month https://wikitech.wikimedia.org/wiki/Contint2001 contint2001 runs the continuous integration tools such as Jenkins and Zuul. Aliashttps://wikitech.wikimedia.org/wiki/Contint2001#Alias Serviceshttps://wikitech.wikimedia.org/wiki/Contint2001#Services Mischttps://wikitech.wikimedia.org/wiki/Contint2001#Misc https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_wallaby == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_wallaby#Overview Noteshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_wallaby#Notes Installationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_wallaby#Installation https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum#Overview Installation guideshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum#Installation_guides Magnum infohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum#Magnum_info Create a templatehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum#Create_a_template scale a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum#scale_a_cluster upgrade a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum#upgrade_a_cluster https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_xena == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_xena#Overview Noteshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_xena#Notes Installationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/Stable_xena#Installation https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47 == 2021-12-29 == 2021-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-29 2021-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-28 2021-12-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-24 2021-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-23 2021-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-22 2021-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-21 2021-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-20 2021-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-19 2021-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-18 2021-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-17 2021-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-16 2021-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-15 2021-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-14 2021-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-13 2021-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-12 2021-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-11 2021-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-10 2021-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-09 2021-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-08 2021-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-07 2021-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-06 2021-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-04 2021-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-03 2021-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-02 2021-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-12-01 2021-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-30 2021-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-29 2021-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-28 2021-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-27 2021-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-26 2021-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-25 2021-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-24 2021-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-23 2021-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-22 2021-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-21 2021-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-20 2021-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-19 2021-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-18 2021-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-17 2021-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-16 2021-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-15 2021-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-14 2021-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-13 2021-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-12 2021-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-11 2021-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-10 2021-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-09 2021-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-08 2021-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-06 2021-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-05 2021-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-04 2021-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-03 2021-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-02 2021-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_47#2021-11-01 https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7 == 2021-12-24 == 2021-12-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-24 2021-12-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-23 2021-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-21 2021-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-19 2021-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-17 2021-12-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-16 2021-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-15 2021-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-13 2021-12-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-08 2021-12-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-06 2021-12-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-02 2021-12-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-12-01 2021-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-30 2021-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-29 2021-11-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-26 2021-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-23 2021-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-22 2021-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-20 2021-11-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-19 2021-11-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-18 2021-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-17 2021-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-16 2021-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-15 2021-11-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-12 2021-11-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-10 2021-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-09 2021-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-08 2021-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-07 2021-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-06 2021-11-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-05 2021-11-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-04 2021-11-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-03 2021-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-02 2021-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-11-01 2021-10-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-29 2021-10-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-28 2021-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-27 2021-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-26 2021-10-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-25 2021-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-24 2021-10-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-22 2021-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-21 2021-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-19 2021-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-18 2021-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-16 2021-10-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-15 2021-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-14 2021-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-13 2021-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-12 2021-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-11 2021-10-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-08 2021-10-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-07 2021-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-06 2021-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-05 2021-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-10-04 2021-09-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-30 2021-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-29 2021-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-27 2021-09-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-24 2021-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-23 2021-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-22 2021-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-21 2021-09-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-17 2021-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-16 2021-09-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-15 2021-09-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-14 2021-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-13 2021-09-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-10 2021-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-09 2021-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-08 2021-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-07 2021-09-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-03 2021-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-02 2021-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-09-01 2021-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-31 2021-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-30 2021-08-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-27 2021-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-25 2021-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-24 2021-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-23 2021-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-21 2021-08-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-20 2021-08-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-19 2021-08-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-17 2021-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-16 2021-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-15 2021-08-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-13 2021-08-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-11 2021-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-10 2021-08-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-09 2021-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-07 2021-08-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-06 2021-08-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-05 2021-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-04 2021-08-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-03 2021-08-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-08-02 2021-07-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-30 2021-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-29 2021-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-28 2021-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-27 2021-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-26 2021-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-23 2021-07-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-21 2021-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-20 2021-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-19 2021-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-18 2021-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-16 2021-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-14 2021-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-13 2021-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-12 2021-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-09 2021-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-08 2021-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-07 2021-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-06 2021-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-05 2021-07-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-07-02 2021-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-30 2021-06-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-29 2021-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-28 2021-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-24 2021-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-23 2021-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-22 2021-06-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-21 2021-06-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-19 2021-06-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-16 2021-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-14 2021-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-13 2021-06-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-11 2021-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-10 2021-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-08 2021-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-07 2021-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-05 2021-06-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-04 2021-06-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-03 2021-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-06-02 2021-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-28 2021-05-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-27 2021-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-26 2021-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-24 2021-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-21 2021-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-20 2021-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-19 2021-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-17 2021-05-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-16 2021-05-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-15 2021-05-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-14 2021-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-13 2021-05-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-12 2021-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-11 2021-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-10 2021-05-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-07 2021-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-06 2021-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-05 2021-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-04 2021-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-03 2021-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-02 2021-05-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-05-01 2021-04-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-30 2021-04-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-29 2021-04-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-28 2021-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-27 2021-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-26 2021-04-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-24 2021-04-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-23 2021-04-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-22 2021-04-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-21 2021-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-20 2021-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-19 2021-04-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-17 2021-04-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-16 2021-04-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-15 2021-04-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-14 2021-04-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-13 2021-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-12 2021-04-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-11 2021-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-10 2021-04-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-09 2021-04-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-08 2021-04-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-07 2021-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-06 2021-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-05 2021-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-02 2021-04-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-04-01 2021-03-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-30 2021-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-29 2021-03-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-26 2021-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-25 2021-03-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-24 2021-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-23 2021-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-22 2021-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-19 2021-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-18 2021-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-17 2021-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-16 2021-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-15 2021-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-13 2021-03-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-12 2021-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-11 2021-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-10 2021-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-09 2021-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-08 2021-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-07 2021-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-06 2021-03-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-05 2021-03-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-04 2021-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-03 2021-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-02 2021-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-03-01 2021-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-27 2021-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-26 2021-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-24 2021-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-23 2021-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-20 2021-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-19 2021-02-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-18 2021-02-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-17 2021-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-16 2021-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-15 2021-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-14 2021-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-13 2021-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-12 2021-02-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-11 2021-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-10 2021-02-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-09 2021-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-08 2021-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-06 2021-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-04 2021-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-03 2021-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-02 2021-02-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-02-01 2021-01-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-29 2021-01-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-28 2021-01-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-27 2021-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-26 2021-01-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-25 2021-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-22 2021-01-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-19 2021-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-18 2021-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-17 2021-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-16 2021-01-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-14 2021-01-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-13 2021-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-12 2021-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-11 2021-01-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-09 2021-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-08 2021-01-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-07 2021-01-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-06 2021-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-05 2021-01-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-04 2021-01-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-02 2021-01-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_7#2021-01-01 https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar/2021 https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar/2022 See also the calendar for 2021 and the calendar for 2023. https://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Introduction Configurationhttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Configuration Usagehttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Usage Istio-Ingressgatewayhttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Istio-Ingressgateway Monitoringhttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Monitoring cfssl-issuerhttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#cfssl-issuer Repo updatehttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Repo_update Testinghttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Testing Building cfssl-issuerhttps://wikitech.wikimedia.org/wiki/Kubernetes/cert-manager#Building_cfssl-issuer https://wikitech.wikimedia.org/wiki/Citoid/Prometheus You can test citoid locally with Promethesus. Local confighttps://wikitech.wikimedia.org/wiki/Citoid/Prometheus#Local_config For citoidhttps://wikitech.wikimedia.org/wiki/Citoid/Prometheus#For_citoid For Prometheushttps://wikitech.wikimedia.org/wiki/Citoid/Prometheus#For_Prometheus https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/PAWS_dev_devstack == Note == Notehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/PAWS_dev_devstack#Note Installationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Devstack_magnum/PAWS_dev_devstack#Installation https://wikitech.wikimedia.org/wiki/Incidents/2021-11-02_Cloud_VPS_networking ==Summary and Metadata== Summary and Metadatahttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-02_Cloud_VPS_networking#Summary_and_Metadata Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-02_Cloud_VPS_networking#Scorecard Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2021-11-02_Cloud_VPS_networking#Actionables https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Overview Setuphttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Setup PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#PayPal Ingenicohttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Ingenico Adyenhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Adyen Dlocalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Dlocal Monthly Converthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Monthly_Convert Recurring queuehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Recurring_queue Smashpig civi extension/Smashing recurring charge job/Recurring charge jobhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Smashpig_civi_extension/Smashing_recurring_charge_job/Recurring_charge_job Failures and retry logichttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Failures_and_retry_logic Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Testing Failure Reasonshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Recurring#Failure_Reasons https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox = ML-Sandbox = ML-Sandboxhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#ML-Sandbox Hostshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Hosts eqiadhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#eqiad Deployhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Deploy Upload a model to Miniohttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Upload_a_model_to_Minio Create an InferenceServicehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Create_an_InferenceService Run a predictionhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Run_a_prediction Clean up Imageshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Clean_up_Images Configurationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox#Configuration https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Summary Developmenthttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Development Dockerhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Docker Production Imageshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Production_Images ML-Sandboxhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#ML-Sandbox Pipelineshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Pipelines Test/Build pipelineshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Test/Build_pipelines Publish pipelineshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Publish_pipelines Jenkins pipelineshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services#Jenkins_pipelines https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Summary Blubberhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Blubber Developing a Blubberfilehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Developing_a_Blubberfile Variantshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Variants Buildhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Build Productionhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Production Testhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Test Testing your Blubberfilehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Testing_your_Blubberfile Pipeline Configurationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Inference_Services/Production_Image_Development#Pipeline_Configuration https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Overview Payment Rules by Countryhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Payment_Rules_by_Country Payment Type by Countryhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Payment_Type_by_Country Payment Methodshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Payment_Methods 3DShttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#3DS Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Recurring Recurring Bank Transferhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Recurring_Bank_Transfer Indiahttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#India Initiating a Recurring in India through Bank Transfer (UPI/PayTM)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Initiating_a_Recurring_in_India_through_Bank_Transfer_(UPI/PayTM) Charging a Bank Transfer Payment in India (UPI/PayTM)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Charging_a_Bank_Transfer_Payment_in_India_(UPI/PayTM) Recurring Credit Cardhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Recurring_Credit_Card Error Messageshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Error_Messages IPNhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#IPN Message Typeshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Message_Types Auditshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Audits DLocal meetingshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#DLocal_meetings Astropay - Older Integration - APIv1https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Astropay_-_Older_Integration_-_APIv1 Card Logoshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Card_Logos Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/dLocal#Testing https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes == How we work == How we workhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes#How_we_work Guideshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes#Guides Metahttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes#Meta Subpageshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes#Subpages https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding = Accounts & Privileges to get = Accounts & Privileges to gethttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Accounts_&_Privileges_to_get Prephttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Prep Set up local Envhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Set_up_local_Env Some account might not need at this moment but good to have laterhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Some_account_might_not_need_at_this_moment_but_good_to_have_later Your first few days/weekshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Your_first_few_days/weeks Day 1https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_1 Day 2https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_2 What is Gerrit and get to know code in generalhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#What_is_Gerrit_and_get_to_know_code_in_general Day 3https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_3 Get familiar with the payment processhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Get_familiar_with_the_payment_process How to monitor production loghttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#How_to_monitor_production_log What is Irchttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#What_is_Irc Add google calendar and know agile meetingshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Add_google_calendar_and_know_agile_meetings Day 4https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_4 Get familiar with local test process:https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Get_familiar_with_local_test_process: Day 5https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_5 Understand each dev test URLshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Understand_each_dev_test_URLs Git reviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Git_review Day 6https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_6 Update package at Packagisthttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Update_package_at_Packagist Update smash-pig version for civihttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Update_smash-pig_version_for_civi Day 7https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_7 Understand redis queuehttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Understand_redis_queue Day 8https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_8 Lint for JShttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Lint_for_JS Code style for PHPhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Code_style_for_PHP XDEBUG for phpStormhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#XDEBUG_for_phpStorm Day 9https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_9 Failmailhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Failmail Day 10https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_10 Deploymenthttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Deployment Day 11https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_11 EOY Emailhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#EOY_Email Day 12https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_12 FraudFilterhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#FraudFilter Day 13https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_13 Emergency Protocol / Incident Responsehttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Emergency_Protocol_/_Incident_Response Day 14https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_14 [Preference]https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#[Preference] Day 15https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_15 Monthly Convert ===https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Monthly_Convert_=== Day 16https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_16 FR-tech-dev cloud project to set up amazon local envhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#FR-tech-dev_cloud_project_to_set_up_amazon_local_env Day 17https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#Day_17 How to watch log with logdog:https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Onboarding#How_to_watch_log_with_logdog: https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments == Release tags and branches == Release tags and brancheshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Release_tags_and_branches Deployment processhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Deployment_process Rolling back a deploymenthttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Rolling_back_a_deployment Testshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Tests Configurationhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Configuration Matching gifts employers listhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Matching_gifts_employers_list Toolshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Tools Process-Control Jobshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Process-Control_Jobs SmashPighttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#SmashPig Deploying SmashPig Standalonehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Deploying_SmashPig_Standalone Updating the SmashPig Composer Package (needs for DI and CiviCrm)https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Updating_the_SmashPig_Composer_Package_(needs_for_DI_and_CiviCrm) Deploying SmashPig inside CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Deploying_SmashPig_inside_CiviCRM Deploying SmashPig in Donation Interfacehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Deploying_SmashPig_in_Donation_Interface Payments-wikihttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Payments-wiki Mediawiki security updateshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Mediawiki_security_updates Donation Interfacehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Donation_Interface Deploying to paymentshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Deploying_to_payments Updating the Donation Interface composer packagehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Updating_the_Donation_Interface_composer_package CentralNoticehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#CentralNotice Civicrmhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Civicrm Disabling jobshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Disabling_jobs Preparing the codebasehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Preparing_the_codebase Vendor updateshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Vendor_updates Updating the databasehttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Updating_the_database Big Civicrm Upgradeshttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Deployments#Big_Civicrm_Upgrades https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01 ==Week of January 03== Week of January 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01#Week_of_January_03 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01#=== Week of January 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01#Week_of_January_10 Week of January 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01#Week_of_January_17 Week of January 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01#Week_of_January_24 Week of January 31https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/01#Week_of_January_31 https://wikitech.wikimedia.org/wiki/Developer.wikimedia.org developer.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Developer.wikimedia.org#Service Production deploymenthttps://wikitech.wikimedia.org/wiki/Developer.wikimedia.org#Production_deployment Demo serverhttps://wikitech.wikimedia.org/wiki/Developer.wikimedia.org#Demo_server See alsohttps://wikitech.wikimedia.org/wiki/Developer.wikimedia.org#See_also https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/PCI to do! https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta This page contains specific information about Toolsbeta, which is the Toolforge mirror deployment for staging/testing/development. Accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#Access sshhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#ssh webhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#web Operational noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#Operational_notes tool accounts in toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#tool_accounts_in_toolsbeta create a tool account in toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#create_a_tool_account_in_toolsbeta edit a tool account in toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#edit_a_tool_account_in_toolsbeta toolsctlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#toolsctl See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#See_also https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Overview Linkshttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Links URL Structurehttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#URL_Structure Sample links (Local instance)https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Sample_links_(Local_instance) Preference Centerhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Preference_Center Translated Preference Center (adding &uselang) =====https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Translated_Preference_Center_(adding_&uselang)_===== Civiproxy JSON responsehttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Civiproxy_JSON_response Phabricator Epichttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Phabricator_Epic Documentation of Email Preferencehttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Documentation_of_Email_Preference User interface Designhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#User_interface_Design File pathshttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#File_paths Queuehttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Queue Unit Testhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Unit_Test CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#CiviCRM Civiproxyhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Civiproxy Deployinghttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Deploying Local Troubleshootinghttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Local_Troubleshooting Translationshttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Translations Proposed Email Update Flowshttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Proposed_Email_Update_Flows Regular recurring donations through Payments form (example Credit Card)https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Regular_recurring_donations_through_Payments_form_(example_Credit_Card) Donations through wallets like Paypal/Venmo/GPay/ApplePayhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Donations_through_wallets_like_Paypal/Venmo/GPay/ApplePay Donations through Fundraiseuphttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/E-mail_preference_center#Donations_through_Fundraiseup https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Database_cheatsheet This comes from contribution_status in civicrm_option_group (id=11) and then the values from civicrm_option_value https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server#Overview Processhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server#Process Create a Server for a new servicehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server#Create_a_Server_for_a_new_service Create a replacement server for an existing servicehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server#Create_a_replacement_server_for_an_existing_service NFS service failoverhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server#NFS_service_failover https://wikitech.wikimedia.org/wiki/GitLab/Stewardship This table documents accountabilities for the various pieces of GitLab infrastructure. https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub === Core Service and Dependency Setup === Core Service and Dependency Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Core_Service_and_Dependency_Setup Core DataHub Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Core_DataHub_Services Metadata Service (GMS)https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Metadata_Service_(GMS) Frontend Servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Frontend_Service Metadata Change Event (MCE) Consumer Jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Metadata_Change_Event_(MCE)_Consumer_Job Metadata Audit Event (MAE) Consumer Jobhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Metadata_Audit_Event_(MAE)_Consumer_Job Confluent Platform Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Confluent_Platform_Services Zookeeperhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Zookeeper Kafkahttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Kafka Schema Registryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Schema_Registry Search Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Search_Services Graph Database Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Graph_Database_Services Ingestion Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Ingestion_Configuration Hive Ingestionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Hive_Ingestion Kafka Ingestionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Kafka_Ingestion Druid Ingestionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Druid_Ingestion Progress Statushttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Progress_Status Perceptionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Perceptions Outcomehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/DataHub#Outcome https://wikitech.wikimedia.org/wiki/Incident_Scorecard To measure progress outside of standard incident counts and severities, the SRE team has designed an incident scorecard, to be applied in every major incident, measuring the team’s incident response and engagement score. The scorecard is meant to be filled out as part of the Incident review ritual. Incident Assessment Overviewhttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Incident_Assessment_Overview Definitionshttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Definitions Incident documenthttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Incident_document Metadatahttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Metadata Metadata dictionaryhttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Metadata_dictionary Incident statushttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Incident_status Engagement Scorecardhttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Engagement_Scorecard Aggregate ScoreCardhttps://wikitech.wikimedia.org/wiki/Incident_Scorecard#Aggregate_ScoreCard https://wikitech.wikimedia.org/wiki/Incident_review_ritual __TOC__ Introhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Intro Problem statementhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Problem_statement Proposalhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Proposal Ritual walkthroughhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Ritual_walkthrough Assign a person running the ritualhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Assign_a_person_running_the_ritual Filling in the scorecardhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Filling_in_the_scorecard Metadata Dictionaryhttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Metadata_Dictionary Advicehttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Advice Sharing knowledgehttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Sharing_knowledge Walkthrough the incidenthttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Walkthrough_the_incident Templatehttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Template Leave space for questionshttps://wikitech.wikimedia.org/wiki/Incident_review_ritual#Leave_space_for_questions https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48 == 2022-01-31 == 2022-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-31 2022-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-29 2022-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-28 2022-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-27 2022-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-26 2022-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-25 2022-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-24 2022-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-23 2022-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-22 2022-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-21 2022-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-20 2022-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-19 2022-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-18 2022-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-17 2022-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-16 2022-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-15 2022-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-14 2022-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-13 2022-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-12 2022-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-11 2022-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-10 2022-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-08 2022-01-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-07 2022-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-06 2022-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-05 2022-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-04 2022-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_48#2022-01-03 https://wikitech.wikimedia.org/wiki/Incidents/2022-02-01_ulsfo_network ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-01_ulsfo_network#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-01_ulsfo_network#Timeline Conclusionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-01_ulsfo_network#Conclusion Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-01_ulsfo_network#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev Fundraising-dev is a set of docker images coordinated by docker-compose configuration and a setup script. Its purpose is to let all members of the Fundraising Tech team develop against the same setup of PHP, mediawiki, and CiviCRM, along with their ancillary tools and databases. More Docshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#More_Docs Quickstarthttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Quickstart Detailed Starthttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Detailed_Start Components installedhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Components_installed CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#CiviCRM Payments-wikihttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Payments-wiki Email Preference Centerhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Email_Preference_Center CiviProxyhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#CiviProxy IPN listenershttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#IPN_listeners PrivateBinhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#PrivateBin Mailcatcherhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Mailcatcher Redishttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Redis MariaDBhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#MariaDB Donut (donatewiki)https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Donut_(donatewiki) Running stuff on the docker VMshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Running_stuff_on_the_docker_VMs FR-tech-dev cloud projecthttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#FR-tech-dev_cloud_project Domain Names and forwardinghttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Domain_Names_and_forwarding Setup and Administrationhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Setup_and_Administration Imageshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Fundraising-dev#Images https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Shared_Runners === Current Gitlab Runner setup ([=== https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Shared_Runners# Setting up a new shared runnerhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Shared_Runners#Setting_up_a_new_shared_runner https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners Trusted GitLab Runners offer CI with additional security and trust requirements. In contrast to the Shared Runners, which run in WMCS, Trusted Runners live inside WMF infrastructure. Request access to Trusted Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners#Request_access_to_Trusted_Runners Using Trusted Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners#Using_Trusted_Runners Troubleshootinghttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners#Troubleshooting Dockerfile supporthttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners#Dockerfile_support Monitoringhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners#Monitoring Further Readhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Trusted_Runners#Further_Read https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation === Future Gitlab Runner setup ([=== Future Gitlab Runner setup (T286958)https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Future_Gitlab_Runner_setup_(T286958) GitLab Runner platformhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#GitLab_Runner_platform Compute Environmentshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Compute_Environments Elastic demandhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Elastic_demand Privacy and trust considerationshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Privacy_and_trust_considerations Monitoring of performance and usagehttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Monitoring_of_performance_and_usage Proposed future architecturehttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Proposed_future_architecture Shared GitLab Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Shared_GitLab_Runners Specific GitLab Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Specific_GitLab_Runners Instance-wide Shared Cloud Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Instance-wide_Shared_Cloud_Runners Bring-your-own Runnerhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Platform_Evaluation#Bring-your-own_Runner https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation This page describes the access and permission model for different kind of Runners as well as additional security measures. Access and permission modelhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Access_and_permission_model Personal/team projectshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Personal/team_projects Supported projectshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Supported_projects Supported projects with trusted buildshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Supported_projects_with_trusted_builds Security measureshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Security_measures Jobs on protected branch onlyhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Jobs_on_protected_branch_only Tagged jobs onlyhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Tagged_jobs_only Run gitlab-runner as non-roothttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Run_gitlab-runner_as_non-root Firewall configurationhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Firewall_configuration Restrict allowed imageshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Restrict_allowed_images Runner configuration changeshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Runner_configuration_changes Rootless Docker and dropped Docker capabilitieshttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Security_Evaluation#Rootless_Docker_and_dropped_Docker_capabilities https://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners A set of instance-wide Shared Runners offer CI capabilities for unreviewed (meaning untrusted) code for private projects and forks. This Runners are available for every project by default and help the community and volunteers to have CI for every code change. Public Cloud Evaluationhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners#Public_Cloud_Evaluation API and automationhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners#API_and_automation Provider Dependencyhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners#Provider_Dependency Provisioning of Runner environmenthttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners#Provisioning_of_Runner_environment Integration of GitLab Runner into Kubernetes Clusterhttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners#Integration_of_GitLab_Runner_into_Kubernetes_Cluster Usage of Cloud Runnershttps://wikitech.wikimedia.org/wiki/GitLab/Gitlab_Runner/Cloud_Runners#Usage_of_Cloud_Runners https://wikitech.wikimedia.org/wiki/Wikimediastatus.net https://www.wikimediastatus. Instructions for usershttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net#Instructions_for_users SRE usage instructionshttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net#SRE_usage_instructions Historical backgroundhttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net#Historical_background What merits posting on the status page?https://wikitech.wikimedia.org/wiki/Wikimediastatus.net#What_merits_posting_on_the_status_page? Statograph (automated metrics upload)https://wikitech.wikimedia.org/wiki/Wikimediastatus.net#Statograph_(automated_metrics_upload) See alsohttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net#See_also External linkshttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net#External_links https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/OpenMetadata === Core Service and Dependency Setup === Core Service and Dependency Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/OpenMetadata#Core_Service_and_Dependency_Setup Ingestion Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/OpenMetadata#Ingestion_Configuration Progress Statushttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/OpenMetadata#Progress_Status Perceptionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/OpenMetadata#Perceptions Outcomehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection/Rubric/OpenMetadata#Outcome https://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_Expansion_EVPN This page will provide an overview of the WMF switch fabric networking as deployed in the 'new cage' (rows E/F) in Eqiad (Equinix Ashburn). Detailed Designhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_Expansion_EVPN#Detailed_Design Testinghttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_Expansion_EVPN#Testing https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion This page documents various tests done to validate the correct operation of networking devices in the new cage (rows E/F) in Eqiad (Equinix, Ashburn). The switches in these rows has been set up differently to those in other rows, following an updated deisgn. Test Topologyhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Test_Topology Functional Testshttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Functional_Tests L2 Access porthttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#L2_Access_port L2 Trunk porthttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#L2_Trunk_port Routed port in VRFhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Routed_port_in_VRF IPv4https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv4 IPv6https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv6 Standard IP gateway / IRB in VRFhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Standard_IP_gateway_/_IRB_in_VRF Remote MAC Learning on Vlan/VNIhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Remote_MAC_Learning_on_Vlan/VNI Client to Client L2 Unicast forwardinghttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Client_to_Client_L2_Unicast_forwarding Same Switch (Pure L2)https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Same_Switch_(Pure_L2) Remote Switch (VXLAN tunneled)https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Remote_Switch_(VXLAN_tunneled) Client to Client broadcast forwarding / ingress replicationhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Client_to_Client_broadcast_forwarding_/_ingress_replication Client to Client L2 multicast forwarding / ingress replicationhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Client_to_Client_L2_multicast_forwarding_/_ingress_replication Anycast IP gateway / IRB across multiple switcheshttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Anycast_IP_gateway_/_IRB_across_multiple_switches Inter-Vlan/subnet routing via IRB interfaces on same switchhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Inter-Vlan/subnet_routing_via_IRB_interfaces_on_same_switch Inter-Vlan/subnet routing via IRB interfaces on separate switcheshttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Inter-Vlan/subnet_routing_via_IRB_interfaces_on_separate_switches BGP Peering on Vlan segment to end devicehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Peering_on_Vlan_segment_to_end_device IPv4 onlyhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv4_only IPv4 carrying IPv4 & IPv6 address familieshttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv4_carrying_IPv4_&_IPv6_address_families IPv4 & IPv6 each carrying their own address familyhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv4_&_IPv6_each_carrying_their_own_address_family BGP Peering on Vlan segment from Anycast GW IPhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Peering_on_Vlan_segment_from_Anycast_GW_IP BGP Peering on Vlan segment with Anycast GW, from Unicast IPhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Peering_on_Vlan_segment_with_Anycast_GW,_from_Unicast_IP IPv4 Onlyhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv4_Only BGP Re-establishment if device peered to Anycast GW moved to new switch (i.e. VM live motion)https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Re-establishment_if_device_peered_to_Anycast_GW_moved_to_new_switch_(i.e._VM_live_motion) eBGP Peering in VRF to external devicehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#eBGP_Peering_in_VRF_to_external_device BGP Route propagaton from unicast peer into EVPN and into remote VRF tablehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Route_propagaton_from_unicast_peer_into_EVPN_and_into_remote_VRF_table BGP Route propagation to external hosts from VRF [IPv4]https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Route_propagation_to_external_hosts_from_VRF_[IPv4] BGP Peering to external host from VRF using local-as 14907https://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#BGP_Peering_to_external_host_from_VRF_using_local-as_14907 Inernal routing from device connected to access vlanhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Inernal_routing_from_device_connected_to_access_vlan External routing from device connected to access vlanhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#External_routing_from_device_connected_to_access_vlan ARP Supressionhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#ARP_Supression ND Suppressionhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#ND_Suppression DHCP Relay & Option 82 insertionhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#DHCP_Relay_&_Option_82_insertion IPv6 Router Advertisement Generationhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IPv6_Router_Advertisement_Generation DHCP Relay On Stretched Vlan / IRB with Anycast GWhttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#DHCP_Relay_On_Stretched_Vlan_/_IRB_with_Anycast_GW IP Filters on Routed interfacehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IP_Filters_on_Routed_interface IP Filters on IRB interfacehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#IP_Filters_on_IRB_interface Failover Testshttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Failover_Tests Spine Switch Failurehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Spine_Switch_Failure Leaf to Spine Link Failurehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Leaf_to_Spine_Link_Failure Spine to CR Link Failurehttps://wikitech.wikimedia.org/wiki/VXLAN-EVPN_Network_Testing_-_Eqiad_Expansion#Spine_to_CR_Link_Failure https://wikitech.wikimedia.org/wiki/Fundraising/Annual_PCI_form Wikimedia is at the SAQ-A level of PCI compliance, meaning we collect all card donations via third party processors and do not let any full card numbers touch our servers. Many of the PCI rules are simply good security practices, such as not using shared accounts. https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/02 ==Week of February 07== Week of February 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/02#Week_of_February_07 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/02#=== Week of February 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/02#Week_of_February_14 Week of February 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/02#Week_of_February_21 Week of February 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/02#Week_of_February_28 https://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding == Background == Backgroundhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Background First Stepshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#First_Steps Wikimedia tech employee orientationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Wikimedia_tech_employee_orientation Wikimedia accounthttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Wikimedia_account IRChttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#IRC Mailing listshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Mailing_lists Office wikihttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Office_wiki Headsethttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Headset Culturehttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Culture Getting permitshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Getting_permits SSH keyshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#SSH_keys Wikitech/Cloud VPShttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Wikitech/Cloud_VPS LDAPhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#LDAP MediaWikihttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#MediaWiki Phabricatorhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Phabricator Gerrithttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Gerrit Accessing production infrastructurehttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Accessing_production_infrastructure Sample ssh confighttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Sample_ssh_config Logging inhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Logging_in Mischttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Misc Operating systemhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Operating_system Further readinghttps://wikitech.wikimedia.org/wiki/Machine_Learning/Onboarding#Further_reading https://wikitech.wikimedia.org/wiki/Kubernetes/Ingress == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Introduction Istio setup and configurationhttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Istio_setup_and_configuration Troubleshootinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Troubleshooting Status of the ingressgatewayhttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Status_of_the_ingressgateway Retrieve clusters, listeners, routes, endpoints, secretshttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Retrieve_clusters,_listeners,_routes,_endpoints,_secrets Dump complete envoy confighttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Dump_complete_envoy_config Enable debug logginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Enable_debug_logging Administrationhttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Administration Add a new service under Ingresshttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Add_a_new_service_under_Ingress Configure certificates (optional)https://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Configure_certificates_(optional) DNS changeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#DNS_changes Create an entry in the service::cataloghttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Create_an_entry_in_the_service::catalog Configuration (for service owners)https://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#Configuration_(for_service_owners) More complex setupshttps://wikitech.wikimedia.org/wiki/Kubernetes/Ingress#More_complex_setups https://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Introduction Commandshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Commands List all images (without registry) running in the clusterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#List_all_images_(without_registry)_running_in_the_cluster List images used per namespacehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#List_images_used_per_namespace Check which image version a cronjob is usinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Check_which_image_version_a_cronjob_is_using Run a cronjob manuallyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Run_a_cronjob_manually Peek into a helm deployment confighttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Peek_into_a_helm_deployment_config Peek into a k8s secret TLS certificatehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Peek_into_a_k8s_secret_TLS_certificate List all RBAC "Groups" referenced in the clusterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#List_all_RBAC_"Groups"_referenced_in_the_cluster Get all pods and their prioritieshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Get_all_pods_and_their_priorities Last termination reason and timehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Last_termination_reason_and_time Get elected master component leadershttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Get_elected_master_component_leaders List all container images available per nodeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#List_all_container_images_available_per_nodes Force refresh of a cert-manager certificatehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Force_refresh_of_a_cert-manager_certificate Drain a "dead" nodehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubectl/Cheat_Sheet#Drain_a_"dead"_node https://wikitech.wikimedia.org/wiki/GitLab/Test_Instance A production-like test instance can be used to test changes, updates and prototype code. The WMCS/VPS instance gitlab-prod-1002. Resetting test instancehttps://wikitech.wikimedia.org/wiki/GitLab/Test_Instance#Resetting_test_instance Setup new test instanceshttps://wikitech.wikimedia.org/wiki/GitLab/Test_Instance#Setup_new_test_instances Open todoshttps://wikitech.wikimedia.org/wiki/GitLab/Test_Instance#Open_todos https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Summary Helm at the WMFhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Helm_at_the_WMF Chartshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Charts Helmfilehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Helmfile Add a model to an existing helmfile confighttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Add_a_model_to_an_existing_helmfile_config revscoring_inference_serviceshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#revscoring_inference_services Add a new helmfile confighttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Add_a_new_helmfile_config How to upload a model to Swifthttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#How_to_upload_a_model_to_Swift How to deployhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#How_to_deploy Test your model after deploymenthttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Test_your_model_after_deployment Troubleshootinghttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Deploy#Troubleshooting https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent === Error / Incident === Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Debugging Quick checkhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Quick_check Common remediation operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Common_remediation_operations Verify if cinder API is up and running and start it if nothttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Verify_if_cinder_API_is_up_and_running_and_start_it_if_not Examine leftover snapshotshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Examine_leftover_snapshots Cleanup of corrupted backups and old volume snapshotshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Cleanup_of_corrupted_backups_and_old_volume_snapshots See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#See_also Old occurrenceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_for_snapshots_leaked_by_cinder_backup_agent#Old_occurrences https://wikitech.wikimedia.org/wiki/Map_of_database_maintenance == Today (2024-11-04) == Today (2024-11-04)https://wikitech.wikimedia.org/wiki/Map_of_database_maintenance#Today_(2024-11-04) Yesterday (2024-11-03)https://wikitech.wikimedia.org/wiki/Map_of_database_maintenance#Yesterday_(2024-11-03) Last seven dayshttps://wikitech.wikimedia.org/wiki/Map_of_database_maintenance#Last_seven_days https://wikitech.wikimedia.org/wiki/Map_of_database_maintenance/Header Here you can follow maintenance on our databases. This is useful to spot potential causes for issues in production or avoid interfering with another maintenance work. https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches This page details the individual tests carried out to validate the Dell hardware / Sonic OS platform. For further information please see the Dell Enterprise Sonic Evaluation write up. Test Topologyhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Test_Topology Physical Testshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Physical_Tests Transceiver Compatibilityhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Transceiver_Compatibility FS.com 40GBase-PSM4 QSFP+https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#FS.com_40GBase-PSM4_QSFP+ Finisar 10GBase-LR SFP+https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Finisar_10GBase-LR_SFP+ FS.com 10GBase-LR SFP+https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#FS.com_10GBase-LR_SFP+ Juniper 10G 3m DAC 10GBASE-CR-DAC-3.0Mhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Juniper_10G_3m_DAC_10GBASE-CR-DAC-3.0M FS.com 10G 3m DAChttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#FS.com_10G_3m_DAC Juniper 40GBase-SR4 QSFP+https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Juniper_40GBase-SR4_QSFP+ FS.com SFP 1000BASE-Thttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#FS.com_SFP_1000BASE-T 'Breakout' Transceivershttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#'Breakout'_Transceivers 4x10G QSFP+ in 'Breakout' Modehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#4x10G_QSFP+_in_'Breakout'_Mode 4x25G QSFP28 in 'Brekaout' Modehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#4x25G_QSFP28_in_'Brekaout'_Mode Transceiver DOM Supprthttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Transceiver_DOM_Supprt SFP+ / SFP28https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#SFP+_/_SFP28 QSFP+ / QSFP28https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#QSFP+_/_QSFP28 Functional Testshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Functional_Tests L2 Access porthttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#L2_Access_port L2 Trunk porthttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#L2_Trunk_port Routing to end host from Vlan interface in VRFhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Routing_to_end_host_from_Vlan_interface_in_VRF IPv4https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IPv4 IPv6https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IPv6 Routed port in VRFhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Routed_port_in_VRF Jumbo frames across L2 Vlanhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Jumbo_frames_across_L2_Vlan Same Switchhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Same_Switch Remote via VXLANhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Remote_via_VXLAN Jumbo frames L3 routinghttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Jumbo_frames_L3_routing Remote MAC Learning on Vlan/VNIhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Remote_MAC_Learning_on_Vlan/VNI Client to Client L2 Unicast forwardinghttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Client_to_Client_L2_Unicast_forwarding Same Switch (Pure L2)https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Same_Switch_(Pure_L2) Remote Switch (VXLAN tunneled)https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Remote_Switch_(VXLAN_tunneled) Client to Client broadcast forwarding / ingress replicationhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Client_to_Client_broadcast_forwarding_/_ingress_replication Client to Client L2 multicast forwarding / ingress replicationhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Client_to_Client_L2_multicast_forwarding_/_ingress_replication Inter-Vlan/subnet routing via IRB interfaces on same switchhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Inter-Vlan/subnet_routing_via_IRB_interfaces_on_same_switch Inter-Vlan/subnet routing via IRB interfaces on separate switcheshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Inter-Vlan/subnet_routing_via_IRB_interfaces_on_separate_switches IPv6 RA Generation from Vlan Interfaceshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IPv6_RA_Generation_from_Vlan_Interfaces BGP Peering on Vlan segment to end devicehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BGP_Peering_on_Vlan_segment_to_end_device IPv4 onlyhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IPv4_only IPv4 carrying IPv4 & IPv6 address familieshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IPv4_carrying_IPv4_&_IPv6_address_families IPv4 & IPv6 each carrying their own address familyhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IPv4_&_IPv6_each_carrying_their_own_address_family BGP Peering on Vlan segment from Anycast GW IPhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BGP_Peering_on_Vlan_segment_from_Anycast_GW_IP BGP Peering on Vlan segment with Anycast GW, from Unicast IPhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BGP_Peering_on_Vlan_segment_with_Anycast_GW,_from_Unicast_IP BGP Re-establishment if device peered to Anycast GW moved to new switch (i.e. VM live motion)https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BGP_Re-establishment_if_device_peered_to_Anycast_GW_moved_to_new_switch_(i.e._VM_live_motion) eBGP Peering in VRF to external devicehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#eBGP_Peering_in_VRF_to_external_device BFD Support on Peering to External Device (VRF)https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BFD_Support_on_Peering_to_External_Device_(VRF) BFD Support on BGP peering in global tablehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BFD_Support_on_BGP_peering_in_global_table BGP Route propagaton from unicast peer into EVPN and into remote VRF tablehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BGP_Route_propagaton_from_unicast_peer_into_EVPN_and_into_remote_VRF_table BGP Route propagation to external hosts from VRFhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#BGP_Route_propagation_to_external_hosts_from_VRF ECMP Routing in overlay networkhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#ECMP_Routing_in_overlay_network ARP Supressionhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#ARP_Supression ND Suppressionhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#ND_Suppression DHCP Relay & Option 82 insertionhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#DHCP_Relay_&_Option_82_insertion DHCP Relayhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#DHCP_Relay Option 82https://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Option_82 IP Filters on Routed interfacehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IP_Filters_on_Routed_interface IP Filters on IRB interfacehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#IP_Filters_on_IRB_interface Filter access to RE/CPU/Device Serviceshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Filter_access_to_RE/CPU/Device_Services Failover Testshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Failover_Tests Spine Switch Failurehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Spine_Switch_Failure Leaf to Spine Link Failurehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Leaf_to_Spine_Link_Failure Management Testshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Management_Tests User Account Creationhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#User_Account_Creation SSH Access to Managementhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#SSH_Access_to_Management SSH Key Authhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#SSH_Key_Auth Management VRFhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Management_VRF SNMP RO Accesshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#SNMP_RO_Access NTPhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#NTP LLDPhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#LLDP Server Sidehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Server_Side Switch Sidehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Switch_Side Per-interface LLDP controlhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Per-interface_LLDP_control sFlow Exporthttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#sFlow_Export Prometheus Exporthttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Prometheus_Export Puppet Agenthttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Puppet_Agent Automation Testshttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Automation_Tests RESTCONFhttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#RESTCONF Partial config replacehttps://wikitech.wikimedia.org/wiki/SONiC/VXLAN-EVPN_Network_Testing_-_Sonic_on_Dell_switches#Partial_config_replace https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection ==Data Catalog Evaluation== Data Catalog Evaluationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#Data_Catalog_Evaluation What is a Data Catalog?https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#What_is_a_Data_Catalog? Problem Statementhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#Problem_Statement Impact Hypothesishttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#Impact_Hypothesis Evaluation Candidateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#Evaluation_Candidates WMF Functional Requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#WMF_Functional_Requirements MVP Goalshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#MVP_Goals Technical MVP Evaluationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#Technical_MVP_Evaluation Notes on the Candidateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/2021_data_catalog_selection#Notes_on_the_Candidates https://wikitech.wikimedia.org/wiki/Bolt Puppet Bolt supports a variety of uses cases, but one in particular is interesting for our use, masterless Puppet catalog applies. In a masterless apply rather than obtaining the catalog from the puppet master the catalog is compiled directly from the source repository. Install Directionshttps://wikitech.wikimedia.org/wiki/Bolt#Install_Directions Install Bolt, not currently in Debian unfortunatelyhttps://wikitech.wikimedia.org/wiki/Bolt#Install_Bolt,_not_currently_in_Debian_unfortunately Delete Bolt’s system modulehttps://wikitech.wikimedia.org/wiki/Bolt#Delete_Bolt’s_system_module Add bolt utilities to your pathhttps://wikitech.wikimedia.org/wiki/Bolt#Add_bolt_utilities_to_your_path Usagehttps://wikitech.wikimedia.org/wiki/Bolt#Usage Noop a serverhttps://wikitech.wikimedia.org/wiki/Bolt#Noop_a_server Look through outputhttps://wikitech.wikimedia.org/wiki/Bolt#Look_through_output Outstanding Issueshttps://wikitech.wikimedia.org/wiki/Bolt#Outstanding_Issues https://wikitech.wikimedia.org/wiki/Phabricator/pushing_over_https == How to git push over https to repos on Phabricator Diffusion == How to git push over https to repos on Phabricator Diffusionhttps://wikitech.wikimedia.org/wiki/Phabricator/pushing_over_https#How_to_git_push_over_https_to_repos_on_Phabricator_Diffusion Set a VCS passwordhttps://wikitech.wikimedia.org/wiki/Phabricator/pushing_over_https#Set_a_VCS_password Clone repo and pushhttps://wikitech.wikimedia.org/wiki/Phabricator/pushing_over_https#Clone_repo_and_push Afterwardshttps://wikitech.wikimedia.org/wiki/Phabricator/pushing_over_https#Afterwards https://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_wdqs_updater_codfw ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_wdqs_updater_codfw#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_wdqs_updater_codfw#Timeline Documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_wdqs_updater_codfw#Documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_wdqs_updater_codfw#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_wdqs_updater_codfw#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template Origin task: [of the decision: 2022-02-22 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template#Options_considered Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_template#Option_1 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks This page contains basic resources for developers who want to author and publish runbooks for Toolforge on Wikitech. Before you beginhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#Before_you_begin What is a runbook?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#What_is_a_runbook? When should you use a runbook?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#When_should_you_use_a_runbook? Tips for building useful runbookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#Tips_for_building_useful_runbooks Cloud VPS runbook templateshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#Cloud_VPS_runbook_templates Where to publish runbooks for Toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#Where_to_publish_runbooks_for_Toolforge Existing runbookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#Existing_runbooks See Alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks#See_Also https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49 == 2022-02-28 == 2022-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-28 2022-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-27 2022-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-25 2022-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-24 2022-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-23 2022-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-22 2022-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-21 2022-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-20 2022-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-19 2022-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-18 2022-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-17 2022-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-16 2022-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-15 2022-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-14 2022-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-13 2022-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-12 2022-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-11 2022-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-10 2022-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-09 2022-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-08 2022-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-07 2022-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-05 2022-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-04 2022-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-03 2022-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-02 2022-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_49#2022-02-01 https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Civicrm_staging_server == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Civicrm_staging_server#Overview Deploying to staginghttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Civicrm_staging_server#Deploying_to_staging https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes This is the systemd timer that triggers the cinder volumes backups. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Common_issues Timeout when doing a backuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Timeout_when_doing_a_backup Check the current speed of download in the backup machinehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Check_the_current_speed_of_download_in_the_backup_machine Increasing the timeout of the individual backupshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Increasing_the_timeout_of_the_individual_backups Snapshot 'available' but cannot be deletedhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Snapshot_'available'_but_cannot_be_deleted Snapshot stuck in 'deleting' statehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Snapshot_stuck_in_'deleting'_state Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Related_information Old occurenceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Old_occurences Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_cinder_volumes#Support_contacts https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub We run an instance of DataHub which acts as a centralized data catalog, intended to facilitate the following: Accessing DataHubhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Accessing_DataHub Frontendhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Frontend Generalized Metadata Servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Generalized_Metadata_Service Via the CLIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Via_the_CLI Accessing the Staging Instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Accessing_the_Staging_Instance Related Pageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Related_Pages Service Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Service_Overview DataHub Componentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#DataHub_Components Backend Data Tiershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Backend_Data_Tiers Metadata Sourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Metadata_Sources Ingestionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Ingestion Automated Ingestionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Automated_Ingestion Manual Ingestion Examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Manual_Ingestion_Example Operationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Operations Administrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub#Administration https://wikitech.wikimedia.org/wiki/Incidents/2022-03-06_wdqs-categories ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-06_wdqs-categories#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-06_wdqs-categories#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-06_wdqs-categories#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-06_wdqs-categories#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-03-01_ulsfo_network ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-01_ulsfo_network#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-01_ulsfo_network#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-01_ulsfo_network#Scorecard https://wikitech.wikimedia.org/wiki/PAWS/Additional_features Features previously listed here no longer exist. https://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_vrts ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_vrts#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_vrts#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-22_vrts#Scorecard https://wikitech.wikimedia.org/wiki/Shared_Data_Platform == Wikimedia Shared Data Platform for Knowledge as a Service == Wikimedia Shared Data Platform for Knowledge as a Servicehttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Wikimedia_Shared_Data_Platform_for_Knowledge_as_a_Service Disclaimer: this document is not a project proposalhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Disclaimer:_this_document_is_not_a_project_proposal Problem Statementhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Problem_Statement Overview of current (2022) WMF data infrastructurehttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Overview_of_current_(2022)_WMF_data_infrastructure MediaWiki data (in MariaDB)https://wikitech.wikimedia.org/wiki/Shared_Data_Platform#MediaWiki_data_(in_MariaDB) Event data (in Kafka)https://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Event_data_(in_Kafka) Other services and datastoreshttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Other_services_and_datastores Analytics Data Lake (Hadoop)https://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Analytics_Data_Lake_(Hadoop) What’s missing?https://wikitech.wikimedia.org/wiki/Shared_Data_Platform#What’s_missing? A way forward: Data as a Product via a Shared Data Platformhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#A_way_forward:_Data_as_a_Product_via_a_Shared_Data_Platform Data as a Producthttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Data_as_a_Product Domain Datahttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Domain_Data Common Data Infrastructurehttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Common_Data_Infrastructure What about analytics?https://wikitech.wikimedia.org/wiki/Shared_Data_Platform#What_about_analytics? Data as a Servicehttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Data_as_a_Service Existent projects that move us forwardhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Existent_projects_that_move_us_forward Shared Data Platform - Externalized Data Lifecyclehttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Shared_Data_Platform_-_Externalized_Data_Lifecycle Producehttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Produce Discoverhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Discover Source (verb)https://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Source_(verb) Transformhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Transform Ingesthttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Ingest Conclusionhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Conclusion Possible Shared Data Platform Diagramhttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Possible_Shared_Data_Platform_Diagram Further readinghttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Further_reading Examples of Wikimedia one-off data pipelineshttps://wikitech.wikimedia.org/wiki/Shared_Data_Platform#Examples_of_Wikimedia_one-off_data_pipelines https://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks == Round trip testing == Round trip testinghttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Round_trip_testing Resultshttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Results Troubleshootinghttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Troubleshooting Freeing disk spacehttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Freeing_disk_space Gory detailshttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Gory_details Preparing a new (weekly) Parsoid deployhttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Preparing_a_new_(weekly)_Parsoid_deploy Reviewing the vendor patchhttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Reviewing_the_vendor_patch Noteshttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Notes Check Production logshttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Check_Production_logs Visual diff testinghttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Visual_diff_testing Publishing results on mediawikihttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#Publishing_results_on_mediawiki TODOhttps://wikitech.wikimedia.org/wiki/Parsoid/Common_Tasks#TODO https://wikitech.wikimedia.org/wiki/Incidents/2022-03-10_MediaWiki_availability ==MediaWiki availability on all wikis for logged-in users / uncached content== MediaWiki availability on all wikis for logged-in users / uncached contenthttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-10_MediaWiki_availability#MediaWiki_availability_on_all_wikis_for_logged-in_users_/_uncached_content Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-10_MediaWiki_availability#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-10_MediaWiki_availability#Scorecard https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/ML-Sandbox/Usage-Examples Examples on how to use the WMF ML-Sandbox environment to develop and test your isvc code. https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions The date function documentation is licensed by Apache Software Foundation (ASF) under the Apache License, Version 2.0. DATETIMEhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#DATETIME Syntaxhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#Syntax Examplehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#Example DATEADDhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#DATEADD DATETRUNChttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#DATETRUNC LASTDAYhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#LASTDAY HOLIDAYhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Date_functions#HOLIDAY https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/03 ==Week of March 07== Week of March 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/03#Week_of_March_07 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/03#=== Week of March 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/03#Week_of_March_14 Week of March 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/03#Week_of_March_21 Week of March 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/03#Week_of_March_28 https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes = 2022-02-23 = 2022-02-23https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2022-02-23 Feasthttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Feast ORES deployhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#ORES_deploy Changeprop calling OREShttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Changeprop_calling_ORES Lift Wing migrationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Lift_Wing_migration 2022-02-16https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2022-02-16 API Gateway platformhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#API_Gateway_platform editquality migrationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#editquality_migration eventgate scoreshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#eventgate_scores 2022-02-09https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2022-02-09 API Gatewayhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#API_Gateway Transformers (again)https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Transformers_(again) ORES migrationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#ORES_migration Staging Environmenthttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Staging_Environment 2022-01-26https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2022-01-26 ORES deploy planninghttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#ORES_deploy_planning API Gateway Integrationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#API_Gateway_Integration Image Recommendation?https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Image_Recommendation? 2022-01-19https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2022-01-19 Lift Wing MVP check-inhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Lift_Wing_MVP_check-in Wikidata ORES spikeshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Wikidata_ORES_spikes ORES clientshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#ORES_clients 2022-01-12https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2022-01-12 Feast spike & hardware orderhttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Feast_spike_&_hardware_order nlwiki articlequality deploymenthttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#nlwiki_articlequality_deployment ORES wikidata spikehttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#ORES_wikidata_spike Load Testinghttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Load_Testing 2021-12-15https://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#2021-12-15 Transformershttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Transformers Deployment Pipeline image issueshttps://wikitech.wikimedia.org/wiki/Machine_Learning/Technical_Meeting_Notes#Deployment_Pipeline_image_issues https://wikitech.wikimedia.org/wiki/Karapace Karapace is a schema registry with the permissive Apache 2 license that we are using for the Datahub data catalog since the default confluent schema registry uses the more restrictive Confluent Community License. Administrationhttps://wikitech.wikimedia.org/wiki/Karapace#Administration Instanceshttps://wikitech.wikimedia.org/wiki/Karapace#Instances https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Contact For most requests, use https://www.mediawiki. Other ways to contact the Data Platform Engineering teamshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Contact#Other_ways_to_contact_the_Data_Platform_Engineering_teams Reporting issues and making requestshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Contact#Reporting_issues_and_making_requests Work organizationhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Contact#Work_organization https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Learning_Materials == Talks and Presentations == Talks and Presentationshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Learning_Materials#Talks_and_Presentations Data Practices and Privacy Engineeringhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Learning_Materials#Data_Practices_and_Privacy_Engineering General Overview: What is analytics doing back there?https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Learning_Materials#General_Overview:_What_is_analytics_doing_back_there? Talks recommended by other members of the Data Engineering team:https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Learning_Materials#Talks_recommended_by_other_members_of_the_Data_Engineering_team: https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Overview Current Payment Methods (as of 2024-08-05)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Current_Payment_Methods_(as_of_2024-08-05) Current Countries (as of 2024-02-14)https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Current_Countries_(as_of_2024-02-14) Stringshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Strings Enablinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Enabling Deployinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Deploying Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Monthly_convert#Testing https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Debugging Maintain-dbusers daemonhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Maintain-dbusers_daemon replica_cnf APIhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#replica_cnf_API Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Common_issues Connectivity issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Connectivity_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_backup_vms#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Roadmap Like all software, Cloud VPS is a work in progress. Here is an outline of near- and long-term improvements planned for the platform. Done, as of 2024-01-01https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Roadmap#Done,_as_of_2024-01-01 Near future (AKA things we have already started on)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Roadmap#Near_future_(AKA_things_we_have_already_started_on) Possible future features (AKA things we would like to work on someday)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Roadmap#Possible_future_features_(AKA_things_we_would_like_to_work_on_someday) https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern Origin task: [of the decision: 2022-03-23 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Constraints_and_risks certificateshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#certificates deployment mechanismhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#deployment_mechanism new standard, who makes the changes?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#new_standard,_who_makes_the_changes? Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T303931_k8s_standard_deployment_code_pattern#Option_3 https://wikitech.wikimedia.org/wiki/Istio From the upstream website: Istio extends Kubernetes to establish a programmable, application-aware network using the powerful Envoy service proxy. Working with both Kubernetes and traditional workloads, Istio brings standard, universal traffic management, telemetry, and security to complex deployments. Istio binary sourceshttps://wikitech.wikimedia.org/wiki/Istio#Istio_binary_sources Istioctlhttps://wikitech.wikimedia.org/wiki/Istio#Istioctl Istio build Docker imagehttps://wikitech.wikimedia.org/wiki/Istio#Istio_build_Docker_image Istio-cnihttps://wikitech.wikimedia.org/wiki/Istio#Istio-cni https://wikitech.wikimedia.org/wiki/Search_Console_Data == What? == What?https://wikitech.wikimedia.org/wiki/Search_Console_Data#What? How?https://wikitech.wikimedia.org/wiki/Search_Console_Data#How? Request processhttps://wikitech.wikimedia.org/wiki/Search_Console_Data#Request_process Notes for Console administratorshttps://wikitech.wikimedia.org/wiki/Search_Console_Data#Notes_for_Console_administrators Google Search Consolehttps://wikitech.wikimedia.org/wiki/Search_Console_Data#Google_Search_Console Adding Users to Domainshttps://wikitech.wikimedia.org/wiki/Search_Console_Data#Adding_Users_to_Domains Removing Users from Domainshttps://wikitech.wikimedia.org/wiki/Search_Console_Data#Removing_Users_from_Domains Bing Webmaster Toolshttps://wikitech.wikimedia.org/wiki/Search_Console_Data#Bing_Webmaster_Tools https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Summary Simple Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Simple_Timeline Detailed Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Detailed_Timeline Leading up to the incidenthttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Leading_up_to_the_incident The actual incidenthttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#The_actual_incident Elukey respondshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Elukey_responds Rolling restart complete, service health restoredhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Rolling_restart_complete,_service_health_restored Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_wdqs_outage#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes == Troubleshooting == Troubleshootinghttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Troubleshooting Block an IP address or multiple IP addresseshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Block_an_IP_address_or_multiple_IP_addresses Add an IP block rulehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Add_an_IP_block_rule Remove an IP block rulehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Remove_an_IP_block_rule Noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Notes Rate-limit IP addresseshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Rate-limit_IP_addresses Add rate-limiting rulehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Add_rate-limiting_rule Remove rate-limiting rulehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Notes#Remove_rate-limiting_rule https://wikitech.wikimedia.org/wiki/Requestctl requestctl is a command-line tool to control the configuration that manages access and routing of web requests. Wikimedia SREs use this tool to throttle and block certain requests patterns in our edge caching, either in the HAProxy TLS terminator or in Varnish frontend. Get startedhttps://wikitech.wikimedia.org/wiki/Requestctl#Get_started Tutorialshttps://wikitech.wikimedia.org/wiki/Requestctl#Tutorials Essential conceptshttps://wikitech.wikimedia.org/wiki/Requestctl#Essential_concepts User guidehttps://wikitech.wikimedia.org/wiki/Requestctl#User_guide Identify problematic traffic patternshttps://wikitech.wikimedia.org/wiki/Requestctl#Identify_problematic_traffic_patterns Look for existing request patternhttps://wikitech.wikimedia.org/wiki/Requestctl#Look_for_existing_request_pattern Add a new patternhttps://wikitech.wikimedia.org/wiki/Requestctl#Add_a_new_pattern Sync the pattern object to etcdhttps://wikitech.wikimedia.org/wiki/Requestctl#Sync_the_pattern_object_to_etcd Add a new ipblockhttps://wikitech.wikimedia.org/wiki/Requestctl#Add_a_new_ipblock Sync the ipblock object to etcdhttps://wikitech.wikimedia.org/wiki/Requestctl#Sync_the_ipblock_object_to_etcd Define an actionhttps://wikitech.wikimedia.org/wiki/Requestctl#Define_an_action Sync action objects to etcdhttps://wikitech.wikimedia.org/wiki/Requestctl#Sync_action_objects_to_etcd Enable / disable and commit actionhttps://wikitech.wikimedia.org/wiki/Requestctl#Enable_/_disable_and_commit_action Define haproxy ̠actionshttps://wikitech.wikimedia.org/wiki/Requestctl#Define_haproxy_̠actions List existing haproxy ̠actionshttps://wikitech.wikimedia.org/wiki/Requestctl#List_existing_haproxy_̠actions Sync haproxy ̠action objects to etcdhttps://wikitech.wikimedia.org/wiki/Requestctl#Sync_haproxy_̠action_objects_to_etcd Enable / disable and commit haproxy ̠actionhttps://wikitech.wikimedia.org/wiki/Requestctl#Enable_/_disable_and_commit_haproxy_̠action Remove an objecthttps://wikitech.wikimedia.org/wiki/Requestctl#Remove_an_object Modify and sync any objecthttps://wikitech.wikimedia.org/wiki/Requestctl#Modify_and_sync_any_object Command line referencehttps://wikitech.wikimedia.org/wiki/Requestctl#Command_line_reference applyhttps://wikitech.wikimedia.org/wiki/Requestctl#apply commithttps://wikitech.wikimedia.org/wiki/Requestctl#commit dumphttps://wikitech.wikimedia.org/wiki/Requestctl#dump enable / disablehttps://wikitech.wikimedia.org/wiki/Requestctl#enable_/_disable findhttps://wikitech.wikimedia.org/wiki/Requestctl#find find-iphttps://wikitech.wikimedia.org/wiki/Requestctl#find-ip gethttps://wikitech.wikimedia.org/wiki/Requestctl#get get actionhttps://wikitech.wikimedia.org/wiki/Requestctl#get_action get haproxy_actionhttps://wikitech.wikimedia.org/wiki/Requestctl#get_haproxy_action get ipblockhttps://wikitech.wikimedia.org/wiki/Requestctl#get_ipblock get patternhttps://wikitech.wikimedia.org/wiki/Requestctl#get_pattern haproxycfghttps://wikitech.wikimedia.org/wiki/Requestctl#haproxycfg loghttps://wikitech.wikimedia.org/wiki/Requestctl#log validatehttps://wikitech.wikimedia.org/wiki/Requestctl#validate vclhttps://wikitech.wikimedia.org/wiki/Requestctl#vcl Code referencehttps://wikitech.wikimedia.org/wiki/Requestctl#Code_reference Auditlog repositoryhttps://wikitech.wikimedia.org/wiki/Requestctl#Auditlog_repository Schemahttps://wikitech.wikimedia.org/wiki/Requestctl#Schema Related playbookshttps://wikitech.wikimedia.org/wiki/Requestctl#Related_playbooks https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc Origin task: [of the decision: 2022-03-29 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Problem Some clarificationshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Some_clarifications Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Constraints_and_risks Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T302863_toolforge_byoc#Option_4 https://wikitech.wikimedia.org/wiki/Logs/Runbook == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Introduction Ad-Hoc Analysishttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Ad-Hoc_Analysis Webrequests Sampledhttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Webrequests_Sampled Superset dashboardshttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Superset_dashboards Log fileshttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Log_files Aggregated datahttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Aggregated_data Grep-able oputputhttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Grep-able_oputput Select all public_cloud nets with 429https://wikitech.wikimedia.org/wiki/Logs/Runbook#Select_all_public_cloud_nets_with_429 Select all requests with a specific user_agent and .refererhttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Select_all_requests_with_a_specific_user_agent_and_.referer List of the top 10 IPs by response sizehttps://wikitech.wikimedia.org/wiki/Logs/Runbook#List_of_the_top_10_IPs_by_response_size Select logs matching specific HTTP status, datestamp prefix, host, and uri_path, outputting the top query parameters foundhttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Select_logs_matching_specific_HTTP_status,_datestamp_prefix,_host,_and_uri_path,_outputting_the_top_query_parameters_found 5xx errorshttps://wikitech.wikimedia.org/wiki/Logs/Runbook#5xx_errors Grepablehttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Grepable Mediawikihttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Mediawiki all ips which have made more the 100 large requestshttps://wikitech.wikimedia.org/wiki/Logs/Runbook#all_ips_which_have_made_more_the_100_large_requests Retrospective Analysishttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Retrospective_Analysis Turnilohttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Turnilo Data Lakehttps://wikitech.wikimedia.org/wiki/Logs/Runbook#Data_Lake https://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Backups/User_guides == Adding a new backup to Bacula == Adding a new backup to Baculahttps://wikitech.wikimedia.org/wiki/SRE/Data_Persistence/Backups/User_guides#Adding_a_new_backup_to_Bacula https://wikitech.wikimedia.org/wiki/Incidents/2022-02-06_wdqs_updater ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-06_wdqs_updater#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-06_wdqs_updater#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-02-06_wdqs_updater#Scorecard https://wikitech.wikimedia.org/wiki/Swift/Ring_Management Category:Swift Swift Ring Managementhttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Swift_Ring_Management Storage Schemeshttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Storage_Schemes Adding a hosthttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Adding_a_host Removing a hosthttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Removing_a_host Removing a devicehttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Removing_a_device Adjusting a device weighthttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Adjusting_a_device_weight Rebalancing the rings without making other changeshttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Rebalancing_the_rings_without_making_other_changes Invoking swift_ring_manager.pyhttps://wikitech.wikimedia.org/wiki/Swift/Ring_Management#Invoking_swift_ring_manager.py https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups Origin task: [of the decision: 2022-03-30 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Rationale Meeting noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Meeting_notes Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Constraints_and_risks Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304058_doing_VM_backups#Option_3 https://wikitech.wikimedia.org/wiki/Incidents/2022-03-31_api_errors ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-31_api_errors#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-31_api_errors#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-31_api_errors#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50 == 2022-03-31 == 2022-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-31 2022-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-30 2022-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-29 2022-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-28 2022-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-27 2022-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-26 2022-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-25 2022-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-24 2022-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-23 2022-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-22 2022-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-21 2022-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-20 2022-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-19 2022-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-18 2022-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-17 2022-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-16 2022-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-15 2022-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-14 2022-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-11 2022-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-10 2022-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-09 2022-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-08 2022-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-07 2022-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-04 2022-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-03 2022-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-02 2022-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_50#2022-03-01 https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Timeline 2022-03-27https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#2022-03-27 2022-03-28https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#2022-03-28 Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-27_api#Scorecard https://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions Normally, the wikimediastatus.net page displays "All Systems Operational". Metricshttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions#Metrics Total request volumehttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions#Total_request_volume User-reported connectivity errorshttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions#User-reported_connectivity_errors Wiki error responseshttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions#Wiki_error_responses Wiki response timehttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions#Wiki_response_time Successful editshttps://wikitech.wikimedia.org/wiki/Wikimediastatus.net/User_instructions#Successful_edits https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/04 ==Week of April 04== Week of April 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/04#Week_of_April_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/04#=== Week of April 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/04#Week_of_April_11 Week of April 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/04#Week_of_April_18 https://wikitech.wikimedia.org/wiki/Incidents/2022-03-29_network ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-29_network#Summary https://wikitech.wikimedia.org/wiki/S3 s3 or S3 might refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Fundraising/Roadmap We want to make our software easier to maintain and develop, and more accessible both to new developers on our team and to other organizations. https://wikitech.wikimedia.org/wiki/Kubernetes/Metrics == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Introduction Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Overview Control-plane metricshttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Control-plane_metrics apiserverhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#apiserver kube-controller-managerhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#kube-controller-manager kube-schedulerhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#kube-scheduler kubelet-kube-proxyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#kubelet-kube-proxy etcdhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#etcd Cluster components metricshttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Cluster_components_metrics Workload/Pod metricshttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Workload/Pod_metrics Scraping all containerPorts with a name ending in -metricshttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Scraping_all_containerPorts_with_a_name_ending_in_-metrics Scraping all containerPortshttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Scraping_all_containerPorts Scraping a specific port/path combinationhttps://wikitech.wikimedia.org/wiki/Kubernetes/Metrics#Scraping_a_specific_port/path_combination https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos This page provides a tutorial for how to design a python based job repository in GitLab that publishes job artifacts that can be scheduled and launched by Airflow . There is also an example Gitlab repository that follows all these recommendations: https://gitlab. Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Overview GitLab Job Repository Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#GitLab_Job_Repository_Setup Python package setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Python_package_setup GitLab CI setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#GitLab_CI_setup Automated Release GitLab Project Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Automated_Release_GitLab_Project_Setup How to Deployhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#How_to_Deploy Job Repository Conda Env Artifact Publishinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Job_Repository_Conda_Env_Artifact_Publishing Developmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Development Releasinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Releasing Deploying your conda env artifact for use by Airflowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Deploying_your_conda_env_artifact_for_use_by_Airflow Spark and Condahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Spark_and_Conda Gitlab CI UI test integrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Repos#Gitlab_CI_UI_test_integration https://wikitech.wikimedia.org/wiki/Incidents/2022-03-04_esams_availability_banner_sampling ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-04_esams_availability_banner_sampling#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-04_esams_availability_banner_sampling#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-03-04_esams_availability_banner_sampling#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51 == 2022-04-15 == 2022-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-15 2022-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-14 2022-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-13 2022-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-12 2022-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-11 2022-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-10 2022-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-09 2022-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-08 2022-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-07 2022-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-06 2022-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-05 2022-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-04 2022-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-02 2022-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_51#2022-04-01 https://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Monitoring == Wikidough Basic Check == Wikidough Basic Checkhttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Monitoring#Wikidough_Basic_Check What does it mean?https://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Monitoring#What_does_it_mean? Resolving this messagehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Monitoring#Resolving_this_message Service Restart Checkhttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Monitoring#Service_Restart_Check https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances WMF's Airflow system is composed of several Airflow instances. Each instance is supposed to schedule and orchestrate jobs belonging to a particular grouping. Multi-instance vs. single instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#Multi-instance_vs._single_instance Accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#Access List of instanceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#List_of_instances test-k8shttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#test-k8s analyticshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#analytics analytics_testhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#analytics_test searchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#search researchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#research platform_enghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#platform_eng analytics_producthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#analytics_product wmdehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#wmde Custom test instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Instances#Custom_test_instance https://wikitech.wikimedia.org/wiki/Incidents/2022-04-26_cr2-eqord_down ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-04-26_cr2-eqord_down#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-04-26_cr2-eqord_down#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-04-26_cr2-eqord_down#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-04-06_esams_network ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-04-06_esams_network#Summary Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-04-06_esams_network#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52 == 2022-04-29 == 2022-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-29 2022-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-28 2022-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-27 2022-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-26 2022-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-25 2022-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-24 2022-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-23 2022-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-22 2022-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-21 2022-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-20 2022-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-19 2022-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-18 2022-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-17 2022-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_52#2022-04-16 https://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service All steps below assume you want to deploy a new service named service-foo to the clusters of the main (wikikube) group. Prepare the clusters for the new servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Prepare_the_clusters_for_the_new_service Tell the deployment server how to set up the kubeconfig files.https://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Tell_the_deployment_server_how_to_set_up_the_kubeconfig_files. Add a Kubernetes namespacehttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Add_a_Kubernetes_namespace Deploy changes to helmfile.d/admin_nghttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Deploy_changes_to_helmfile.d/admin_ng Create certificates (for the services proxy)https://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Create_certificates_(for_the_services_proxy) Add private data/secrets (optional)https://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Add_private_data/secrets_(optional) Setting up Ingresshttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Setting_up_Ingress Set resource requests and limits for your service/containershttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Set_resource_requests_and_limits_for_your_service/containers Deploy the servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Deploy_the_service Testing a servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Testing_a_service Deploy a service to productionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Deploy_a_service_to_production Monitor the Servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Monitor_the_Service Setting up LVShttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Setting_up_LVS Add in Service Meshhttps://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Add_in_Service_Mesh https://wikitech.wikimedia.org/wiki/Check_bacula.py Check bacula is a wrapper for bconsole that is able to produce output to be used by icinga and prometheus, as well as used interactively to debug backup job errors/misses, useful for monitoring of backups generated by Bacula in the WMF production. Usagehttps://wikitech.wikimedia.org/wiki/Check_bacula.py#Usage Examples of interactive usagehttps://wikitech.wikimedia.org/wiki/Check_bacula.py#Examples_of_interactive_usage See alsohttps://wikitech.wikimedia.org/wiki/Check_bacula.py#See_also https://wikitech.wikimedia.org/wiki/Incidents/2022-05-01_etcd ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-01_etcd#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-01_etcd#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-01_etcd#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service Origin task: [of the decision: 2022-05-04 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Decision_taken Direct responsible individualhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Direct_responsible_individual Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Options_considered Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T304060_How_to_manage_quotas_in_Toolforge_Build_service#Option_4 https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Overview Unit Testshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Unit_Tests Resourceshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Resources Logginghttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Logging IPN listenershttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#IPN_listeners PSP Specific Instructionshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#PSP_Specific_Instructions Adyenhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Adyen Test Card Detailshttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Test_Card_Details Instant Payment Notifications(IPN) Messages - using wmcloudhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Instant_Payment_Notifications(IPN)_Messages_-_using_wmcloud iDEAL Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#iDEAL_Recurring Pending Resolverhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Pending_Resolver Instant Payment Notifications(IPN) Messages - using ngrokhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Instant_Payment_Notifications(IPN)_Messages_-_using_ngrok Amazonhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Amazon Astropayhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Astropay GlobalCollect (Legacy Ingenico)https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#GlobalCollect_(Legacy_Ingenico) Ingenico Connecthttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Ingenico_Connect PayPal Express Checkouthttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#PayPal_Express_Checkout Braintreehttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Braintree Dlocalhttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#Dlocal IPN testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Testing#IPN_testing https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Docker https://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-05_Wikimedia_full_site_outage#Scorecard https://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep == Adding Nodes to Deployment-Prep == Adding Nodes to Deployment-Prephttps://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#Adding_Nodes_to_Deployment-Prep Hack acknowledgementhttps://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#Hack_acknowledgement Commit to Puppet Repohttps://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#Commit_to_Puppet_Repo Horizonhttps://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#Horizon Newly-deployed host (puppet client)https://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#Newly-deployed_host_(puppet_client) Puppet Master (puppet server)https://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#Puppet_Master_(puppet_server) When you can't loginhttps://wikitech.wikimedia.org/wiki/Search/adding-nodes-to-deployment-prep#When_you_can't_login https://wikitech.wikimedia.org/wiki/SLO/HAProxy Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Clients Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/HAProxy#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/HAProxy#Service_Level_Objectives https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05 ==Week of May 02== Week of May 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05#Week_of_May_02 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05#=== Week of May 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05#Week_of_May_09 Week of May 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05#Week_of_May_16 Week of May 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05#Week_of_May_23 Week of May 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/05#Week_of_May_30 https://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration == Adding a new Wikidough host == Adding a new Wikidough hosthttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#Adding_a_new_Wikidough_host 1. Puppet Rolehttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#1._Puppet_Role 2. acme-chiefhttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#2._acme-chief 3. Ganeti VMhttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#3._Ganeti_VM Possible Issueshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#Possible_Issues 4. Homer and Anycasthttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#4._Homer_and_Anycast Post-Setup Noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#Post-Setup_Notes Restarting serviceshttps://wikitech.wikimedia.org/wiki/Wikimedia_DNS/Administration#Restarting_services https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Overview Payment Methodshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Payment_Methods Paypalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Paypal Venmohttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Venmo Recurringhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Recurring IPN messageshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#IPN_messages Auditshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Audits Pending Tablehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Pending_Table Jobs Queuehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Jobs_Queue Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Braintree#Testing https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide For documentation about Apache Airflow, please refer to https://airflow.apache. Airflow basicshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Airflow_basics Glossaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Glossary DAG interpretation time vs execution timehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_interpretation_time_vs_execution_time DAG interpretation stagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_interpretation_stage Task execution stagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Task_execution_stage Data dependencieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Data_dependencies DAG runshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_runs DAG Run dateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_Run_dates Concurrent DAG Runshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Concurrent_DAG_Runs Writing a DAG using our Airflow setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Writing_a_DAG_using_our_Airflow_setup Importing codehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Importing_code Airflow native librarieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Airflow_native_libraries WMF Airflow commonhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#WMF_Airflow_common Instance level importshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Instance_level_imports Configuration and defaultshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Configuration_and_defaults WMF common DAG default argshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#WMF_common_DAG_default_args Instance level configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Instance_level_configuration DAG level configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_level_configuration Variable propertieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Variable_properties Which properties should be overridable?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Which_properties_should_be_overridable? How to make them overridable?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#How_to_make_them_overridable? How to override them at run-time?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#How_to_override_them_at_run-time? Create an Airflow Variable using UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Create_an_Airflow_Variable_using_UI Create an Airflow Variable using environment variableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Create_an_Airflow_Variable_using_environment_variables Handy methodshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Handy_methods Artifactshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Artifacts Define your artifact in artifacts.yamlhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Define_your_artifact_in_artifacts.yaml Reference your artifact from your DAGhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Reference_your_artifact_from_your_DAG Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Deployment How it workshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#How_it_works Filtershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Filters Don’t forgethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Don’t_forget Conventions & good practiceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Conventions_&_good_practices Task idshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Task_ids DAG idshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_ids DAG file nameshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_file_names Tagshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Tags Schedule intervalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Schedule_interval SLAshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#SLAs Timeoutshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Timeouts Artifact versioninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Artifact_versioning DAG docshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#DAG_docs Alert emailhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Alert_email Start datehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Start_date Sensor poke_intervalhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Sensor_poke_interval Sensor timeouthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Sensor_timeout Config and contexthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Config_and_context TaskGroup factories vs. DAG factorieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#TaskGroup_factories_vs._DAG_factories Linting & auto-formattinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Linting_&_auto-formatting wmf_airflow_common Sensors and Operatorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#wmf_airflow_common_Sensors_and_Operators Sensorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Sensors RangeHivePartitionSensorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#RangeHivePartitionSensor daily_partitionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#daily_partitions URLSensorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#URLSensor Wiki partitionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Wiki_partitions Operatorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Operators Spark Operatorshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Spark_Operators SparkSQLOperatorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#SparkSQLOperator SparkSubmitOperatorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#SparkSubmitOperator URLTouch Operatorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#URLTouch_Operator Testinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Testing Unit testshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Unit_tests Setting up the environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Setting_up_the_environment Definition testhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Definition_test Testing the DAG itselfhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Testing_the_DAG_itself Testing the librarieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Testing_the_libraries On-Disk Fixtureshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#On-Disk_Fixtures Developing on macOShttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Developing_on_macOS CIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#CI Development instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Development_instance Limitshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Limits Setuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Setup Input/output override procedurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Input/output_override_procedure Analytics test Clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Analytics_test_Cluster How to deployhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#How_to_deploy Use caseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Use_cases Airflow Debian package upgrade processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Airflow_Debian_package_upgrade_process Update the conda environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Update_the_conda_environment Build the Debian packagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Build_the_Debian_package Deploy on the test clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Deploy_on_the_test_cluster Deploy in productionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Deploy_in_production Test deb package in a stat boxhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide#Test_deb_package_in_a_stat_box https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Upgrading The upstream DataHub repository is: https://github.com/linkedin/datahub/ Deploy datahub CLI toolhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Upgrading#Deploy_datahub_CLI_tool https://wikitech.wikimedia.org/wiki/Incidents/2022-05-21_varnish_cache_busting ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-21_varnish_cache_busting#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-21_varnish_cache_busting#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-21_varnish_cache_busting#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-24_Failed_Apache_restart#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-05-02_deployment ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-02_deployment#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-02_deployment#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-02_deployment#Scorecard https://wikitech.wikimedia.org/wiki/Bast6001 bast6001 was the main bastion for drmrs. It was replaced by bast6002. Serviceshttps://wikitech.wikimedia.org/wiki/Bast6001#Services https://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-25_de.wikipedia.org#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_exim-bdat-errors#Scorecard https://wikitech.wikimedia.org/wiki/Maps/Kartotherian_packages === Kartotherian service === Kartotherian servicehttps://wikitech.wikimedia.org/wiki/Maps/Kartotherian_packages#Kartotherian_service https://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra This page details the configuration of the network devices managed by SRE Infrastructure Foundations (netops) to support cloud services in the Eqiad (Equinix, Ashburn) datacenter. Further information on the overall WMCS networking setup, including elements managed by the WMCS team themselves, are on the Portal:Cloud VPS/Admin/Network page. Physical Networkhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Physical_Network Logical Networkhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Logical_Network Production Realmhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Production_Realm CR Uplinkshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#CR_Uplinks Routed Networkshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Routed_Networks Cloud Host Networkshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Cloud_Host_Networks Vlan1118 - cloud-hosts1-eqiadhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Vlan1118_-_cloud-hosts1-eqiad Link Networkshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Link_Networks L2 Vlanshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#L2_Vlans Cloudsw BGP Routinghttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Cloudsw_BGP_Routing Static Routeshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Static_Routes Cloud Realm / VRFhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Cloud_Realm_/_VRF Routing Instancehttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Routing_Instance Transit Vlanhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Transit_Vlan Storage Networkshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Storage_Networks CloudGW to CloudNET (Neutron) Transporthttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#CloudGW_to_CloudNET_(Neutron)_Transport Cloud Instances Vlanhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Cloud_Instances_Vlan Manual Interventionhttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Manual_Intervention Noteshttps://wikitech.wikimedia.org/wiki/Network_design_-_Eqiad_WMCS_Network_Infra#Notes https://wikitech.wikimedia.org/wiki/Incidents/2022-05-31_Analytics_Hadoop_failure ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-31_Analytics_Hadoop_failure#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-31_Analytics_Hadoop_failure#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-31_Analytics_Hadoop_failure#Scorecard https://wikitech.wikimedia.org/wiki/HAProxy/session_states This is section 8.5 from the configuration documentation at haproxy. https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53 == 2022-05-31 == 2022-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-31 2022-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-30 2022-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-29 2022-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-28 2022-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-27 2022-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-26 2022-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-25 2022-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-24 2022-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-23 2022-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-22 2022-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-21 2022-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-20 2022-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-19 2022-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-18 2022-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-17 2022-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-16 2022-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-15 2022-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-14 2022-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-13 2022-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-12 2022-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-11 2022-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-10 2022-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-09 2022-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-08 2022-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-07 2022-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-06 2022-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-05 2022-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-04 2022-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-03 2022-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-02 2022-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_53#2022-05-01 https://wikitech.wikimedia.org/wiki/Incidents/2022-05-26_Database_hardware_failure ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-26_Database_hardware_failure#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-26_Database_hardware_failure#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-26_Database_hardware_failure#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-09_confctl#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-06-01_Lost_index_in_cloudelastic ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-01_Lost_index_in_cloudelastic#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-01_Lost_index_in_cloudelastic#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-01_Lost_index_in_cloudelastic#Scorecard https://wikitech.wikimedia.org/wiki/Wikifunctions This page is the primary entry-point for documentation related to Wikifunctions technical infrastructure at Wikimedia. Sub-pageshttps://wikitech.wikimedia.org/wiki/Wikifunctions#Sub-pages Create a subpagehttps://wikitech.wikimedia.org/wiki/Wikifunctions#Create_a_subpage Guideshttps://wikitech.wikimedia.org/wiki/Wikifunctions#Guides See alsohttps://wikitech.wikimedia.org/wiki/Wikifunctions#See_also https://wikitech.wikimedia.org/wiki/Wikifunctions/Beta_Cluster The Beta Cluster houses a functional test instance of Wikifunctions and associated services, with all software components running at HEAD. function-orchestrator and function-evaluatorhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Beta_Cluster#function-orchestrator_and_function-evaluator Debugginghttps://wikitech.wikimedia.org/wiki/Wikifunctions/Beta_Cluster#Debugging Running MediaWiki maintenance scriptshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Beta_Cluster#Running_MediaWiki_maintenance_scripts Debug logshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Beta_Cluster#Debug_logs https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance This page describes how to measure performance of backend code. Production impacthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Production_impact Flame graphshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Flame_graphs WANObjectCachehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#WANObjectCache Server monitoringhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Server_monitoring Database querieshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Database_queries Debughttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Debug Local developmenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Local_development Benchmarkinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Benchmarking Benchmarking and load testing in productionhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Benchmarking_and_load_testing_in_production Beta Clusterhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Beta_Cluster See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#See_also Creditshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Measure_backend_performance#Credits https://wikitech.wikimedia.org/wiki/Phabricator/Deployment == Deployment windows == Deployment windowshttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#Deployment_windows GitLab deployment repositoryhttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#GitLab_deployment_repository Downtime host alertshttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#Downtime_host_alerts Deploy to fallback hosthttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#Deploy_to_fallback_host Deploy to production hosthttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#Deploy_to_production_host Clean up deployed Phabricator tasks in Phabricatorhttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#Clean_up_deployed_Phabricator_tasks_in_Phabricator See alsohttps://wikitech.wikimedia.org/wiki/Phabricator/Deployment#See_also https://wikitech.wikimedia.org/wiki/Quarry Soft redirected pageshttps://wikitech.wikimedia.org/wiki/Category:Soft_redirected_pages https://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable == Backup and Restore API Calls == Backup and Restore API Callshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Backup_and_Restore_API_Calls Register S3 repositoryhttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Register_S3_repository Create snapshot (aka backup)https://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Create_snapshot_(aka_backup) A Note on Cross-cluster Restoreshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#A_Note_on_Cross-cluster_Restores Restore Snapshothttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Restore_Snapshot Check Status of Ongoing Restorehttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Check_Status_of_Ongoing_Restore Post Restorehttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Post_Restore Repository Errorshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Repository_Errors Why Enable the S3 Plugin?https://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Why_Enable_the_S3_Plugin? Complicating factorshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Complicating_factors Getting the elastic keystore path righthttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Getting_the_elastic_keystore_path_right The keystore file has no validationhttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#The_keystore_file_has_no_validation The keystore file must be identical across all cluster nodeshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#The_keystore_file_must_be_identical_across_all_cluster_nodes Path-style and bucket-style accesshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Path-style_and_bucket-style_access Overloading LVS when creating a snapshothttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Overloading_LVS_when_creating_a_snapshot Premature end of Content-Length delimited message bodyhttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#Premature_end_of_Content-Length_delimited_message_body index.routing.allocation.total_shards_per_nodehttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable#index.routing.allocation.total_shards_per_node https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions Technical interactions with Query Services such as Wikidata Query Service (WDWS) and Wikimedia Commons Query Service (WCQS). Contexthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions#Context Constraints on external endpointshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions#Constraints_on_external_endpoints Constraints on using WDQS/WCQS as part of the Wikimedia Foundation use caseshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions#Constraints_on_using_WDQS/WCQS_as_part_of_the_Wikimedia_Foundation_use_cases Query constraints on internal WDQS endpointhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions#Query_constraints_on_internal_WDQS_endpoint Asynchronous operations onlyhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions#Asynchronous_operations_only Limit impact on other componentshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions#Limit_impact_on_other_components https://wikitech.wikimedia.org/wiki/TLS/Runbook This page contains service runbooks to handle (among other things) certificate expiration alerts. CertAlmostExpiredhttps://wikitech.wikimedia.org/wiki/TLS/Runbook#CertAlmostExpired fooservice:443https://wikitech.wikimedia.org/wiki/TLS/Runbook#fooservice:443 swift-https:443https://wikitech.wikimedia.org/wiki/TLS/Runbook#swift-https:443 gitlab:22https://wikitech.wikimedia.org/wiki/TLS/Runbook#gitlab:22 https://wikitech.wikimedia.org/wiki/Email_System_Revamp == Glossary == Glossaryhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Glossary Current Email Services Overviewhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Current_Email_Services_Overview Inbound Email Serviceshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Inbound_Email_Services Inbound Email Routinghttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Inbound_Email_Routing Outbound Email Serviceshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Outbound_Email_Services Outbound Email Routinghttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Outbound_Email_Routing Problems with Current Designhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Problems_with_Current_Design Benefits to Improving our Current Designhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Benefits_to_Improving_our_Current_Design Risks of Keeping the Status Quohttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Risks_of_Keeping_the_Status_Quo Design Considerationshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Design_Considerations Subdomains or new domains for email serviceshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Subdomains_or_new_domains_for_email_services Options:https://wikitech.wikimedia.org/wiki/Email_System_Revamp#Options: Multiple User Groups of @wikimedia.orghttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Multiple_User_Groups_of_@wikimedia.org Proposed Design Overviewhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Proposed_Design_Overview Replace Exim with Postfixhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Replace_Exim_with_Postfix Split Inbound and Outbound MTAshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Split_Inbound_and_Outbound_MTAs Proposed Designhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Proposed_Design Task Outlinehttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Task_Outline Improve Test Coverage & Methodologies for Mail Config Changeshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Improve_Test_Coverage_&_Methodologies_for_Mail_Config_Changes Provision a Development Setup on OpenStackhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Provision_a_Development_Setup_on_OpenStack Create Puppet Moduleshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Create_Puppet_Modules Setup Postfix Monitoringhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Setup_Postfix_Monitoring Setup Outbound Postfix Email Servershttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Setup_Outbound_Postfix_Email_Servers Convert Null Clients to Postfixhttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Convert_Null_Clients_to_Postfix Setup Inbound Postfix Email Servershttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Setup_Inbound_Postfix_Email_Servers Remove Exim MTAshttps://wikitech.wikimedia.org/wiki/Email_System_Revamp#Remove_Exim_MTAs https://wikitech.wikimedia.org/wiki/Config-master.wikimedia.org config-master.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Config-master.wikimedia.org#Service See alsohttps://wikitech.wikimedia.org/wiki/Config-master.wikimedia.org#See_also External linkhttps://wikitech.wikimedia.org/wiki/Config-master.wikimedia.org#External_link https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes#Overview Run and Access Your Service Applications on a Web Browserhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes#Run_and_Access_Your_Service_Applications_on_a_Web_Browser Step 1 - Working with Kubernetes Podshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes#Step_1_-_Working_with_Kubernetes_Pods Create a Deploymenthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes#Create_a_Deployment Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Build_a_service_application_on_Kubernetes#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes#Overview Step 1 - Running the pywpchksumbot.py Application Locallyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes#Step_1_-_Running_the_pywpchksumbot.py_Application_Locally Hands-on Demo: Setting up a Simple Batch Application Using Docker and Kubernetes (minikube)https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes#Hands-on_Demo:_Setting_up_a_Simple_Batch_Application_Using_Docker_and_Kubernetes_(minikube) Building a Docker Imagehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes#Building_a_Docker_Image Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Set_up_a_batch_application_on_Kubernetes#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Overview Step 1 - Creating Jobs with YAMLhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Step_1_-_Creating_Jobs_with_YAML Step 2 - Cronjobshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Step_2_-_Cronjobs Step 3 - Deploying a Simple Web Serverhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Step_3_-_Deploying_a_Simple_Web_Server Hands-on Demo: Deploying a Production Web Serverhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Hands-on_Demo:_Deploying_a_Production_Web_Server Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Setting_up_Infrastructure_as_Code_(IaC)_in_Kubernetes#Previous_Module_== https://wikitech.wikimedia.org/wiki/Incidents/2022-06-10_overload_varnish_haproxy ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-10_overload_varnish_haproxy#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-10_overload_varnish_haproxy#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-10_overload_varnish_haproxy#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Payments_staging_server == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Payments_staging_server#Overview Deploying to staginghttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Payments_staging_server#Deploying_to_staging https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Autoscaling_in_Kubernetes == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Autoscaling_in_Kubernetes#Overview Hands-on Demo: Horizontal Pod Autoscaling (HPA)https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Autoscaling_in_Kubernetes#Hands-on_Demo:_Horizontal_Pod_Autoscaling_(HPA) minikube Dashboard and Lenshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Autoscaling_in_Kubernetes#minikube_Dashboard_and_Lens Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Autoscaling_in_Kubernetes#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Autoscaling_in_Kubernetes#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Overview Step 1 - Refactoring Variables From the Book Apphttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Step_1_-_Refactoring_Variables_From_the_Book_App Step 2 - Refactoring the Deployment Scripthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Step_2_-_Refactoring_the_Deployment_Script Step 3 - Running the Refactored Codehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Step_3_-_Running_the_Refactored_Code Step 4 - Debugginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Step_4_-_Debugging Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Refactoring_code_using_Kubernetes_features#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Overview Step 1: Creating a cluster with kubesprayhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Step_1:_Creating_a_cluster_with_kubespray Step 2: Running a simple workloadhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Step_2:_Running_a_simple_workload Step 3: Running a simple service workloadhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Step_3:_Running_a_simple_service_workload Step 4: Using kubectl locallyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Step_4:_Using_kubectl_locally Hands-on Demo: Granting browser access to our servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Hands-on_Demo:_Granting_browser_access_to_our_service Step 5: Google Kubernetes Engine (GKE)https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Step_5:_Google_Kubernetes_Engine_(GKE) Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Building_a_production_ready_cluster#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager#Overview Step 1: Adding tags to various builds of the apache web serverhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager#Step_1:_Adding_tags_to_various_builds_of_the_apache_web_server Step 2: Helm commandshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager#Step_2:_Helm_commands Hands-on Demo: Using the Helm Chart in a Deploymenthttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager#Hands-on_Demo:_Using_the_Helm_Chart_in_a_Deployment Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_Package_Manager#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Overview Step 1: Updating container imageshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Step_1:_Updating_container_images Step 2: Running the container with limited privilegeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Step_2:_Running_the_container_with_limited_privileges Hands-on Demo: Namespaceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Hands-on_Demo:_Namespaces Step 3: Kubernetes security and management best practiceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Step_3:_Kubernetes_security_and_management_best_practices Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Manageability_and_Security#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF) == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF)#Overview Step 1 - The Blubber Tutorialhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF)#Step_1_-_The_Blubber_Tutorial Step 2 - Running Images on minikubehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF)#Step_2_-_Running_Images_on_minikube Hands-on Demo: The Deployment Pipeline Tutorialhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF)#Hands-on_Demo:_The_Deployment_Pipeline_Tutorial Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF)#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Kubernetes_at_the_Wikimedia_Foundation_(WMF)#Previous_Module_== https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Overview Guidelineshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Guidelines Step 1 - Using Blubber to Generate Dockerfileshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Step_1_-_Using_Blubber_to_Generate_Dockerfiles Step 2 - Deploying your Application to WMF’s Kubernetes Deployment Pipelinehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Step_2_-_Deploying_your_Application_to_WMF’s_Kubernetes_Deployment_Pipeline Step 3 - Testing the client’s requestshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Step_3_-_Testing_the_client’s_requests Hands-on Demo: Deploying your application to WMF’s production pipeline, running tests and getting a security reviewhttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Hands-on_Demo:_Deploying_your_application_to_WMF’s_production_pipeline,_running_tests_and_getting_a_security_review Helm for Production Releaseshttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Helm_for_Production_Releases Next Modulehttps://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Next_Module Previous Module ==https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_Workshop/Using_WMF_Kubernetes_to_run_your_services#Previous_Module_== https://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Raspberry_Pi_Image The device lab images are based on the upstream Debian GNU/Linux image. I’ve forked the build scripts to include the additional dependencies we require. Building the imagehttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Raspberry_Pi_Image#Building_the_image Writing the imagehttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Raspberry_Pi_Image#Writing_the_image Running the imagehttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Raspberry_Pi_Image#Running_the_image https://wikitech.wikimedia.org/wiki/Incidents/2022-06-21_asw-a2-codfw_accidental_power_cycle ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-21_asw-a2-codfw_accidental_power_cycle#Summary Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-21_asw-a2-codfw_accidental_power_cycle#Scorecard https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/06 ==Week of June 06== Week of June 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/06#Week_of_June_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/06#=== Week of June 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/06#Week_of_June_13 Week of June 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/06#Week_of_June_20 Week of June 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/06#Week_of_June_27 https://wikitech.wikimedia.org/wiki/Image-suggestion image-suggestion is a service that provides read-only access to the [Engineering Team/Data Value Stream/Data Gateway|Data Gateway Service]. It is a relatively simple HTTP service running in Kubernetes. Configurationhttps://wikitech.wikimedia.org/wiki/Image-suggestion#Configuration Deploymenthttps://wikitech.wikimedia.org/wiki/Image-suggestion#Deployment API docshttps://wikitech.wikimedia.org/wiki/Image-suggestion#API_docs Runbookhttps://wikitech.wikimedia.org/wiki/Image-suggestion#Runbook See alsohttps://wikitech.wikimedia.org/wiki/Image-suggestion#See_also https://wikitech.wikimedia.org/wiki/Event_Platform/Intake PLACEHOLDER: document event platform intake requirements https://wikitech.wikimedia.org/wiki/Incidents/2022-06-16_MariaDB_password_leak ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-16_MariaDB_password_leak#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-16_MariaDB_password_leak#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-16_MariaDB_password_leak#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-05-20_Database_slow ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-20_Database_slow#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-20_Database_slow#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-05-20_Database_slow#Scorecard https://wikitech.wikimedia.org/wiki/Editing_Port_Trunked_Vlans_in_Netbox Netbox is used to define what Vlans are 'trunked' on datacenter switch ports on which multiple Vlans are used. Edit Port in Netboxhttps://wikitech.wikimedia.org/wiki/Editing_Port_Trunked_Vlans_in_Netbox#Edit_Port_in_Netbox Run Homer Against Switchhttps://wikitech.wikimedia.org/wiki/Editing_Port_Trunked_Vlans_in_Netbox#Run_Homer_Against_Switch https://wikitech.wikimedia.org/wiki/Performance/AS_Report The AS Report (Autonomous Systems Performance Report) provides insights into the effective performance of Internet providers around the world. It representes a step toward formalizing collaborations with browsers vendors and ISPs. Methodologyhttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#Methodology CPU microbenchmarkhttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#CPU_microbenchmark Mobile vs desktophttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#Mobile_vs_desktop RUM metricshttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#RUM_metrics Privacyhttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#Privacy Servicehttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#Service How it workshttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#How_it_works Outputhttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#Output See alsohttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#See_also Further readinghttps://wikitech.wikimedia.org/wiki/Performance/AS_Report#Further_reading https://wikitech.wikimedia.org/wiki/Incidents/2022-06-30_asw-a4-codfw_accidental_power_cycle ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-30_asw-a4-codfw_accidental_power_cycle#Summary Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-30_asw-a4-codfw_accidental_power_cycle#Scorecard https://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable/Beta_Env == S3 Plugin Test Environment (beta) == S3 Plugin Test Environment (beta)https://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable/Beta_Env#S3_Plugin_Test_Environment_(beta) Hostshttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable/Beta_Env#Hosts Miniohttps://wikitech.wikimedia.org/wiki/Search/S3_Plugin_Enable/Beta_Env#Minio https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54 == 2022-06-30 == 2022-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-30 2022-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-29 2022-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-28 2022-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-27 2022-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-26 2022-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-25 2022-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-24 2022-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-23 2022-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-22 2022-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-21 2022-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-20 2022-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-19 2022-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-17 2022-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-16 2022-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-15 2022-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-14 2022-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-13 2022-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-12 2022-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-11 2022-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-10 2022-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-09 2022-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-08 2022-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-07 2022-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-06 2022-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-05 2022-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-04 2022-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-03 2022-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-02 2022-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_54#2022-06-01 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes Origin task: [of the decision: 2022-06-29 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Decision_taken Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Option_1 Proposed schedule and zones:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Proposed_schedule_and_zones: Create an alerting best practices and move current alerts to it:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Create_an_alerting_best_practices_and_move_current_alerts_to_it: Create also a common process for pages/alert handling:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Create_also_a_common_process_for_pages/alert_handling: Pros-conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Pros-cons Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Option_2 Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T310598_Team_oncall_alerting_schedules_and_processes#Rationale https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_container_image_configuration This document proposes to establish a single place to configure Toolforge container images. Overviewhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_container_image_configuration#Overview Proposed solutionhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_container_image_configuration#Proposed_solution Formathttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_container_image_configuration#Format Location of the filehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_container_image_configuration#Location_of_the_file Otherhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_container_image_configuration#Other https://wikitech.wikimedia.org/wiki/Incidents/2022-07-03_shellbox_request_spike ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-03_shellbox_request_spike#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-03_shellbox_request_spike#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-03_shellbox_request_spike#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Overview Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Common_issues Cloudvirt downhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Cloudvirt_down Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDown See Portal:Cloud_VPS/Admin/Runbooks/NodeDownForLong https://wikitech.wikimedia.org/wiki/MariaDB/grants This page provides a basic introduction on grants management in our production. Note that we are in the process of automation of the work so this might change a lot. Gathering reporthttps://wikitech.wikimedia.org/wiki/MariaDB/grants#Gathering_report Analyzing grantshttps://wikitech.wikimedia.org/wiki/MariaDB/grants#Analyzing_grants Changing password of a db userhttps://wikitech.wikimedia.org/wiki/MariaDB/grants#Changing_password_of_a_db_user https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown See Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDownForLong#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudvirtsDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudcontrolsDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudnetsDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TooManyCloudgwsDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning The ceph cluster is in warning status, this means that it's not highly available anymore or something might be affecting it's performance, but the cluster is still up and running. Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning#Debugging Mons using a lot of disk spacehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning#Mons_using_a_lot_of_disk_space Slow opshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning#Slow_ops Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning#Related_information Example taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning#Example_tasks https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterAllMonsDown#Old_incidents https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history/Revision_identity_reverts This page summarizes an interaction on Slack about the definition of the notion of revision identity-revert in the mediawiki_history dataset. This notion is at heart of 4 fields of the dataset: revision_is_identity_revert, revision_is_identity_reverted, revision_seconds_to_identity_revert and revision_first_identity_reverting_revision_id. Definitionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history/Revision_identity_reverts#Definition Relation to Mediawiki Revert Typeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_history/Revision_identity_reverts#Relation_to_Mediawiki_Revert_Types https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe KServe is a Python framework and K8s infrastructure aimed to standardize the way that people run and deploy HTTP servers wrapping up ML models. The Machine Learning team uses it in the LiftWing K8s cluster, to implement the new model serving infrastructure that should replace ORES. How Kserve fits into the Kubernetes picture?https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#How_Kserve_fits_into_the_Kubernetes_picture? KServe architecturehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#KServe_architecture Repositorieshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Repositories New servicehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#New_service Create your model serverhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Create_your_model_server Create a Dockerfilehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Create_a_Dockerfile Deploy locally and Testhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Deploy_locally_and_Test Multiprocessing with asynciohttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Multiprocessing_with_asyncio Service already present in the inference-services repositoryhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Service_already_present_in_the_inference-services_repository Example 1 - Testing enwiki-goodfaithhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Example_1_-_Testing_enwiki-goodfaith Example 2 - Testing calling a "fake" EventGate (two containers)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Example_2_-_Testing_calling_a_"fake"_EventGate_(two_containers) Example 3 - Testing outlink-topic-model (two containers)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Example_3_-_Testing_outlink-topic-model_(two_containers) Admin only - Upgrade KServe to a new versionhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe#Admin_only_-_Upgrade_KServe_to_a_new_version https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures#Debugging Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures#Related_information Referenceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures#References https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Logging Logging https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovaFullstackStaleStats#Old_incidents https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/07 ==Week of July 04== Week of July 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/07#Week_of_July_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/07#=== Week of July 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/07#Week_of_July_11 Week of July 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/07#Week_of_July_18 Week of July 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/07#Week_of_July_25 https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/New_integration_manual This is the development process to integrate with a new payment processor. Preliminarieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/New_integration_manual#Preliminaries First milestone: ready for internal testhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/New_integration_manual#First_milestone:_ready_for_internal_test Second milestone: 1-hour donor testhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/New_integration_manual#Second_milestone:_1-hour_donor_test Final milestone: campaign-readyhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/New_integration_manual#Final_milestone:_campaign-ready https://wikitech.wikimedia.org/wiki/SRE/business_case A business case is a document that provides a justification for making a change or undertaking a project. It defines an observed problem or opportunity, evaluates benefit, cost and risk both for proposal as well as alternative solutions and provides a rationale of the undertaking. Create a new business casehttps://wikitech.wikimedia.org/wiki/SRE/business_case#Create_a_new_business_case https://wikitech.wikimedia.org/wiki/SRE/business_case# https://wikitech.wikimedia.org/wiki/SRE/business_case/template == 1. Executive Summary == 1. Executive Summaryhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#1._Executive_Summary 2. Business Problemhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#2._Business_Problem 3. Problem Analysishttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#3._Problem_Analysis 4. Current Technology/Solutionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#4._Current_Technology/Solution 5. Available Optionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5._Available_Options 5.1 Option 1 - Namehttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1_Option_1_-_Name 5.1.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1.1_Description 5.1.2 Benefits, Goals and Measurement Criteriahttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1.2_Benefits,_Goals_and_Measurement_Criteria 5.1.3 Costs and Funding Planhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1.3_Costs_and_Funding_Plan 5.1.4 Riskshttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1.4_Risks 5.1.5 Issueshttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1.5_Issues 5.1.6 Assumptionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#5.1.6_Assumptions 6. Recommended Optionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#6._Recommended_Option 7. Implementation Approachhttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#7._Implementation_Approach 7.1 Dependencieshttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#7.1_Dependencies 7.2 Rough estimateshttps://wikitech.wikimedia.org/wiki/SRE/business_case/template#7.2_Rough_estimates https://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs == 1. Executive Summary == 1. Executive Summaryhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#1._Executive_Summary 2. Business Problemhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#2._Business_Problem 3. Problem Analysishttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#3._Problem_Analysis 4. Current Technology/Solutionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#4._Current_Technology/Solution 5. Available Optionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5._Available_Options 5.1 Option 1 - elevate IXPs usagehttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.1_Option_1_-_elevate_IXPs_usage 5.1.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.1.1_Description 5.2 Option 2 - add a 4th transit providerhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.2_Option_2_-_add_a_4th_transit_provider 5.2.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.2.1_Description 5.1.3 Costs and Funding Planhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.1.3_Costs_and_Funding_Plan 5.1.4 Riskshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.1.4_Risks 5.1.5 Issueshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#5.1.5_Issues 6. Recommended Optionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#6._Recommended_Option 7. Implementation Approachhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#7._Implementation_Approach 7.1 Dependencieshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#7.1_Dependencies 7.2 Rough estimateshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_4th_transit_for_drmrs#7.2_Rough_estimates https://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_Shellbox_and_parsoid_saturation#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-07-13_brief_outbound_bandwidth_spike_eqsin ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-13_brief_outbound_bandwidth_spike_eqsin#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-13_brief_outbound_bandwidth_spike_eqsin#Actionables https://wikitech.wikimedia.org/wiki/Incidents/2022-07-20_network_interruption ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-20_network_interruption#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-20_network_interruption#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-20_network_interruption#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_FrontendUnavailable_cache_text ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_FrontendUnavailable_cache_text#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_FrontendUnavailable_cache_text#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-11_FrontendUnavailable_cache_text#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-06-12_appserver_latency ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-12_appserver_latency#Summary Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-06-12_appserver_latency#Scorecard https://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment == 1. Executive Summary == 1. Executive Summaryhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#1._Executive_Summary 2. Business Problemhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#2._Business_Problem 3. Problem Analysishttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#3._Problem_Analysis 4. Current Solutionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#4._Current_Solutions deployment-prep aka betahttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#deployment-prep_aka_beta Individual or team WMCS projectshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#Individual_or_team_WMCS_projects Pontoonhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#Pontoon Bolthttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#Bolt Beakerhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#Beaker 5. Available Optionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5._Available_Options 5.1 Option 1 - Supported shared services infrastructurehttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1_Option_1_-_Supported_shared_services_infrastructure 5.1.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1.1_Description 5.1.2 Benefits, Goals and Measurement Criteriahttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1.2_Benefits,_Goals_and_Measurement_Criteria 5.1.3 Costs and Funding Planhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1.3_Costs_and_Funding_Plan 5.1.4 Riskshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1.4_Risks 5.1.5 Issueshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1.5_Issues 5.1.6 Assumptionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.1.6_Assumptions 5.2 Option 2 - Cloud agnostic pontoonhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2_Option_2_-_Cloud_agnostic_pontoon 5.2.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2.1_Description 5.2.2 Benefits, Goals and Measurement Criteriahttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2.2_Benefits,_Goals_and_Measurement_Criteria 5.2.3 Costs and Funding Planhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2.3_Costs_and_Funding_Plan 5.2.4 Riskshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2.4_Risks 5.2.5 Issueshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2.5_Issues 5.2.6 Assumptionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.2.6_Assumptions 5.3 Option 3 - Docker compose/helm chart repository for specific roleshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3_Option_3_-_Docker_compose/helm_chart_repository_for_specific_roles 5.3.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3.1_Description 5.3.2 Benefits, Goals and Measurement Criteriahttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3.2_Benefits,_Goals_and_Measurement_Criteria 5.3.3 Costs and Funding Planhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3.3_Costs_and_Funding_Plan 5.3.4 Riskshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3.4_Risks 5.3.5 Issueshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3.5_Issues 5.3.6 Assumptionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#5.3.6_Assumptions 6. Recommended Optionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#6._Recommended_Option 7. Implementation Approachhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#7._Implementation_Approach 7.1 Dependencieshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#7.1_Dependencies 7.2 Rough estimateshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Disposable_Development_Environment#7.2_Rough_estimates https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55 == 2022-07-31 == 2022-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-31 2022-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-29 2022-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-28 2022-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-27 2022-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-26 2022-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-25 2022-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-24 2022-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-23 2022-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-22 2022-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-21 2022-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-20 2022-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-19 2022-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-18 2022-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-17 2022-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-16 2022-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-15 2022-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-14 2022-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-13 2022-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-12 2022-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-11 2022-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-10 2022-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-09 2022-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-08 2022-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-07 2022-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-06 2022-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-05 2022-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-04 2022-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-03 2022-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-02 2022-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#2022-07-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_55#Other_archives https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI = Designated Response Individual(s) (aka The Chaos Crew) = Designated Response Individual(s) (aka The Chaos Crew)https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Designated_Response_Individual(s)_(aka_The_Chaos_Crew) What is DRI?https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#What_is_DRI? General Responsibilitieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#General_Responsibilities In scope activitieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#In_scope_activities Out of scope activitieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Out_of_scope_activities Processeshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Processes Rotationhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Rotation DRI Roleshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#DRI_Roles Secondary -> Primary roll-inhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Secondary_->_Primary_roll-in Primary DRI responsibilitieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Primary_DRI_responsibilities Secondary DRI responsibilitieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Secondary_DRI_responsibilities Primary & Secondary DRI responsibilitieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#Primary_&_Secondary_DRI_responsibilities Referenceshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI#References https://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation =Background= Backgroundhttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Background Foundation Costshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Foundation_Costs Open Sourcehttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Open_Source White Boxhttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#White_Box Ecosystemhttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Ecosystem SONiChttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#SONiC Architecturehttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Architecture SONiC Supporthttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#SONiC_Support Dell Enterprise SONiChttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Dell_Enterprise_SONiC Dell Network Switcheshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Dell_Network_Switches Lab Setuphttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Lab_Setup Test Criteriahttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Test_Criteria Test Resultshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Test_Results Conclusionshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Conclusions Proshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Pros Conshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Cons Costshttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Costs Note on Netconf/YANGhttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Note_on_Netconf/YANG Verdicthttps://wikitech.wikimedia.org/wiki/SONiC/Dell_Enterprise_Sonic_Evaluation#Verdict https://wikitech.wikimedia.org/wiki/Incidents/2022-07-12_codfw_A5_powercycle ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-12_codfw_A5_powercycle#Summary Actionablehttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-12_codfw_A5_powercycle#Actionable See alsohttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-12_codfw_A5_powercycle#See_also Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-12_codfw_A5_powercycle#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation DRI Rotation; current and historical. Currenthttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#Current Historicalhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#Historical 2024-10-22 - 2024-11-05https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-10-22_-_2024-11-05 2024-10-08 - 2024-10-22https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-10-08_-_2024-10-22 2024-09-24 - 2024-10-08https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-09-24_-_2024-10-08 2024-09-10 - 2024-09-24https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-09-10_-_2024-09-24 2024-08-27 - 2024-09-10https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-08-27_-_2024-09-10 2024-08-13 - 2024-08-27https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-08-13_-_2024-08-27 2024-07-30 - 2024-08-13https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-07-30_-_2024-08-13 2024-07-16 - 2024-07-30https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-07-16_-_2024-07-30 2024-07-02 - 2024-07-16https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-07-02_-_2024-07-16 2024-06-18 - 2024-07-02https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-06-18_-_2024-07-02 2024-06-04 - 2024-06-18https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-06-04_-_2024-06-18 2024-05-21 - 2024-06-04https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-05-21_-_2024-06-04 2024-05-07 - 2024-05-21https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-05-07_-_2024-05-21 2024-04-23 - 2024-05-07https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-04-23_-_2024-05-07 2024-04-09 - 2024-04-23https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-04-09_-_2024-04-23 2024-03-26 - 2024-04-09https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-03-26_-_2024-04-09 2024-03-12 - 2024-03-26https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-03-12_-_2024-03-26 2024-02-27 - 2024-03-12https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-02-27_-_2024-03-12 2024-02-13 - 2024-02-27https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-02-13_-_2024-02-27 2024-01-30 - 2024-02-13https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-01-30_-_2024-02-13 2024-01-16 - 2024-01-30https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2024-01-16_-_2024-01-30 2023-12-19 - 2024-01-16https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-12-19_-_2024-01-16 2023-12-05 - 2023-12-19https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-12-05_-_2023-12-19 2023-11-21 - 2023-12-05https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-11-21_-_2023-12-05 2023-11-07 - 2023-11-21https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-11-07_-_2023-11-21 2023-10-24 - 2023-11-07https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-10-24_-_2023-11-07 2023-10-10 - 2023-10-24https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-10-10_-_2023-10-24 2023-09-26 - 2023-10-10https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-09-26_-_2023-10-10 2023-09-12 - 2023-09-26https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-09-12_-_2023-09-26 2023-08-29 - 2023-09-12https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-08-29_-_2023-09-12 2023-08-16 - 2023-08-29https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-08-16_-_2023-08-29 2023-08-02 - 2023-08-15https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-08-02_-_2023-08-15 2023-07-18 - 2023-08-01https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-07-18_-_2023-08-01 2023-07-04 - 2023-07-18https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-07-04_-_2023-07-18 2023-06-19 - 2023-07-02https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-06-19_-_2023-07-02 2023-06-06 - 2023-06-18https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-06-06_-_2023-06-18 2023-05-23 - 2023-06-05https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-05-23_-_2023-06-05 2023-05-10 - 2023-05-22https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-05-10_-_2023-05-22 2023-04-26 - 2023-05-09https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-04-26_-_2023-05-09 2023-04-12 - 2023-04-25https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-04-12_-_2023-04-25 2023-03-29 - 2023-04-11https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-03-29_-_2023-04-11 2023-03-15 - 2023-03-28https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-03-15_-_2023-03-28 2023-03-01 - 2023-03-14https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-03-01_-_2023-03-14 2023-02-15 - 2023-02-28https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-02-15_-_2023-02-28 2023-02-01 - 2023-02-14https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-02-01_-_2023-02-14 2023-01-17 - 2023-01-31https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-01-17_-_2023-01-31 2023-01-03 - 2023-01-16https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2023-01-03_-_2023-01-16 2022-12-06 - 2023-01-02https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-12-06_-_2023-01-02 2022-11-23 - 2022-12-05https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-11-23_-_2022-12-05 2022-11-10 - 2022-11-22https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-11-10_-_2022-11-22 2022-10-25 - 2022-11-09https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-10-25_-_2022-11-09 2022-10-11 - 2022-10-25https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-10-11_-_2022-10-25 2022-09-27 - 2022-10-11https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-09-27_-_2022-10-11 2022-09-13 - 2022-09-27https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-09-13_-_2022-09-27 2022-08-30 - 2022-09-13https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-08-30_-_2022-09-13 2022-08-16 - 2022-08-30https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-08-16_-_2022-08-30 2022-08-02 - 2022-08-16https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Rotation#2022-08-02_-_2022-08-16 https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Tech_talks 2023-11-14 Tuesday Caching in SmashPig https://wikitech.wikimedia.org/wiki/IDM Wikimedia IDM (codename Bitu) is an [management|identity management service] that (will) centralize and streamline account creation, account settings, access groups, and account disabling for [account|Wikimedia Developer accounts] (sometimes known as "Wikitech", "LDAP", or "Gerrit" accounts). IDM stands for identity management. Preliminary design decisionshttps://wikitech.wikimedia.org/wiki/IDM#Preliminary_design_decisions Initial use cases for IDMhttps://wikitech.wikimedia.org/wiki/IDM#Initial_use_cases_for_IDM Major use cases for the Wikimedia IDM pagehttps://wikitech.wikimedia.org/wiki/IDM#Major_use_cases_for_the_Wikimedia_IDM_page Account creationhttps://wikitech.wikimedia.org/wiki/IDM#Account_creation Status quohttps://wikitech.wikimedia.org/wiki/IDM#Status_quo Futurehttps://wikitech.wikimedia.org/wiki/IDM#Future Modifying account settingshttps://wikitech.wikimedia.org/wiki/IDM#Modifying_account_settings Gaining additional access needed for a rolehttps://wikitech.wikimedia.org/wiki/IDM#Gaining_additional_access_needed_for_a_role Future setuphttps://wikitech.wikimedia.org/wiki/IDM#Future_setup Disabling an accounthttps://wikitech.wikimedia.org/wiki/IDM#Disabling_an_account Bug reports and feature requestshttps://wikitech.wikimedia.org/wiki/IDM#Bug_reports_and_feature_requests Runbookshttps://wikitech.wikimedia.org/wiki/IDM#Runbooks External linkshttps://wikitech.wikimedia.org/wiki/IDM#External_links https://wikitech.wikimedia.org/wiki/Puppet/Beaker Beaker is a project to allow users to perform application testing on Puppet repositories. It allows you to define a host or set of hosts, apply a Puppet policy and then uses serverspec to test the state of the built VM or container. Running beakerhttps://wikitech.wikimedia.org/wiki/Puppet/Beaker#Running_beaker Debug Modehttps://wikitech.wikimedia.org/wiki/Puppet/Beaker#Debug_Mode Preserve imagehttps://wikitech.wikimedia.org/wiki/Puppet/Beaker#Preserve_image Testing random WMF puppet codehttps://wikitech.wikimedia.org/wiki/Puppet/Beaker#Testing_random_WMF_puppet_code Changing Roleshttps://wikitech.wikimedia.org/wiki/Puppet/Beaker#Changing_Roles Other environment variableshttps://wikitech.wikimedia.org/wiki/Puppet/Beaker#Other_environment_variables https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Definition_of_Done A definition of done is a way for our whole team to agree on our habits for pushing out quality code. All of these things need to be done before a phabricator task can be marked as complete by the stakeholder, fellow engineer, or product owner. https://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability This document aims to capture the metrics we will use to measure performance of the Wikifunctions project. The metrics are divided into a few categories: Performance SLOs (current phase)https://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Performance_SLOs_(current_phase) Resource Saturation Metrics (current phase)https://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Resource_Saturation_Metrics_(current_phase) Wikifunctions-Specific Metrics (future phase)https://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Wikifunctions-Specific_Metrics_(future_phase) Health Checkshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Health_Checks Dashboardshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Dashboards Alertinghttps://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Alerting Infrastructurehttps://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Infrastructure Data Storagehttps://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#Data_Storage User Storyhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Performance_observability#User_Story https://wikitech.wikimedia.org/wiki/Vopsbot Vopsbot (source) is an IRC bot that allows interacting with the splunk oncall api from IRC. Installation and configurationhttps://wikitech.wikimedia.org/wiki/Vopsbot#Installation_and_configuration Bot commandshttps://wikitech.wikimedia.org/wiki/Vopsbot#Bot_commands See who is oncall nowhttps://wikitech.wikimedia.org/wiki/Vopsbot#See_who_is_oncall_now List paging incidents for the last 24 hourshttps://wikitech.wikimedia.org/wiki/Vopsbot#List_paging_incidents_for_the_last_24_hours Acknowledge an open incidenthttps://wikitech.wikimedia.org/wiki/Vopsbot#Acknowledge_an_open_incident Resolve an open incidenthttps://wikitech.wikimedia.org/wiki/Vopsbot#Resolve_an_open_incident Access controlhttps://wikitech.wikimedia.org/wiki/Vopsbot#Access_control Other capabilitieshttps://wikitech.wikimedia.org/wiki/Vopsbot#Other_capabilities Restart sirenbothttps://wikitech.wikimedia.org/wiki/Vopsbot#Restart_sirenbot https://wikitech.wikimedia.org/wiki/Community_Tech https://wikitech.wikimedia.org/wiki/Performance/Runbooks/Analyze_memcached == memkeys == memkeyshttps://wikitech.wikimedia.org/wiki/Performance/Runbooks/Analyze_memcached#memkeys cachedumphttps://wikitech.wikimedia.org/wiki/Performance/Runbooks/Analyze_memcached#cachedump See alsohttps://wikitech.wikimedia.org/wiki/Performance/Runbooks/Analyze_memcached#See_also https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro == Sprint Retro == Sprint Retrohttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Sprint_Retro Sprint Retro Promptshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Sprint_Retro_Prompts Plus/Minus/Learninghttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Plus/Minus/Learning 4Ls: Liked/(Lacked/Longed for)/Loathed/Learnedhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#4Ls:_Liked/(Lacked/Longed_for)/Loathed/Learned Sailboathttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Sailboat KLMAhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#KLMA Engine and Parachutehttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Engine_and_Parachute Happy/Sad/Confusedhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Happy/Sad/Confused One Word Retrohttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#One_Word_Retro Movie Review Retrohttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Sprint_Retro#Movie_Review_Retro https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Mid-Sprint_Checkup == Sprint Checkup == Sprint Checkuphttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Mid-Sprint_Checkup#Sprint_Checkup Checkup Agendahttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Mid-Sprint_Checkup#Checkup_Agenda https://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Conclusions Volume Sizinghttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Volume_Sizing Dedicate storagehttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Dedicate_storage The role of hinted-handoffhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#The_role_of_hinted-handoff Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_cassandra_disk_space#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#What_went_poorly? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_x2_databases_replication_breakage#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502 ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Where_did_we_get_lucky? How many people were involved in the remediation?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#How_many_people_were_involved_in_the_remediation? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Scorecard https://wikitech.wikimedia.org/wiki/Style_guidelines Style guidelines are an important part of an organization; As a team, we should all have expectations of how code will be written and read so that we can all contribute with the lowest barrier to entry. Githttps://wikitech.wikimedia.org/wiki/Style_guidelines#Git Commit messageshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Commit_messages Puppethttps://wikitech.wikimedia.org/wiki/Style_guidelines#Puppet Shellhttps://wikitech.wikimedia.org/wiki/Style_guidelines#Shell Environmenthttps://wikitech.wikimedia.org/wiki/Style_guidelines#Environment File Extensionshttps://wikitech.wikimedia.org/wiki/Style_guidelines#File_Extensions STDOUT vs STDERRhttps://wikitech.wikimedia.org/wiki/Style_guidelines#STDOUT_vs_STDERR Fail by defaulthttps://wikitech.wikimedia.org/wiki/Style_guidelines#Fail_by_default Commentshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Comments Formattinghttps://wikitech.wikimedia.org/wiki/Style_guidelines#Formatting Indentationhttps://wikitech.wikimedia.org/wiki/Style_guidelines#Indentation Line Length and Long Stringshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Line_Length_and_Long_Strings Pipelineshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Pipelines Loopshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Loops Case statementhttps://wikitech.wikimedia.org/wiki/Style_guidelines#Case_statement Quotinghttps://wikitech.wikimedia.org/wiki/Style_guidelines#Quoting Features and Bugshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Features_and_Bugs ShellCheckhttps://wikitech.wikimedia.org/wiki/Style_guidelines#ShellCheck Command Substitutionhttps://wikitech.wikimedia.org/wiki/Style_guidelines#Command_Substitution Wildcard Expansion of Filenameshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Wildcard_Expansion_of_Filenames Evalhttps://wikitech.wikimedia.org/wiki/Style_guidelines#Eval Arithmetichttps://wikitech.wikimedia.org/wiki/Style_guidelines#Arithmetic Naming Conventionshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Naming_Conventions Function Nameshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Function_Names Source Filenameshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Source_Filenames Variable Nameshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Variable_Names Constants and Environment Variable Nameshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Constants_and_Environment_Variable_Names Calling Commandshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Calling_Commands Checking Return Valueshttps://wikitech.wikimedia.org/wiki/Style_guidelines#Checking_Return_Values See alsohttps://wikitech.wikimedia.org/wiki/Style_guidelines#See_also https://wikitech.wikimedia.org/wiki/PERCCli Later models (2022) versions of the Dell PowerEdge servers have migrated from the MegaRAID controller and the MegaCli tool to PERC6 (PowerEdge RAID Controller) cards. Management of these RAID cards is done via Dells perccli and perccli64 tool. Installationhttps://wikitech.wikimedia.org/wiki/PERCCli#Installation Monitoringhttps://wikitech.wikimedia.org/wiki/PERCCli#Monitoring Battery statushttps://wikitech.wikimedia.org/wiki/PERCCli#Battery_status Relearn cyclehttps://wikitech.wikimedia.org/wiki/PERCCli#Relearn_cycle Virtual disk (array) statushttps://wikitech.wikimedia.org/wiki/PERCCli#Virtual_disk_(array)_status Physical driveshttps://wikitech.wikimedia.org/wiki/PERCCli#Physical_drives Replace a drivehttps://wikitech.wikimedia.org/wiki/PERCCli#Replace_a_drive https://wikitech.wikimedia.org/wiki/Juniper_TLS_certificate_install In the fundraising environment, we use certificates from the pre-existing Puppet Preparationhttps://wikitech.wikimedia.org/wiki/Juniper_TLS_certificate_install#Preparation Certificate reinstall/installhttps://wikitech.wikimedia.org/wiki/Juniper_TLS_certificate_install#Certificate_reinstall/install Verificationhttps://wikitech.wikimedia.org/wiki/Juniper_TLS_certificate_install#Verification Cleanuphttps://wikitech.wikimedia.org/wiki/Juniper_TLS_certificate_install#Cleanup See alsohttps://wikitech.wikimedia.org/wiki/Juniper_TLS_certificate_install#See_also https://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines A collection of guidelines to follow for an efficient use of our network. With their exceptions. Servers uplinkshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Servers_uplinks General reasons for servers to have multiple uplinkshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#General_reasons_for_servers_to_have_multiple_uplinks Redundancyhttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Redundancy Capacityhttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Capacity Required L2 adjacency to physically distant networkshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Required_L2_adjacency_to_physically_distant_networks Failure domainshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Failure_domains Virtual Chassishttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Virtual_Chassis L2 domainshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#L2_domains WMCShttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#WMCS Ganeti clustershttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Ganeti_clusters Core DCshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Core_DCs Public IPshttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Public_IPs IPv6https://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#IPv6 Congestionhttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#Congestion See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines#See_also https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation This page contains information about the deprecation and removal of the Toolforge Grid Engine platform. What is changing?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#What_is_changing? Timelinehttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Timeline FAQhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#FAQ How can I track tool migrations?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#How_can_I_track_tool_migrations? What exactly is happening on 2023-12-14?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#What_exactly_is_happening_on_2023-12-14? Why is this happening?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Why_is_this_happening? How can I know if a tool I maintain or use has been tagged as having an unreachable maintainer?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#How_can_I_know_if_a_tool_I_maintain_or_use_has_been_tagged_as_having_an_unreachable_maintainer? If I use a tool that has been shut down, what should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#If_I_use_a_tool_that_has_been_shut_down,_what_should_I_do? If I maintain a tool that has been shut down, what should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#If_I_maintain_a_tool_that_has_been_shut_down,_what_should_I_do? What happens to crontabs for tools that have been shut down?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#What_happens_to_crontabs_for_tools_that_have_been_shut_down? How can I help?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#How_can_I_help? Are crontab and jlocal going away too?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Are_crontab_and_jlocal_going_away_too? What should I do?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#What_should_I_do? Use case continuityhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Use_case_continuity Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Why_are_we_doing_this? Solutions to common problemshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Solutions_to_common_problems Rebuild virtualenv for Python users / python3: not found / ModuleNotFoundError: No module named '...'https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Rebuild_virtualenv_for_Python_users_/_python3:_not_found_/_ModuleNotFoundError:_No_module_named_'...' Tools needing multiple language runtimeshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Tools_needing_multiple_language_runtimes Mono containerhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Mono_container Requires a system library or tool to be presenthttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Requires_a_system_library_or_tool_to_be_present Pywikibot scriptshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Pywikibot_scripts Delete a toolhttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Delete_a_tool "Your webservice is not running" from `webservice status` after migratinghttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#"Your_webservice_is_not_running"_from_`webservice_status`_after_migrating See alsohttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#See_also https://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams ==1. Executive Summary== 1. Executive Summaryhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#1._Executive_Summary 2. Business Problemhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#2._Business_Problem 3. Problem Analysishttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#3._Problem_Analysis 4. Current Technology/Solutionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#4._Current_Technology/Solution 5. Available Optionshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5._Available_Options 5.1 Option 1 - esams->knams movehttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.1_Option_1_-_esams->knams_move 5.1.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.1.1_Description 5.1.2 Benefits, Goals and Measurement Criteriahttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.1.2_Benefits,_Goals_and_Measurement_Criteria 5.1.3 Riskshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.1.3_Risks 5.2 Option 2 - Push the move 1 year laterhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.2_Option_2_-_Push_the_move_1_year_later 5.2.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.2.1_Description 5.3 Option 3 - Stay in esams and knamshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.3_Option_3_-_Stay_in_esams_and_knams 5.3.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.3.1_Description 5.4 Option 4 - Stay in esams, move out of knamshttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.4_Option_4_-_Stay_in_esams,_move_out_of_knams 5.4.1 Descriptionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#5.4.1_Description 6. Recommended Optionhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#6._Recommended_Option 7. Implementation Approachhttps://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams#7._Implementation_Approach https://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_confd_all_hosts ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_confd_all_hosts#Summary Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_confd_all_hosts#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-10_confd_all_hosts#Scorecard https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/08 ==Week of August 15== Week of August 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/08#Week_of_August_15 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/08#=== Week of August 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/08#Week_of_August_22 Week of August 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/08#Week_of_August_29 https://wikitech.wikimedia.org/wiki/PAWS/Python_with_Pip PAWS works great with default Python out-of-the-box, but what if you need to import packages from PyPi? https://wikitech.wikimedia.org/wiki/CDN The Wikimedia CDN handles traffic routing and HTTP caching for all Wikimedia projects. It is maintained by the SRE Traffic team. Headershttps://wikitech.wikimedia.org/wiki/CDN#Headers HTTPShttps://wikitech.wikimedia.org/wiki/CDN#HTTPS TLS protocolshttps://wikitech.wikimedia.org/wiki/CDN#TLS_protocols Ciphershttps://wikitech.wikimedia.org/wiki/CDN#Ciphers Rate-limitinghttps://wikitech.wikimedia.org/wiki/CDN#Rate-limiting Request Normalizationhttps://wikitech.wikimedia.org/wiki/CDN#Request_Normalization Query sortinghttps://wikitech.wikimedia.org/wiki/CDN#Query_sorting Path normalizationhttps://wikitech.wikimedia.org/wiki/CDN#Path_normalization Cachinghttps://wikitech.wikimedia.org/wiki/CDN#Caching Text clusterhttps://wikitech.wikimedia.org/wiki/CDN#Text_cluster Logichttps://wikitech.wikimedia.org/wiki/CDN#Logic Retentionhttps://wikitech.wikimedia.org/wiki/CDN#Retention Invalidating contenthttps://wikitech.wikimedia.org/wiki/CDN#Invalidating_content Optimizationshttps://wikitech.wikimedia.org/wiki/CDN#Optimizations Historyhttps://wikitech.wikimedia.org/wiki/CDN#History Old caching clustershttps://wikitech.wikimedia.org/wiki/CDN#Old_caching_clusters Through the yearshttps://wikitech.wikimedia.org/wiki/CDN#Through_the_years Further readinghttps://wikitech.wikimedia.org/wiki/CDN#Further_reading See alsohttps://wikitech.wikimedia.org/wiki/CDN#See_also https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts This page gives some information about WMCS team alerting system and procedures. All the team alerts go to this same alerting system. Current alertshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Current_alerts Old alertshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Old_alerts Ideal scenariohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Ideal_scenario Current status (when writing this)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Current_status_(when_writing_this) Handling a pagehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Handling_a_page If you are close to a laptop/ device with a browserhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#If_you_are_close_to_a_laptop/_device_with_a_browser If you are not close to a laptophttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#If_you_are_not_close_to_a_laptop Special temporary case: if the alert has the label 'sourceicinga' ==https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Special_temporary_case:_if_the_alert_has_the_label_'sourceicinga'_== Related Linkshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Alerts#Related_Links https://wikitech.wikimedia.org/wiki/Gerrit/Events_ingestion This was an experiment over the summer 2022. As of March 2023 there is no plan to complete it Referenceshttps://wikitech.wikimedia.org/wiki/Gerrit/Events_ingestion#References https://wikitech.wikimedia.org/wiki/Query_string_normalization == Problem == Problemhttps://wikitech.wikimedia.org/wiki/Query_string_normalization#Problem Theoryhttps://wikitech.wikimedia.org/wiki/Query_string_normalization#Theory MediaWikihttps://wikitech.wikimedia.org/wiki/Query_string_normalization#MediaWiki Implementationhttps://wikitech.wikimedia.org/wiki/Query_string_normalization#Implementation Varnishhttps://wikitech.wikimedia.org/wiki/Query_string_normalization#Varnish Purgedhttps://wikitech.wikimedia.org/wiki/Query_string_normalization#Purged See alsohttps://wikitech.wikimedia.org/wiki/Query_string_normalization#See_also https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow [WIP] older docs at Fundraising#F Data and flow. Donationhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow#Donation Payment processor/payment method/donation flow permutationshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow#Payment_processor/payment_method/donation_flow_permutations Recurring chargehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow#Recurring_charge Audithttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow#Audit E-mail exporthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow#E-mail_export Otherhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow#Other https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Triggers = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Triggers#Overview Update triggers on productionhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Triggers#Update_triggers_on_production https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Meeting_norms These are agreements and guidelines on how we conduct meetings. Before meetingshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Meeting_norms#Before_meetings During meetingshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Meeting_norms#During_meetings After the meetinghttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Meeting_norms#After_the_meeting https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence Origin task: [of the decision: 5 October 2022 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Problem Goals:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Goals: Constraints and Riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Constraints_and_Risks Proposals:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Proposals: Option 1:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Option_1: Proshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Pros Conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Cons Option 2:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Option_2: Option 3:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Option_3: Option 4:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T316866_Openstack_Upgrade_Cadence#Option_4: https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gateway_Chooser == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gateway_Chooser#Overview Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gateway_Chooser#Testing https://wikitech.wikimedia.org/wiki/SLO/Trafficserver Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Clients Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#Service_Level_Objectives See alsohttps://wikitech.wikimedia.org/wiki/SLO/Trafficserver#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy These tests are defined here: https://gerrit.wikimedia. https://admin.toolforge.org/healthzhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy#https://admin.toolforge.org/healthz https://this-tool-does-not-exist.toolforge.org/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy#https://this-tool-does-not-exist.toolforge.org/ https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56 == 2022-08-31 == 2022-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-31 2022-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-30 2022-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-29 2022-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-28 2022-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-27 2022-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-26 2022-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-25 2022-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-24 2022-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-23 2022-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-22 2022-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-21 2022-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-20 2022-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-19 2022-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-18 2022-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-17 2022-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-16 2022-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-15 2022-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-14 2022-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-13 2022-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-12 2022-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-11 2022-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-10 2022-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-09 2022-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-08 2022-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-07 2022-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-06 2022-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-05 2022-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-04 2022-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-03 2022-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-02 2022-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#2022-08-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_56#Other_archives https://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet More or less loose collection of GitLab commands that might be helpful (or were helpful at some point) GitLabhttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#GitLab Restartshttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Restarts Backup and Restorehttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Backup_and_Restore Postgreshttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Postgres gitlab-runnerhttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#gitlab-runner Depool/pause a runnerhttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Depool/pause_a_runner Pool/unpause a runnerhttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Pool/unpause_a_runner Register/Unregister:https://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Register/Unregister: Clean docker cache:https://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Clean_docker_cache: Registering to a replica:https://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Registering_to_a_replica: Run commands against all WMCS Runners (cloudcumin)https://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Run_commands_against_all_WMCS_Runners_(cloudcumin) Depool/pause all WMCS runnershttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Depool/pause_all_WMCS_runners Pool/unpause all WMCS runnershttps://wikitech.wikimedia.org/wiki/GitLab/Cheat_Sheet#Pool/unpause_all_WMCS_runners https://wikitech.wikimedia.org/wiki/Incidents/2022-07-10_thumbor ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-10_thumbor#Summary Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-10_thumbor#Detection Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-10_thumbor#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-10_thumbor#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-07-10_thumbor#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-08_codfw_appservers_degradation#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-24_swift#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-09_Elastic_Autocomplete_Missing#Scorecard https://wikitech.wikimedia.org/wiki/Juniper_RE_i40e_firmware ==Backgroud== Backgroudhttps://wikitech.wikimedia.org/wiki/Juniper_RE_i40e_firmware#Backgroud Firmware Filehttps://wikitech.wikimedia.org/wiki/Juniper_RE_i40e_firmware#Firmware_File Stepshttps://wikitech.wikimedia.org/wiki/Juniper_RE_i40e_firmware#Steps https://wikitech.wikimedia.org/wiki/Michael_Jackson_effect The Michael Jackson effect (also Michael Jackson problemPoolCounter documentation: first revision from March 2011, Tim Starling, mediawiki.org. Eventhttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#Event Technical impacthttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#Technical_impact Backgroundhttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#Background Incidenthttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#Incident Solutionhttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#Solution Further readinghttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#Further_reading Referenceshttps://wikitech.wikimedia.org/wiki/Michael_Jackson_effect#References https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/09 ==Week of September 05== Week of September 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/09#Week_of_September_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/09#=== Week of September 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/09#Week_of_September_12 Week of September 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/09#Week_of_September_19 Week of September 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/09#Week_of_September_26 https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores ==Checking damaged messages== Checking damaged messageshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Checking_damaged_messages Following up on incoming failmailhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Following_up_on_incoming_failmail Follow up or ack incoming alerts (from payments team or processors) to fr-tech@ mailboxhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Follow_up_or_ack_incoming_alerts_(from_payments_team_or_processors)_to_fr-tech@_mailbox Log checkinghttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Log_checking Deploymentshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Deployments Check on audit incoming directorieshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Check_on_audit_incoming_directories Civicrm Upgradeshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Civicrm_Upgrades Docker maintenance and updates task creationhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Docker_maintenance_and_updates_task_creation Every 90 days should login to test consoles for all payment gateways to prevent lock accounthttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/DRI/Chores#Every_90_days_should_login_to_test_consoles_for_all_payment_gateways_to_prevent_lock_account https://wikitech.wikimedia.org/wiki/Browser_fingerprinting == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Browser_fingerprinting#Introduction Why is this needed?https://wikitech.wikimedia.org/wiki/Browser_fingerprinting#Why_is_this_needed? What's a browser fingerprint?https://wikitech.wikimedia.org/wiki/Browser_fingerprinting#What's_a_browser_fingerprint? Caveatshttps://wikitech.wikimedia.org/wiki/Browser_fingerprinting#Caveats Entropyhttps://wikitech.wikimedia.org/wiki/Browser_fingerprinting#Entropy Resourceshttps://wikitech.wikimedia.org/wiki/Browser_fingerprinting#Resources https://wikitech.wikimedia.org/wiki/Search/Object_Store_Cleanup Describes how to clean up Swift containers (analogous to S3 buckets) using the Swiftly client https://wikitech.wikimedia.org/wiki/Event_Platform/Maintainers Every Event Platform component should have a steward with a manager, and at least 2 maintainers. If a component has fewer than 2 maintainers, it is in danger of being ill-supported. https://wikitech.wikimedia.org/wiki/Peering_management Peering management is something with still a large manual process. This is mostly due to communication (for new, changes, or issues) happening over emails. Finding peering candidateshttps://wikitech.wikimedia.org/wiki/Peering_management#Finding_peering_candidates peering@ email aliashttps://wikitech.wikimedia.org/wiki/Peering_management#peering@_email_alias Equinix peering opportunities portalhttps://wikitech.wikimedia.org/wiki/Peering_management#Equinix_peering_opportunities_portal Netflowhttps://wikitech.wikimedia.org/wiki/Peering_management#Netflow PeeringDBhttps://wikitech.wikimedia.org/wiki/Peering_management#PeeringDB Peering Newshttps://wikitech.wikimedia.org/wiki/Peering_management#Peering_News IX mailing listshttps://wikitech.wikimedia.org/wiki/Peering_management#IX_mailing_lists Peering workflowhttps://wikitech.wikimedia.org/wiki/Peering_management#Peering_workflow Setting up new sessionshttps://wikitech.wikimedia.org/wiki/Peering_management#Setting_up_new_sessions Noteshttps://wikitech.wikimedia.org/wiki/Peering_management#Notes Managing down sessionshttps://wikitech.wikimedia.org/wiki/Peering_management#Managing_down_sessions Manually increase the prefix limithttps://wikitech.wikimedia.org/wiki/Peering_management#Manually_increase_the_prefix_limit Providers not using emails to manage peeringhttps://wikitech.wikimedia.org/wiki/Peering_management#Providers_not_using_emails_to_manage_peering Possible improvementshttps://wikitech.wikimedia.org/wiki/Peering_management#Possible_improvements https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Overview Accountshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Accounts API callshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#API_calls Initial payment setuphttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Initial_payment_setup Payment status requesthttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Payment_status_request Payment capturehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Payment_capture Recurring payment setuphttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Recurring_payment_setup IPN Listenerhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#IPN_Listener Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/PayPal_Express#Testing https://wikitech.wikimedia.org/wiki/SRE/Oncall/Schedule == Upcoming business hours on-call schedule == Upcoming business hours on-call schedulehttps://wikitech.wikimedia.org/wiki/SRE/Oncall/Schedule#Upcoming_business_hours_on-call_schedule https://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration This pages describes the process for configuring an event stream for Metrics Platform events. Quickstarthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Quickstart 1. Submit a configuration patchhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#1._Submit_a_configuration_patch 2. Deploy the patchhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#2._Deploy_the_patch Choosing a stream namehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Choosing_a_stream_name Stream configurationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Stream_configuration Example: Using custom sampling rateshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Example:_Using_custom_sampling_rates Example: Using a sampling rate of 1 on the beta clusterhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Example:_Using_a_sampling_rate_of_1_on_the_beta_cluster Curation ruleshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Curation_rules Example: Using curation ruleshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Example:_Using_curation_rules Stream registrationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Stream_registration Overriding event stream config settingshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Overriding_event_stream_config_settings Configuring a stream in the beta clusterhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Configuring_a_stream_in_the_beta_cluster Decommissioninghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Stream_configuration#Decommissioning https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs Note: some of these steps might require extra access to internal infrastructure systems, we are working on improving the runbooks, until then, take this as a guideline. Errorhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs#Error Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs#Debugging Solutionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs#Solutions Solution: block a user agenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs#Solution:_block_a_user_agent Solution: block an IPhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs#Solution:_block_an_IP Related taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIs#Related_tasks https://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-06_eqiad_row_D_networking#Scorecard https://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration Learn more about how Quarry is administered and maintained. Overviewhttps://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration#Overview Main pointshttps://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration#Main_points Webhttps://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration#Web Workerhttps://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration#Worker Quarry source codehttps://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration#Quarry_source_code Nova Resourcehttps://wikitech.wikimedia.org/wiki/Quarry/Quarry_maintenance_and_administration#Nova_Resource https://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-09-15_sessionstore_quorum_issues#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements This document proposes some improvements on how we build and deploy various components to the Toolforge Kubernetes clusters. Problem statement / Current processhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Problem_statement_/_Current_process Proposed new workflowhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Proposed_new_workflow CI builds of new container images and Helm chartshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#CI_builds_of_new_container_images_and_Helm_charts Controlling live container image and chart versions in Githttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Controlling_live_container_image_and_chart_versions_in_Git Deployment planhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Deployment_plan Stage 0: Helm migrationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Stage_0:_Helm_migration Stage A: Start using Git commit hashes for image versionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Stage_A:_Start_using_Git_commit_hashes_for_image_versions Stage B: GitLab migration for the affected repositorieshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Stage_B:_GitLab_migration_for_the_affected_repositories Stage C: Proper chart repositoryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Stage_C:_Proper_chart_repository Stage D: Introduce the deployment control repositoryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Stage_D:_Introduce_the_deployment_control_repository Stage E: Automated container buildshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Stage_E:_Automated_container_builds Further improvementshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Further_improvements Monitoringhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Monitoring Automationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Automation Disk space clean-uphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#Disk_space_clean-up gitopshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_Kubernetes_component_workflow_improvements#gitops https://wikitech.wikimedia.org/wiki/Puppet/PQL PQL is a simple query syntax for the PuppetDB api. its much nicer to use then the older query syntax and is also supported by pypuppetdb. Exampleshttps://wikitech.wikimedia.org/wiki/Puppet/PQL#Examples All nodes with Package['confd']https://wikitech.wikimedia.org/wiki/Puppet/PQL#All_nodes_with_Package['confd'] All exported resourceshttps://wikitech.wikimedia.org/wiki/Puppet/PQL#All_exported_resources All exported sshkey resourceshttps://wikitech.wikimedia.org/wiki/Puppet/PQL#All_exported_sshkey_resources All exported sshkey resources for a specific hosthttps://wikitech.wikimedia.org/wiki/Puppet/PQL#All_exported_sshkey_resources_for_a_specific_host All instances of a resource with a specific paramater valuehttps://wikitech.wikimedia.org/wiki/Puppet/PQL#All_instances_of_a_resource_with_a_specific_paramater_value A list files matching a specific pathhttps://wikitech.wikimedia.org/wiki/Puppet/PQL#A_list_files_matching_a_specific_path List all teams and the roles they ownhttps://wikitech.wikimedia.org/wiki/Puppet/PQL#List_all_teams_and_the_roles_they_own Produce a list of all files changed during a specific windowhttps://wikitech.wikimedia.org/wiki/Puppet/PQL#Produce_a_list_of_all_files_changed_during_a_specific_window All changed resources using a specific change revisionhttps://wikitech.wikimedia.org/wiki/Puppet/PQL#All_changed_resources_using_a_specific_change_revision List of hosts on specific versionhttps://wikitech.wikimedia.org/wiki/Puppet/PQL#List_of_hosts_on_specific_version More informationhttps://wikitech.wikimedia.org/wiki/Puppet/PQL#More_information https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10 ==Week of October 03== Week of October 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10#Week_of_October_03 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10#=== Week of October 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10#Week_of_October_10 Week of October 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10#Week_of_October_17 Week of October 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10#Week_of_October_24 Week of October 31https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/10#Week_of_October_31 https://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-15_s6_master_failure#Scorecard https://wikitech.wikimedia.org/wiki/Metrics_Platform/Sampling Sampling in Metrics Platform may refer to: Analytics samplinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Sampling#Analytics_sampling Experiment enrolment samplinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Sampling#Experiment_enrolment_sampling https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ This page includes information about the purpose, functionality, and status of the Metrics Platform. General FAQshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#General_FAQs What core capabilities will the Metrics Platform deliver?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_core_capabilities_will_the_Metrics_Platform_deliver? What are the benefits of the Metrics Platform?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_are_the_benefits_of_the_Metrics_Platform? What does the Metrics Platform enable and why is that valuable to the Movement?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_does_the_Metrics_Platform_enable_and_why_is_that_valuable_to_the_Movement? Metrics Platform Developmenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Metrics_Platform_Development How is the development of the Metrics Platform being approached?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#How_is_the_development_of_the_Metrics_Platform_being_approached? How will the Metrics Platform work?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#How_will_the_Metrics_Platform_work? Where are we currently focusing:https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Where_are_we_currently_focusing: When should I start creating new instrumentation with the Metrics Platform?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#When_should_I_start_creating_new_instrumentation_with_the_Metrics_Platform? On-Wiki Instrumentationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#On-Wiki_Instrumentation What will be different if I use the Metrics Platform for instrumentation?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_will_be_different_if_I_use_the_Metrics_Platform_for_instrumentation? Can I still use the existing process for instrumentation?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Can_I_still_use_the_existing_process_for_instrumentation? Will I be forced to migrate all my existing schemas and instrumentation to the metrics platform?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Will_I_be_forced_to_migrate_all_my_existing_schemas_and_instrumentation_to_the_metrics_platform? If we no longer create schemas, where will instrumentation documentation go?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#If_we_no_longer_create_schemas,_where_will_instrumentation_documentation_go? What is the process for creating new instrumentations?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_is_the_process_for_creating_new_instrumentations? If I migrate existing instrumentations, how does that impact existing Analytics scripts, visualisations, etc.?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#If_I_migrate_existing_instrumentations,_how_does_that_impact_existing_Analytics_scripts,_visualisations,_etc.? How do we know that data quality is consistent with existing instrumentations?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#How_do_we_know_that_data_quality_is_consistent_with_existing_instrumentations? Metrics Platform & Eventshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Metrics_Platform_&_Events How Does the Metrics Platform Relate to the Event Platform?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#How_Does_the_Metrics_Platform_Relate_to_the_Event_Platform? Will it replace the current event platform?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Will_it_replace_the_current_event_platform? What are the implementation differences between a Metrics Platform instrument and an Event Platform instrument?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_are_the_implementation_differences_between_a_Metrics_Platform_instrument_and_an_Event_Platform_instrument? Experimentation & Feature Flag FAQs - WIPhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Experimentation_&_Feature_Flag_FAQs_-_WIP What is a Feature Flag?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_is_a_Feature_Flag? Why Feature Flags?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Why_Feature_Flags? What is Experimentation?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#What_is_Experimentation? Why Experimentation?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#Why_Experimentation? How could experiments and feature flags work?https://wikitech.wikimedia.org/wiki/Metrics_Platform/FAQ#How_could_experiments_and_feature_flags_work? https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation This page contains a proposal for iterating on Cloud network isolation. Cross-realm traffic guidelines case 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Cross-realm_traffic_guidelines_case_4 New cloud-realm network: cloud-privatehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#New_cloud-realm_network:_cloud-private LB layerhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#LB_layer predicted usage of the new LB abstraction layerhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#predicted_usage_of_the_new_LB_abstraction_layer Open questionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Open_questions How to connect cross-DChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#How_to_connect_cross-DC Potential Designhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Potential_Design Dedicated cloud-public Vlanhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Dedicated_cloud-public_Vlan Default route for servers connected to cloud-privatehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Default_route_for_servers_connected_to_cloud-private Proof of concept build-outhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Proof_of_concept_build-out Potentially available servershttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Potentially_available_servers Previous workhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Iteration_on_network_isolation#Previous_work https://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts ==Summary== Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-17_mx_and_vrts#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates#Error_/_Incident Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates#Old_incidents https://wikitech.wikimedia.org/wiki/Npm_registry The @wikimedia org on npmjs.com is used to publish Node. Access controlhttps://wikitech.wikimedia.org/wiki/Npm_registry#Access_control Packageshttps://wikitech.wikimedia.org/wiki/Npm_registry#Packages See alsohttps://wikitech.wikimedia.org/wiki/Npm_registry#See_also External linkshttps://wikitech.wikimedia.org/wiki/Npm_registry#External_links https://wikitech.wikimedia.org/wiki/Npm npm may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Labels == This page contains a list of known labels used in the Toolforge Kubernetes cluster. == This page contains a list of known labels used in the Toolforge Kubernetes cluster.https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Labels#This_page_contains_a_list_of_known_labels_used_in_the_Toolforge_Kubernetes_cluster. https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57 == 2022-09-30 == 2022-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-30 2022-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-29 2022-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-28 2022-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-27 2022-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-26 2022-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-25 2022-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-23 2022-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-22 2022-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-21 2022-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-20 2022-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-19 2022-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-17 2022-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-16 2022-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-15 2022-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-14 2022-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-13 2022-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-12 2022-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-11 2022-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-10 2022-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-09 2022-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-08 2022-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-07 2022-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-06 2022-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-05 2022-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-04 2022-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-03 2022-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-02 2022-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#2022-09-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_57#Other_archives https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58 == 2022-10-31 == 2022-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-31 2022-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-29 2022-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-28 2022-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-27 2022-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-26 2022-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-25 2022-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-24 2022-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-22 2022-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-21 2022-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-20 2022-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-19 2022-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-18 2022-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-17 2022-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-15 2022-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-14 2022-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-13 2022-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-12 2022-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-11 2022-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-10 2022-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-08 2022-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-07 2022-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-06 2022-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-05 2022-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-04 2022-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-03 2022-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-02 2022-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#2022-10-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_58#Other_archives https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Queues/Queue_performance_log Tue 01 Nov 2022 11:58:53 PM UTC https://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook This is a list of runbooks for the Abstract Wikipedia Team, particularly the Wikifunctions services, covering step-by-step lists of what to do when things need doing, especially when things go wrong. How to disable execution in an emergencyhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#How_to_disable_execution_in_an_emergency Prevent logged-out users from running functionshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Prevent_logged-out_users_from_running_functions Prevent all users from running functionshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Prevent_all_users_from_running_functions Prevent service from accessing Wikidatahttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Prevent_service_from_accessing_Wikidata Back-end serviceshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Back-end_services What services?https://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#What_services? Deploy a config update to the orchestratorhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Deploy_a_config_update_to_the_orchestrator Deploy a new version of the orchestratorhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Deploy_a_new_version_of_the_orchestrator Disable an evaluator from being calledhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Disable_an_evaluator_from_being_called Add an evaluator to be calledhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Add_an_evaluator_to_be_called Deploy a config update update to an evaluatorhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Deploy_a_config_update_update_to_an_evaluator Deploy a new version of an evaluatorhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Deploy_a_new_version_of_an_evaluator Wikifunctions.org wikihttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Wikifunctions.org_wiki Add a new pre-defined Object in productionhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Add_a_new_pre-defined_Object_in_production Re-run the secondary data updates for a kind of Object in productionhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Re-run_the_secondary_data_updates_for_a_kind_of_Object_in_production How to monitor usagehttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#How_to_monitor_usage How to debug an issuehttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#How_to_debug_an_issue How to inspect Wikifunctions with Kubernetes toolshttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#How_to_inspect_Wikifunctions_with_Kubernetes_tools How to poke the orchestrator/evaluatorhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#How_to_poke_the_orchestrator/evaluator Thing that might go wronghttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Thing_that_might_go_wrong Beta Clusterhttps://wikitech.wikimedia.org/wiki/Wikifunctions/Runbook#Beta_Cluster https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Pending_transaction_resolver = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Pending_transaction_resolver#Overview Adyenhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Pending_transaction_resolver#Adyen Ingenicohttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Pending_transaction_resolver#Ingenico Diagramshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Pending_transaction_resolver#Diagrams Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Pending_transaction_resolver#Testing https://wikitech.wikimedia.org/wiki/Event_Platform/Producer_Requirements In order to ensure that Event Platform based event streams are automatically integratable with all consumers and downstream data systems, producers must ensure that the events satisify specific requirements before producing them. If you are using a supported WMF Event Platform producer service or library, these requirements should be satisified already. Requirementshttps://wikitech.wikimedia.org/wiki/Event_Platform/Producer_Requirements#Requirements Eventshttps://wikitech.wikimedia.org/wiki/Event_Platform/Producer_Requirements#Events Producer librarieshttps://wikitech.wikimedia.org/wiki/Event_Platform/Producer_Requirements#Producer_libraries Supported Event Platform producer clientshttps://wikitech.wikimedia.org/wiki/Event_Platform/Producer_Requirements#Supported_Event_Platform_producer_clients https://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-04_Swift_issues#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations#Overview Capability grid that was on homepagehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations#Capability_grid_that_was_on_homepage https://wikitech.wikimedia.org/wiki/SLO/WDQS Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Clients Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/WDQS#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/SLO/WDQS#Reconciliation https://wikitech.wikimedia.org/wiki/Aphlict Aphlict is a realtime-notification service used by Phabricator. Rebooting aphlict serverhttps://wikitech.wikimedia.org/wiki/Aphlict#Rebooting_aphlict_server https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener === Overview === Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Overview Adyenhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Adyen Amazonhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Amazon Braintreehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Braintree PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#PayPal Running IPN Listeners locallyhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Running_IPN_Listeners_locally Braintree - PayPalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Braintree_-_PayPal Dlocalhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/IPN_listener#Dlocal https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Redis = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Redis#Overview Performance Tracking (Formally on main page)https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Redis#Performance_Tracking_(Formally_on_main_page) https://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service All steps below assume you want to remove a service named service-foo from the clusters of the main (wikikube) group. 1. Destroy the service deploymentshttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#1._Destroy_the_service_deployments Staginghttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Staging Productionhttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Production Note: Ensure you have silenced alarms for your service, and removed LVS if necessaryhttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Note:_Ensure_you_have_silenced_alarms_for_your_service,_and_removed_LVS_if_necessary 2. Private data cleanuphttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#2._Private_data_cleanup Puppet: remove kubeconfig fileshttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Puppet:_remove_kubeconfig_files Puppermaster secretshttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Puppermaster_secrets 4. Remove the kubernetes service definitionshttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#4._Remove_the_kubernetes_service_definitions Preparing the commithttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Preparing_the_commit 1. Removing the namespacehttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#1._Removing_the_namespace 2. Remove your deploymenthttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#2._Remove_your_deployment 3. Review your changeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#3._Review_your_changes Deploy changes to helmfile.d/admin_nghttps://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#Deploy_changes_to_helmfile.d/admin_ng All Alright?https://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#All_Alright? 5. Remove the chart (if needed)https://wikitech.wikimedia.org/wiki/Kubernetes/Remove_a_service#5._Remove_the_chart_(if_needed) https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service = Toolforge Build Service Project = Toolforge Build Service Projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service#Toolforge_Build_Service_Project Abouthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service#About Backgroundhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service#Background Report a bughttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service#Report_a_bug https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview = Toolforge Build Service Project = Toolforge Build Service Projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Toolforge_Build_Service_Project Project Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Project_Overview Project organizationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Project_organization Success criteriahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Success_criteria Milestoneshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Milestones Beta user storieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Beta_user_stories How to read user storieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#How_to_read_user_stories Future milestoneshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Overview#Future_milestones https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports = Toolforge Build Service Project = Toolforge Build Service Projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#Toolforge_Build_Service_Project Reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#Reports Decision recordshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#Decision_records Ongoinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#Ongoing Decidedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#Decided Progress reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#Progress_reports 2023https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#2023 2022https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Reports#2022 https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM = CiviCRM (Drupal) = CiviCRM (Drupal)https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#CiviCRM_(Drupal) deploymenthttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#deployment drushhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#drush Troubleshooting setuphttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Troubleshooting_setup Log Tableshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Log_Tables Or best practiceshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Or_best_practices Running CiviCRM behind a firewallhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Running_CiviCRM_behind_a_firewall Getting data into CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Getting_data_into_CiviCRM Dedupinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Deduping Queue processing (coworker)https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Queue_processing_(coworker) Setting.create queue_paused1/Setting.create queue_paused=0 =====https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Setting.create_queue_paused1/Setting.create_queue_paused=0_===== Queue.runItemshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Queue.runItems Queue.runhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Queue.run Queue log outputhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Queue_log_output Automated emails from CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Automated_emails_from_CiviCRM Thank you , monthly convert, recurring failure notification and end of year email text & translationshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Thank_you_,_monthly_convert,_recurring_failure_notification_and_end_of_year_email_text_&_translations Money formatting in emailshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Money_formatting_in_emails CiviMail recordshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#CiviMail_records Manual emails from CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Manual_emails_from_CiviCRM Our CiviCRM customisationshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Our_CiviCRM_customisations Custom fieldshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Custom_fields Ensuring the fields are present in our dev environmentshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Ensuring_the_fields_are_present_in_our_dev_environments Update triggers on productionhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Update_triggers_on_production Creating extensions in Civicrm to manage tables in other WMFF Databaseshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases Performance trackinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Performance_tracking Queries & timinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Queries_&_timing Benchmarkinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Benchmarking Query trackinghttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Query_tracking Redis monitoringhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Redis_monitoring Code cleanupshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Code_cleanups Preferred Language (completed code cleanup)https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Preferred_Language_(completed_code_cleanup) Subpageshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM#Subpages https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Documentation = Toolforge Build Service Project = Toolforge Build Service Projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Documentation#Toolforge_Build_Service_Project Documentationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Documentation#Documentation Internalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Documentation#Internal Archived documents/pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Documentation#Archived_documents/pages Externalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Previous_Efforts/Toolforge_Build_Service/Documentation#External https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Fraud_filtering = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Fraud_filtering#Overview https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Payments = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Payments#Overview Upgrading MediaWikihttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Payments#Upgrading_MediaWiki Moved from main pagehttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Payments#Moved_from_main_page Translationshttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Payments#Translations https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts Reader Counts is a proposed metric to allow understanding of reader behaviour which will guide the future development of features for readers, the vast majority of whom are anonymous (not logged in). Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Overview Reader Cohortshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Reader_Cohorts Analytics Questionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Analytics_Questions Implementation Detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Implementation_Details Calculation of the Cohorthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Calculation_of_the_Cohort Calculate Cohorts Client-Sidehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Calculate_Cohorts_Client-Side Adding the Reader Cohort Dimension to Pageviewshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Adding_the_Reader_Cohort_Dimension_to_Pageviews Adding a Cohort to SessionLengthhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Adding_a_Cohort_to_SessionLength Generalisinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Generalising Considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Considerations Alternative Approachhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#Alternative_Approach Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/ReaderCounts#References https://wikitech.wikimedia.org/wiki/VRT_System/Customization == Local Customizations == Local Customizationshttps://wikitech.wikimedia.org/wiki/VRT_System/Customization#Local_Customizations Packageshttps://wikitech.wikimedia.org/wiki/VRT_System/Customization#Packages Buildinghttps://wikitech.wikimedia.org/wiki/VRT_System/Customization#Building Installinghttps://wikitech.wikimedia.org/wiki/VRT_System/Customization#Installing Errorshttps://wikitech.wikimedia.org/wiki/VRT_System/Customization#Errors https://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3 The Data Engineering team has now upgraded to Spark 3 and no longer supports Spark 2. The official date upon which support ceased was 31 March 2023. Spark 2 and Spark 3https://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3#Spark_2_and_Spark_3 There can be only onehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3#There_can_be_only_one Spark 2 deprecationhttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3#Spark_2_deprecation Impacthttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3#Impact Helphttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3#Help List of Spark 2 jobs to migratehttps://wikitech.wikimedia.org/wiki/Analytics/Archive/Spark/Migration_to_Spark_3#List_of_Spark_2_jobs_to_migrate https://wikitech.wikimedia.org/wiki/Phatality Phatality is an OpenSearch Dashboards plugin to easily associate errors with Phabricator Tasks. https://wikitech.wikimedia.org/wiki/SRE/Collaboration_Services/Documentation Incident response | Dashboards] | Runbooks | Architecture | User guides https://wikitech.wikimedia.org/wiki/VRT_System/Database The primary database is on the m2 shard, database named 'otrs'. https://wikitech.wikimedia.org/wiki/VRT_System/Configuration The source is being expanded in a version dependant directory under /opt, e.g. https://wikitech.wikimedia.org/wiki/VRT_System/Troubleshooting ==Troubleshooting == Troubleshootinghttps://wikitech.wikimedia.org/wiki/VRT_System/Troubleshooting#Troubleshooting Mail deliveryhttps://wikitech.wikimedia.org/wiki/VRT_System/Troubleshooting#Mail_delivery Apache permissions errorshttps://wikitech.wikimedia.org/wiki/VRT_System/Troubleshooting#Apache_permissions_errors SpamAssassin stops reporting Bayes resultshttps://wikitech.wikimedia.org/wiki/VRT_System/Troubleshooting#SpamAssassin_stops_reporting_Bayes_results https://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup ==Mail setup== Mail setuphttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#Mail_setup Spam and Malware scanninghttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#Spam_and_Malware_scanning Message tagginghttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#Message_tagging VRT mail routinghttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#VRT_mail_routing Outbound mailhttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#Outbound_mail ClamAVhttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#ClamAV SpamAssassinhttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#SpamAssassin /etc/default/spamassassinhttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#/etc/default/spamassassin /etc/spamassassin/local.cfhttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#/etc/spamassassin/local.cf SpamAssassin Traininghttps://wikitech.wikimedia.org/wiki/VRT_System/Mail_Setup#SpamAssassin_Training https://wikitech.wikimedia.org/wiki/VRT_System/Upgrading ==Upgrading== Upgradinghttps://wikitech.wikimedia.org/wiki/VRT_System/Upgrading#Upgrading https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/11 ==Week of November 07== Week of November 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/11#Week_of_November_07 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/11#=== Week of November 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/11#Week_of_November_14 Week of November 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/11#Week_of_November_21 Week of November 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/11#Week_of_November_28 https://wikitech.wikimedia.org/wiki/VRT_System/Installation == Installation == Installationhttps://wikitech.wikimedia.org/wiki/VRT_System/Installation#Installation https://wikitech.wikimedia.org/wiki/Cookies This page contains hard-won advice on the use of cookies in MediaWiki code deployed to Wikimedia wikis. But if you must…https://wikitech.wikimedia.org/wiki/Cookies#But_if_you_must… See alsohttps://wikitech.wikimedia.org/wiki/Cookies#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade We currently deploy OpenStack using Puppet and Debian Packages. Horizon is deployed from source, so the Horizon upgrade process is completely different. OpenStack componentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#OpenStack_components Coupling and dependencieshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Coupling_and_dependencies Staging the upgrade in puppethttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Staging_the_upgrade_in_puppet Upgrade the testing deployment (codfw1-dev)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrade_the_testing_deployment_(codfw1-dev) Upgrade the main deployment (eqiad1)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrade_the_main_deployment_(eqiad1) Upgrade steps (common to both deployments)https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrade_steps_(common_to_both_deployments) Upgrading Openstack API serviceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_Openstack_API_services Preparing for an upgradehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Preparing_for_an_upgrade Upgrading cloudservices nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_cloudservices_nodes Upgrading cloudcontrol nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_cloudcontrol_nodes Upgrading cloudnet nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_cloudnet_nodes Re-enable Horizonhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Re-enable_Horizon Upgrading cloudvirt nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_cloudvirt_nodes Finallyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Finally Upgrading Horizonhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_Horizon Staging the upgrade in githttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Staging_the_upgrade_in_git Upgrading labweb nodeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade#Upgrading_labweb_nodes https://wikitech.wikimedia.org/wiki/Docker-registry/jwt-authorizer The Docker registry also accepts authorization using JSON Web Tokens. This option was introduced to allow Trusted GitLab Runners to push images to the registry during CI builds ([nginx on the registry is configured to accept jwt from a list of allowed IPs (profile::docker_registry_ha::registry::jwt_allowed_ips). Building a new versionhttps://wikitech.wikimedia.org/wiki/Docker-registry/jwt-authorizer#Building_a_new_version Publish a new versionhttps://wikitech.wikimedia.org/wiki/Docker-registry/jwt-authorizer#Publish_a_new_version https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting The Toolforge monthly meeting is a one-hour engineering-focused meeting to discuss the current state and the future plans of Toolforge, to unblock some decisions or to get everyone on the same page. It is currently held on the first Tuesday of every month at 17:30 CE(S)T. Next meeting agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting#Next_meeting_agenda Former meeting minuteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting#Former_meeting_minutes https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15 = Toolforge Workgroupmeeting 2022-11-15 notes = Toolforge Workgroupmeeting 2022-11-15 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Toolforge_Workgroupmeeting_2022-11-15_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Notes Did we finish discussing a looser approach accepting changes to toolforge docker images?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Did_we_finish_discussing_a_looser_approach_accepting_changes_to_toolforge_docker_images? Idea to rewrite parts of toolforge-cli in golang (from python)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Idea_to_rewrite_parts_of_toolforge-cli_in_golang_(from_python) Decision request / Enhancement proposal: https://phabricator.wikimedia.org/T320667 Toolforge Kubernetes component workflow improvements.https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Decision_request_/_Enhancement_proposal:_https://phabricator.wikimedia.org/T320667_Toolforge_Kubernetes_component_workflow_improvements. Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-11-15#Action_items https://wikitech.wikimedia.org/wiki/Primary_database_switchover See Switch master/Archive for the previous version. Updateshttps://wikitech.wikimedia.org/wiki/Primary_database_switchover#Updates Stepshttps://wikitech.wikimedia.org/wiki/Primary_database_switchover#Steps https://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Rationale == Problem statement == Problem statementhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Rationale#Problem_statement Todayhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Rationale#Today Pontoonhttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Rationale#Pontoon Benefitshttps://wikitech.wikimedia.org/wiki/Puppet/Pontoon/Rationale#Benefits https://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Detection After the fact graphshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#After_the_fact_graphs Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-17_Gerrit_3.5_upgrade#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases ===== Overview ===== Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases#Overview Create Extensionhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases#Create_Extension Create Entity from scratchhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases#Create_Entity_from_scratch Create entity from an already existing table on a different databasehttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases#Create_entity_from_an_already_existing_table_on_a_different_database Related Topicshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Creating_extensions_in_Civicrm_to_manage_tables_in_other_WMFF_Databases#Related_Topics https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Create_Custom_Formbuilder_pages_to_monitor_tables_in_other_WMFF_Databases Having created the custom extension and entity on CiviCRM, the next step to make all that work useful would be to create a page to view the data in the table. CiviCRM allows the combination of Form Builder (Afform) and Searchkit searches to build layouts and forms. Generating a SearchKit table to query the Databasehttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Create_Custom_Formbuilder_pages_to_monitor_tables_in_other_WMFF_Databases#Generating_a_SearchKit_table_to_query_the_Database Creating a FormBuilder pagehttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Create_Custom_Formbuilder_pages_to_monitor_tables_in_other_WMFF_Databases#Creating_a_FormBuilder_page Adding Filters to the FormBuilder pagehttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Create_Custom_Formbuilder_pages_to_monitor_tables_in_other_WMFF_Databases#Adding_Filters_to_the_FormBuilder_page More about the FormBuilder form configuration pagehttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Create_Custom_Formbuilder_pages_to_monitor_tables_in_other_WMFF_Databases#More_about_the_FormBuilder_form_configuration_page Related Topicshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Create_Custom_Formbuilder_pages_to_monitor_tables_in_other_WMFF_Databases#Related_Topics https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Exporting_SearchKit_Search_into_an_extension This is necessary, if the extension is designed to be reused and the search is an integral aspect of the usability of the form. The following steps would describe how to ensure a SearchKit search is packaged into a custom extension. Related Topics:https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Exporting_SearchKit_Search_into_an_extension#Related_Topics: https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Exporting_FormBuilder_Pages_into_an_extension Like the SearchKit Search export, this would also be helpful if the extension by which the FormBuilder page is built on was designed to be reusable. The following steps would describe how to ensure a FormBuilder page is packaged into a custom extension. Related Topics:https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Exporting_FormBuilder_Pages_into_an_extension#Related_Topics: https://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki Multi-DC MediaWiki (also known as, Active-active MediaWiki) is a cross-cutting project driven by the Performance Team to give MediaWiki the ability to serve read requests from multiple datacenters. Initial work (2014-2016)https://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Initial_work_(2014-2016) RFChttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#RFC JobQueuehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#JobQueue WANObjectCachehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#WANObjectCache MariaDB lag indicationhttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#MariaDB_lag_indication Media storagehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Media_storage Searchhttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Search Incremental progresshttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Incremental_progress DC independencehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#DC_independence Mcrouterhttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Mcrouter CDN purginghttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#CDN_purging Thumbnail servinghttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Thumbnail_serving Media originals servinghttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Media_originals_serving Remaining work (2020-2022)https://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Remaining_work_(2020-2022) ChronologyProtectorhttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#ChronologyProtector Session storagehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Session_storage CentralAuth storagehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#CentralAuth_storage Main Stash storehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Main_Stash_store MariaDB cross-datacenter secure writeshttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#MariaDB_cross-datacenter_secure_writes ResourceLoader file dependency storehttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#ResourceLoader_file_dependency_store CDN routinghttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#CDN_routing Further readinghttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#Further_reading Historyhttps://wikitech.wikimedia.org/wiki/Performance/Multi-DC_MediaWiki#History https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Donor_Data_Delivery_Tool = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/Donor_Data_Delivery_Tool#Overview https://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#What_went_poorly? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-08-26_Phabricator_login_issues#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy Origin task: [of the decision: 2022-11-22 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Problem Constraints and Riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Constraints_and_Risks Proposals:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Proposals: Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Option_1 Proshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Pros Conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Cons Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T321798_gitlab_cloud_repos_merge_strategy#Option_4 https://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-22_wdqs_outage#Scorecard https://wikitech.wikimedia.org/wiki/Benthos Benthos defines itself as fancy stream processing made operationally mundane. Benthos on centralloghttps://wikitech.wikimedia.org/wiki/Benthos#Benthos_on_centrallog Benthos on cache hostshttps://wikitech.wikimedia.org/wiki/Benthos#Benthos_on_cache_hosts How to add a new instancehttps://wikitech.wikimedia.org/wiki/Benthos#How_to_add_a_new_instance https://wikitech.wikimedia.org/wiki/Monitoring/sre.puppet.sync-netbox-hiera.timer == What it does == What it doeshttps://wikitech.wikimedia.org/wiki/Monitoring/sre.puppet.sync-netbox-hiera.timer#What_it_does What to dohttps://wikitech.wikimedia.org/wiki/Monitoring/sre.puppet.sync-netbox-hiera.timer#What_to_do https://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts = Deployment Charts = Deployment Chartshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Deployment_Charts Helm Chartshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Helm_Charts Common Templateshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Common_Templates Enabling egress to services external to Kuberneteshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Enabling_egress_to_services_external_to_Kubernetes Install the external-services helm templatehttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Install_the_external-services_helm_template In a new charthttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#In_a_new_chart In an existing charthttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#In_an_existing_chart Select what services you want to enable egress tohttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Select_what_services_you_want_to_enable_egress_to Testing a Charthttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Testing_a_Chart Quick testshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#Quick_tests CI testshttps://wikitech.wikimedia.org/wiki/Kubernetes/Deployment_Charts#CI_tests https://wikitech.wikimedia.org/wiki/Kubernetes/Administration == Create a new cluster == Create a new clusterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Create_a_new_cluster Add a new servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Add_a_new_service Remove a servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Remove_a_service Managing pool status of a worker nodehttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Managing_pool_status_of_a_worker_node Rebooting control plane nodeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Rebooting_control_plane_nodes Rebooting worker nodeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Rebooting_worker_nodes The way of the cookbook (recommended)https://wikitech.wikimedia.org/wiki/Kubernetes/Administration#The_way_of_the_cookbook_(recommended) The polite wayhttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#The_polite_way The impolite wayhttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#The_impolite_way Drain a dead nodehttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Drain_a_dead_node Restarting specific componentshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Restarting_specific_components Restarting the API serverhttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Restarting_the_API_server Switch the active staging cluster (eqiad<->codfw)https://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Switch_the_active_staging_cluster_(eqiadcodfw) Managing pods, jobs and cronjobshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Managing_pods,_jobs_and_cronjobs Listing cronjobs, jobs and podshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Listing_cronjobs,_jobs_and_pods Deleting a jobhttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Deleting_a_job Updating the docker image run by a CronJobhttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Updating_the_docker_image_run_by_a_CronJob Recreate pods (of deployments, daemonsets, statefulsets, ...)https://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Recreate_pods_(of_deployments,_daemonsets,_statefulsets,_...) Running a rolling restart of a Helmfile servicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Running_a_rolling_restart_of_a_Helmfile_service Tips and trickshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Tips_and_tricks Isolate a pod from traffic and deploymentshttps://wikitech.wikimedia.org/wiki/Kubernetes/Administration#Isolate_a_pod_from_traffic_and_deployments https://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network) = Network QoS = Network QoShttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Network_QoS QoS in Wikimediahttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#QoS_in_Wikimedia QoS Classeshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#QoS_Classes Scheduling Bandwidthhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Scheduling_Bandwidth DSCP Markinghttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#DSCP_Marking Trusted vs Untrusted Interfaceshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Trusted_vs_Untrusted_Interfaces Traffic Classeshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Traffic_Classes Management & Controlhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Management_&_Control High Priorityhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#High_Priority Normal Priorityhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Normal_Priority Low Priorityhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Low_Priority Puppethttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Puppet More Complex Configurationshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#More_Complex_Configurations Guidelines for SREshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Guidelines_for_SREs Juniper Class-of-Servicehttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Juniper_Class-of-Service Queues and Forwarding-Classeshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Queues_and_Forwarding-Classes Classifiershttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Classifiers DSCP Classifiershttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#DSCP_Classifiers Interface Classifier Configurationhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Interface_Classifier_Configuration Schedulershttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Schedulers Scheduler Mapshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Scheduler_Maps Outbound Shapershttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Outbound_Shapers Interface Confighttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Interface_Config Troubleshootinghttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Troubleshooting Classificationhttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Classification Outbound Dropshttps://wikitech.wikimedia.org/wiki/Quality_of_Service_(Network)#Outbound_Drops https://wikitech.wikimedia.org/wiki/Phab1004 phab1004 is the production Phabricator server. Connectinghttps://wikitech.wikimedia.org/wiki/Phab1004#Connecting https://wikitech.wikimedia.org/wiki/Gitlab2002 gitlab2002 is a production Gitlab server (along with Gitlab1003/Gitlab1004 in eqiad) and (soon) Gitlab2003 in codfw. Connectinghttps://wikitech.wikimedia.org/wiki/Gitlab2002#Connecting Ticketshttps://wikitech.wikimedia.org/wiki/Gitlab2002#Tickets https://wikitech.wikimedia.org/wiki/Gitlab2003 gitlab2003 will be a production Gitlab server (along with Gitlab1003/Gitlab1004 in eqiad) and Gitlab2002 in codfw. Connectinghttps://wikitech.wikimedia.org/wiki/Gitlab2003#Connecting Ticketshttps://wikitech.wikimedia.org/wiki/Gitlab2003#Tickets https://wikitech.wikimedia.org/wiki/Gitlab1003 gitlab1003 is a production Gitlab server (along with Gitlab1004 in eqiad) and Gitlab2002/Gitlab2003 in codfw. Connectinghttps://wikitech.wikimedia.org/wiki/Gitlab1003#Connecting Ticketshttps://wikitech.wikimedia.org/wiki/Gitlab1003#Tickets https://wikitech.wikimedia.org/wiki/Gitlab1004 gitlab1004 is a production Gitlab server (along with Gitlab1003 in eqiad) and Gitlab2002/Gitlab2003 in codfw. Connectinghttps://wikitech.wikimedia.org/wiki/Gitlab1004#Connecting Ticketshttps://wikitech.wikimedia.org/wiki/Gitlab1004#Tickets https://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-15_asw1-eqsin#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59 == 2022-11-15 == 2022-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-15 2022-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-14 2022-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-12 2022-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-11 2022-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-10 2022-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-09 2022-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-08 2022-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-07 2022-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-06 2022-11-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-05 2022-11-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-04 2022-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-03 2022-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-02 2022-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#2022-11-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_59#Other_archives https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60 == 2022-11-30 == 2022-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-30 2022-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-29 2022-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-28 2022-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-27 2022-11-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-26 2022-11-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-25 2022-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-24 2022-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-23 2022-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-22 2022-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-21 2022-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-20 2022-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-19 2022-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-18 2022-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-17 2022-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#2022-11-16 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_60#Other_archives https://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-11-03_conf_disk_space#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/notes/Magnum_POC_for_release_engineering TODO: see [| phab:T324156 - Explore Openstack Magnum release engineering use case] https://wikitech.wikimedia.org/wiki/Search/Cloudvirt-wdqs == Cloudvirt-wdqs hosts == Cloudvirt-wdqs hostshttps://wikitech.wikimedia.org/wiki/Search/Cloudvirt-wdqs#Cloudvirt-wdqs_hosts Operations Ownershiphttps://wikitech.wikimedia.org/wiki/Search/Cloudvirt-wdqs#Operations_Ownership Current Statehttps://wikitech.wikimedia.org/wiki/Search/Cloudvirt-wdqs#Current_State https://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Timeline Metricshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Metrics Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-02_wdqs_outage#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide [WIP] Before on-call dutyhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide#Before_on-call_duty During on-call dutyhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide#During_on-call_duty On call schedule 2022https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide#On_call_schedule_2022 Fail Mailhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide#Fail_Mail How to take down bannershttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide#How_to_take_down_banners Other documentationhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/On-call_guide#Other_documentation https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts = Ongoing Efforts = Ongoing Effortshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts#Ongoing_Efforts https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing If you are looking to contribute to the Toolforge project itself, you are welcome! Where is the source code?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing#Where_is_the_source_code? Work on a single task, fix a bug, add/improve some docs or implement a small featurehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing#Work_on_a_single_task,_fix_a_bug,_add/improve_some_docs_or_implement_a_small_feature Work with us on specific effortshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing#Work_with_us_on_specific_efforts Propose something new or improve an existing systemhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing#Propose_something_new_or_improve_an_existing_system Join Toolforge Workgroup meetingshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing#Join_Toolforge_Workgroup_meetings Get in touch!https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Contributing#Get_in_touch! https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Chaos_crew_handover When leaving the Chaos Crew rotation, the Primary DRI engineer is expected to provide a summary to the team covering the preceding two weeks of Chaos Crew work . This should also help the new Secondary DRI engineer get up to speed with current issues. https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_MediaWiki_REST_API#Scorecard https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/12 ==Week of December 05== Week of December 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/12#Week_of_December_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/12#=== Week of December 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/12#Week_of_December_12 Week of December 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/12#Week_of_December_19 Week of December 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2022/12#Week_of_December_26 https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar/2023 See also the calendars for 2022 and for 2024. https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Detection Alertshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Alerts Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-09_api_appserver_worker_starvation#Scorecard https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work When working remotely as a team (we are all remoties!), it is especially important to 'share our work' in writing. tl;drhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#tl;dr Whyhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Why Wherehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Where Wikishttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Wikis Phabricatorhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Phabricator Code reviewhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Code_review Meetings, chat, and emailhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Meetings,_chat,_and_email Google docshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Google_docs Examplehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Share_our_work#Example https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration For the public-facing documentation, see Superset. Superset Kubernetes Readiness Checklisthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Superset_Kubernetes_Readiness_Checklist Designhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Design OIDC loginhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#OIDC_login Role mappinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Role_mapping User details updatehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#User_details_update Cachinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Caching Static assets servinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Static_assets_serving requestctl-generatorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#requestctl-generator Metricshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Metrics Alertinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Alerting The app isn't runninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#The_app_isn't_running How tohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#How_to Deploy the applicationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Deploy_the_applications superset-nexthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#superset-next supersethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#superset Exec into the superset containerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Exec_into_the_superset_container Use the superset clihttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Use_the_superset_cli Perform a database upgradehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Perform_a_database_upgrade Sync the staging database with the production onehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Sync_the_staging_database_with_the_production_one Enable an additional feature flaghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Enable_an_additional_feature_flag Add a specific Superset config flaghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Add_a_specific_Superset_config_flag Rebuild the docker imageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Rebuild_the_docker_images Upgrade Supersethttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Upgrade_Superset Test a different role's permissionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Superset/Administration#Test_a_different_role's_permissions https://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-13_sessionstore#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13 = Toolforge Workgroup meeting 2022-12-13 notes = Toolforge Workgroup meeting 2022-12-13 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#Toolforge_Workgroup_meeting_2022-12-13_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#Notes buildpackshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#buildpacks Toolforge design docshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#Toolforge_design_docs k8s upgrade cadencehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#k8s_upgrade_cadence Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2022-12-13#Action_items https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging Since 2022, all Cloud VPS instances forward authentication-related events to a set of syslog servers for security reasons. Forwarding these events to a remote machine mitigates various scenarios where attackers hide their actions by tampering with log files. Architecturehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Architecture Clienthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Client Serverhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Server Security considerationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Security_considerations Searching through the messageshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Searching_through_the_messages Adminstrationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Adminstration Switching syslog servershttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Switching_syslog_servers Known limitationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Known_limitations Miscellaneoushttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Auth_logging#Miscellaneous https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes MediaWiki-on-Kubernetes (or mw-on-k8s for short) is an initiative to transition the MediaWiki at WMF deployment from dedicated Application servers to Kubernetes. This page contains information about what is changing as part of this transition. Motivationhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Motivation What traffic is currently served by MediaWiki on k8shttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#What_traffic_is_currently_served_by_MediaWiki_on_k8s External traffichttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#External_traffic Exceptionshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Exceptions Internal traffichttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Internal_traffic Jobshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Jobs Server groupshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Server_groups What is in a MediaWiki podhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#What_is_in_a_MediaWiki_pod How to manage changes to the infrastructurehttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#How_to_manage_changes_to_the_infrastructure How to deploy MediaWiki on Kuberneteshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#How_to_deploy_MediaWiki_on_Kubernetes Add a mw-on-k8s deploymenthttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Add_a_mw-on-k8s_deployment to scaphttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#to_scap to the cookbookshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#to_the_cookbooks Manual deploymenthttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Manual_deployment Automatic deploymenthttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Automatic_deployment Full image rebuild and deploymenthttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Full_image_rebuild_and_deployment No image build deployment (helmfile only)https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#No_image_build_deployment_(helmfile_only) The scap wayhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#The_scap_way The bash wayhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#The_bash_way Troubleshootinghttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Troubleshooting Dashboardshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Dashboards Logshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Logs Graphshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Graphs MediaWiki REPLhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#MediaWiki_REPL Get a shell on a production podhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Get_a_shell_on_a_production_pod strace a production PHP processhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#strace_a_production_PHP_process https://wikitech.wikimedia.org/wiki/Country_protection_list https://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-12_wdqs_codfw_brief_outage#Scorecard https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/URL_parameters = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/URL_parameters#Overview https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#What_happens_when_a_project_is_not_marked_as_active Further clueshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#Further_clues Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#Projects_and_Instances account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#account-creation-assistance adminhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#admin admin-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#admin-monitoring analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#analytics appservershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#appservers auditlogginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#auditlogging automation-frameworkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#automation-framework baglama2https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#baglama2 baserowhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#baserow bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#bastion canastahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#canasta capacity-exchangehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#capacity-exchange centralnotice-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#centralnotice-staging chathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#chat citelearnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#citelearn clouddb-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#clouddb-services cloudinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#cloudinfra cloudinfra-nfshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#cloudinfra-nfs cloudvirt-canaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#cloudvirt-canary codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#codereview codesearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#codesearch collection-alt-rendererhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#collection-alt-renderer commons-corruption-checkerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#commons-corruption-checker commonsarchivehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#commonsarchive commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#commtech cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#cvn Always cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#Always_cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#dashiki data-engineeringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#data-engineering deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#deployment-prep devportalhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#devportal devtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#devtools discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#discourse downloadhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#download dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#dwl entity-detectionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#entity-detection etytreehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#etytree eventmetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#eventmetrics extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#fastcci fr-tech-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#fr-tech-dev getstartedhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#getstarted gitlab-runnershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#gitlab-runners gitlab-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#gitlab-test glamshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#glams glamwikidashboardhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#glamwikidashboard globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#google-api-proxy gratitudehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#gratitude hashtagshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#hashtags hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#huggle huwiki-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#huwiki-dev idm-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#idm-dev iiabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#iiab image-suggestion-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#image-suggestion-api incubatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#incubator integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#integration ircwebchathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#ircwebchat isahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#isa k8splayhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#k8splay languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#language ldap-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#ldap-dev library-upgraderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#library-upgrader linkwatcherhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#linkwatcher logginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#logging lta-trackerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#lta-tracker machine-learninghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#machine-learning mailmanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mailman mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#maps maps-experimentshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#maps-experiments mariadb104-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mariadb104-test maszhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#masz mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#math matrixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#matrix mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mediawiki-vagrant meethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#meet metricsinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#metricsinfra mix-n-matchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mix-n-match ml-collab-2022https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#ml-collab-2022 mobilehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mobile monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#monitoring mwclihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mwcli mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mwoffliner mwstakehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mwstake mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#mwv-apt netops-clabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#netops-clab observerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#observer ocrtoyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#ocrtoy onfirehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#onfire openocrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#openocr openstackhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#openstack osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#osmit owidmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#owidm packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#packaging packagist-mirrorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#packagist-mirror pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#paws petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#petscan pkihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#pki pluggableauthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#pluggableauth procbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#procbot project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#project-proxy puppet-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#puppet-dev puppet-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#puppet-diffs qrankhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#qrank quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#quarry rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#rcm reading-web-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#reading-web-staging recommendation-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#recommendation-api redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#redirects research-collaborations-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#research-collaborations-api schematreerecommenderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#schematreerecommender sciencesourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#sciencesource searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#search - security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#-_security-tools servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#service serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#services shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#signwriting soweegohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#soweego spi-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#spi-tools sre-sandboxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#sre-sandbox ssohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#sso strikerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#striker suggestbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#suggestbot swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#swift terraformhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#terraform testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#testlabs text-to-speechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#text-to-speech teyorahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#teyora toolhubhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#toolhub toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#toolsbeta traffichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#traffic trovehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#trove twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#twl utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#utrs videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#video videocuttoolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#videocuttool videowikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#videowiki visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#visualeditor wcdohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wcdo webperfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#webperf wikiapiaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikiapiary wikibase-registryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikibase-registry wikicitehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikicite wikicommunityhealthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikicommunityhealth wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikidata-dev wikidata-history-query-servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikidata-history-query-service wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikidata-query wikidata-reconciliationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikidata-reconciliation wikidocumentarieshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikidocumentaries wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikidumpparse wikifunctionshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikifunctions wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikilabels wikilearnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikilearn wikilinkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikilink wikiloophttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikiloop wikinewsiehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikinewsie wikipathwayshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikipathways wikisourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikisource wikisphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikisp wikispeechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikispeech wikisporehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikispore wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikistats wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikitextexp wikiwhohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wikiwho wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wildcat wlm-it-visualhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wlm-it-visual wm-bothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wm-bot wmcs-uptimehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmcs-uptime wmcz-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmcz-stats wmde-dashboardshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmde-dashboards wmde-templates-alphahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmde-templates-alpha wmdeanalyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmdeanalytics wmf-dumps-playgroundhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmf-dumps-playground wmf-research-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmf-research-tools wmflabsdotorghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#wmflabsdotorg xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#xtools https://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-21_shellbox-syntaxhighlight#Scorecard https://wikitech.wikimedia.org/wiki/SLO/Runbook == Establishing a new SLO == Establishing a new SLOhttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Establishing_a_new_SLO Draftinghttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Drafting Publicationhttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Publication Updating an SLOhttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Updating_an_SLO Tighteninghttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Tightening Looseninghttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Loosening Other changeshttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Other_changes List of responsible teamshttps://wikitech.wikimedia.org/wiki/SLO/Runbook#List_of_responsible_teams When an SLO is missedhttps://wikitech.wikimedia.org/wiki/SLO/Runbook#When_an_SLO_is_missed Aspirational SLOshttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Aspirational_SLOs Things we don't do: Intentionally burning error budgethttps://wikitech.wikimedia.org/wiki/SLO/Runbook#Things_we_don't_do:_Intentionally_burning_error_budget https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep It has been nearly a decade since Toolforge came online. Since then, there have a been a lot of improvements to tool infrastructure, but many tools have not yet caught up. How it workshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep#How_it_works Checklisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep#Checklist Why do this?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep#Why_do_this? For maintainershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep#For_maintainers Positive feedbackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep#Positive_feedback Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep#Participants https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1 == rfa-tool == rfa-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rfa-tool data-design-demohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#data-design-demo veblenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#veblenbot proneval-gsoc17https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#proneval-gsoc17 whopaintedthishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#whopaintedthis positionholderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#positionholder wnegarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wnegar ushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#us referencebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#referencebot steve-adderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#steve-adder hiwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#hiwiki ims-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ims-bot wdgraphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wdgraph gratitudehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gratitude rust-hello-worldhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rust-hello-world comprendehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#comprende fatghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#fatg uarchivebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#uarchivebot william-avery-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#william-avery-bot mwpackageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#mwpackages satorihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#satori imagecheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#imagechecker ninjastrikershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ninjastrikers wiwosmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wiwosm raymond-pywikibot-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#raymond-pywikibot-tool mdaniels-licencehelperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#mdaniels-licencehelper pixelreportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#pixelreports tool-log-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#tool-log-stats video-cut-tool-back-endhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#video-cut-tool-back-end commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#commons wmtranhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wmtran coordhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#coord afdstats2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#afdstats2 superzerocoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#superzerocool pdfreaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#pdfreader nullbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#nullbot rc-discordhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rc-discord xecforkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#xecfork ruarbcomhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ruarbcom qrankhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#qrank botorderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#botorder upload-stats-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#upload-stats-bot archive-things-3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#archive-things-3 il-generalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#il-general povocontahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#povoconta tabernaclehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#tabernacle phpcshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#phpcs test-commonsreconcilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#test-commonsreconcile awstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#awstats rillke-nodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rillke-node meetingtimeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#meetingtimes zppixbot-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#zppixbot-test devyshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#devys citationhunthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#citationhunt wlhhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wlh farticlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#farticle incolabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#incolabot wiki-todohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wiki-todo esbackuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#esbackup image-resize-calchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#image-resize-calc gerakitoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gerakitools catcomparehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#catcompare zurichpopulationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#zurichpopulation vichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#vic orwell02https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#orwell02 yjswhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#yjsw hoiscripthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#hoiscript grephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#grep robins7bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#robins7bot wb2rdfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wb2rdf mathis-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#mathis-bot schoolwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#schoolwiki randomincategoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#randomincategory serobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#serobot acc-utilitieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#acc-utilities wikifactmine-pipelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikifactmine-pipeline booktoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#booktool wikidata-janitorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikidata-janitor jarallah-iihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#jarallah-ii shortnameshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#shortnames rfc-analyzerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rfc-analyzer warped-to-iframehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#warped-to-iframe thanatoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#thanatos wmpthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wmpt categoriehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#categorie dynbot-srv2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#dynbot-srv2 sourcemdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#sourcemd alessiobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#alessiobot asurabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#asurabot agpb-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#agpb-api luke081515bot-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#luke081515bot-beta blockloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#blocklog peacock-finderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#peacock-finder phabuloushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#phabulous uploadhelper-irhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#uploadhelper-ir geodatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#geodata krinkle-redirecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#krinkle-redirect archivesrcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#archivesrcbot klaxonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#klaxon lrtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#lrtools train-blockershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#train-blockers project-fahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#project-fa wsexport-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wsexport-test sigmahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#sigma inaturalistreviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#inaturalistreviewer vip-space-mediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#vip-space-media static-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#static-browser largedatasetbot-regularhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#largedatasetbot-regular url-converterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#url-converter growth-mentor-dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#growth-mentor-dashboard interpagelinkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#interpagelinker vartanihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#vartani rkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rkbot khebihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#khebi myrcxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#myrcx global-pandashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#global-pandas plaintexteditcounterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#plaintexteditcounter jitrixis-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#jitrixis-test dumpscanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#dumpscan ust1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ust1 babhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#bab shexiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#shexia wikiapertahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikiaperta abricothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#abricot vrbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#vrb import-freemindhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#import-freemind codexbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#codexbot ipphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ipp sybot51https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#sybot51 edcounterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#edcounter gun-wdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gun-wd wpvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wpv qichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#qic scottytoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#scottytools wiki-user-contributionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wiki-user-contributions listpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#listpages neechalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#neechal lucaswerkmeister-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#lucaswerkmeister-test un-ocha-mapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#un-ocha-maps test-music1201https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#test-music1201 pubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#pub hylabelshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#hylabels file-siblingshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#file-siblings pygmentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#pygments simplecommonstransferhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#simplecommonstransfer blockcalchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#blockcalc nakonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#nakon deskana2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#deskana2 logoscopehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#logoscope tsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#tsbot bunykbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#bunykbot itemsubjectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#itemsubjector dbreps-ukhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#dbreps-uk wikipedia-zh-irc-queryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikipedia-zh-irc-query entityschema-generatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#entityschema-generator ash-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ash-dev kanzatgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#kanzatgroup wikistatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikistats wiki-irchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wiki-irc ft5-darqahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ft5-darqa retractionbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#retractionbot yfdyh-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#yfdyh-bot secwatchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#secwatch titlehistoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#titlehistory commons-delinquenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#commons-delinquent gerrit-patch-uploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gerrit-patch-uploader wikitabshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikitabs ios-crasheshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ios-crashes crawlerbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#crawlerbot pybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#pybot papayatesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#papayatest mp-counthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#mp-count gabrielchihonglee-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gabrielchihonglee-bot merlbot-readhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#merlbot-read unwatchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#unwatch norefhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#noref vltoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#vltools kanjybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#kanjybot gennfshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gennfs femiwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#femiwiki unblockmehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#unblockme tomthirteenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#tomthirteen base-php-clihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#base-php-cli harvesting-data-refineryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#harvesting-data-refinery mwp-testinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#mwp-testing globaleditcounterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#globaleditcounter userrankhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#userrank wmf-sitematrixhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wmf-sitematrix shabdanumanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#shabdanuman revibot-iihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#revibot-ii g13bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#g13bot gsoc-ifttt-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gsoc-ifttt-dev autoformat-enwikthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#autoformat-enwikt wd-image-positionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wd-image-positions toolpilothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#toolpilot idwiki-gpuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#idwiki-gpu arelphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#arelph cbenchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#cbench zerabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#zerabot cerseihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#cersei notebookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#notebooks ipinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ipinfo commonsreconcilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#commonsreconcile category-by-uploadershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#category-by-uploaders deadlinkfinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#deadlinkfinder quick-intersectionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#quick-intersection commons-app-webhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#commons-app-web ruwn-mischttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ruwn-misc protectorathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#protectorat khanamalumathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#khanamalumat searchstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#searchstats tarrow-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#tarrow-dev osmlinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#osmlint samoabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#samoabot srishhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#srish bayshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#bays nullzerobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#nullzerobot boosterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#booster wikicuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikicup wikipathways-datahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikipathways-data grantmakinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#grantmaking globalsearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#globalsearch iepcbm-bot-2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#iepcbm-bot-2 top25report-sitehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#top25report-site raymondhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#raymond contentcontributorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#contentcontributor discordwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#discordwiki zhwp-afc-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#zhwp-afc-bot templatecounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#templatecount nullzerohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#nullzero ru-monumentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ru-monuments bingohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#bingo wikidatagrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikidatagroup costarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#costar lingua-libre-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#lingua-libre-bot cbng-sql-3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#cbng-sql-3 videoconvertionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#videoconvertion wiktionnaire-anagrammeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wiktionnaire-anagrammes robokobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#robokobot new-uploads-refresherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#new-uploads-refresher balasankarchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#balasankarc doi-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#doi-bot local-reference-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#local-reference-api pathway-viewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#pathway-viewer wikilambda-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wikilambda-beta description-editshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#description-edits info-farmerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#info-farmer gendergapdashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#gendergapdashboard svgedithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#svgedit cipherbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#cipherbot spbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#spbot helpearwigbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#helpearwigbot wd-word-cloudhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#wd-word-cloud svgcheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#svgcheck ircredirectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#ircredirector contribgraphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#contribgraph roundtrippinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#roundtripping nokib-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#nokib-bot searchdiffhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#searchdiff enetthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#enett rebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#rebot libhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#lib facebook-messenger-chatbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#facebook-messenger-chatbot discobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#discobot monohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#mono depictshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#depicts huwptlisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/1#huwptlist https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61 == 2022-12-31 == 2022-12-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-31 2022-12-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-30 2022-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-29 2022-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-22 2022-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-21 2022-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-20 2022-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-19 2022-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-18 2022-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-17 2022-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-16 2022-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-15 2022-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-14 2022-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-13 2022-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-12 2022-12-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-10 2022-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-09 2022-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-08 2022-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-07 2022-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-06 2022-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-05 2022-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-04 2022-12-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-03 2022-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-02 2022-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#2022-12-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_61#Other_archives https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8 == 2022-12-30 == 2022-12-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-30 2022-12-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-27 2022-12-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-20 2022-12-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-19 2022-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-17 2022-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-15 2022-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-14 2022-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-13 2022-12-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-12 2022-12-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-09 2022-12-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-08 2022-12-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-07 2022-12-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-06 2022-12-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-02 2022-12-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-12-01 2022-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-30 2022-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-29 2022-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-27 2022-11-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-25 2022-11-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-23 2022-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-22 2022-11-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-21 2022-11-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-18 2022-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-17 2022-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-16 2022-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-15 2022-11-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-14 2022-11-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-10 2022-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-09 2022-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-08 2022-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-07 2022-11-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-03 2022-11-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-11-02 2022-10-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-31 2022-10-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-28 2022-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-27 2022-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-26 2022-10-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-25 2022-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-24 2022-10-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-21 2022-10-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-20 2022-10-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-19 2022-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-18 2022-10-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-17 2022-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-14 2022-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-13 2022-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-12 2022-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-11 2022-10-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-10 2022-10-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-08 2022-10-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-07 2022-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-06 2022-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-05 2022-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-04 2022-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-10-03 2022-09-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-30 2022-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-29 2022-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-28 2022-09-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-27 2022-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-26 2022-09-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-23 2022-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-22 2022-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-21 2022-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-20 2022-09-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-19 2022-09-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-16 2022-09-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-15 2022-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-13 2022-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-12 2022-09-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-09 2022-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-08 2022-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-07 2022-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-06 2022-09-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-02 2022-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-09-01 2022-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-31 2022-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-30 2022-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-29 2022-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-25 2022-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-23 2022-08-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-22 2022-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-21 2022-08-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-19 2022-08-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-18 2022-08-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-17 2022-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-16 2022-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-12 2022-08-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-11 2022-08-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-10 2022-08-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-09 2022-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-08 2022-08-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-05 2022-08-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-04 2022-08-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-03 2022-08-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-02 2022-08-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-08-01 2022-07-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-29 2022-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-28 2022-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-27 2022-07-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-25 2022-07-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-23 2022-07-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-21 2022-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-20 2022-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-19 2022-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-18 2022-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-17 2022-07-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-16 2022-07-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-15 2022-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-14 2022-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-13 2022-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-12 2022-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-11 2022-07-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-10 2022-07-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-09 2022-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-07 2022-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-07-05 2022-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-30 2022-06-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-29 2022-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-28 2022-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-27 2022-06-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-24 2022-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-23 2022-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-22 2022-06-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-21 2022-06-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-20 2022-06-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-17 2022-06-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-16 2022-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-15 2022-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-14 2022-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-13 2022-06-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-12 2022-06-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-10 2022-06-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-09 2022-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-08 2022-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-06 2022-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-06-02 2022-05-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-31 2022-05-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-30 2022-05-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-28 2022-05-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-27 2022-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-26 2022-05-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-25 2022-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-24 2022-05-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-23 2022-05-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-22 2022-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-21 2022-05-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-20 2022-05-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-19 2022-05-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-18 2022-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-17 2022-05-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-16 2022-05-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-14 2022-05-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-13 2022-05-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-12 2022-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-11 2022-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-10 2022-05-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-09 2022-05-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-08 2022-05-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-06 2022-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-05 2022-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-04 2022-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-03 2022-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-05-02 2022-04-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-29 2022-04-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-28 2022-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-27 2022-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-26 2022-04-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-25 2022-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-20 2022-04-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-18 2022-04-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-14 2022-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-12 2022-04-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-08 2022-04-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-07 2022-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-06 2022-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-04 2022-04-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-04-02 2022-03-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-31 2022-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-29 2022-03-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-28 2022-03-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-27 2022-03-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-26 2022-03-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-25 2022-03-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-24 2022-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-23 2022-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-22 2022-03-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-21 2022-03-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-18 2022-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-17 2022-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-16 2022-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-15 2022-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-14 2022-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-11 2022-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-10 2022-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-09 2022-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-08 2022-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-07 2022-03-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-04 2022-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-03 2022-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-03-02 2022-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-28 2022-02-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-26 2022-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-24 2022-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-23 2022-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-22 2022-02-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-21 2022-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-20 2022-02-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-19 2022-02-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-18 2022-02-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-17 2022-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-16 2022-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-15 2022-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-14 2022-02-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-12 2022-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-10 2022-02-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-09 2022-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-08 2022-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-07 2022-02-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-04 2022-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-03 2022-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-02 2022-02-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-02-01 2022-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-31 2022-01-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-28 2022-01-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-27 2022-01-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-26 2022-01-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-25 2022-01-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-24 2022-01-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-22 2022-01-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-21 2022-01-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-20 2022-01-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-19 2022-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-18 2022-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-17 2022-01-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-14 2022-01-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-13 2022-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-12 2022-01-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-11 2022-01-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-10 2022-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-05 2022-01-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-04 2022-01-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_8#2022-01-03 https://wikitech.wikimedia.org/wiki/Adding_and_removing_transit_providers This page contains a checklist of actions to be taken on mutations regarding transit circuits in the "production" realm (in other words: this does not apply to the Wikimedia corporate/office network). Based on input from netops/Ferran, but may be incomplete. Adding transit circuitshttps://wikitech.wikimedia.org/wiki/Adding_and_removing_transit_providers#Adding_transit_circuits Preparation workhttps://wikitech.wikimedia.org/wiki/Adding_and_removing_transit_providers#Preparation_work Implementation (once PO signed)https://wikitech.wikimedia.org/wiki/Adding_and_removing_transit_providers#Implementation_(once_PO_signed) Removing transit circuithttps://wikitech.wikimedia.org/wiki/Adding_and_removing_transit_providers#Removing_transit_circuit https://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training == Context == Contexthttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Context Formathttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Format Alumnihttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Alumni Contenthttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Content Introductionhttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Introduction Defining test parametershttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Defining_test_parameters How to measure performancehttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#How_to_measure_performance Mastering the cachehttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Mastering_the_cache Web browsers and HTTPhttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Web_browsers_and_HTTP The critical pathhttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#The_critical_path Fontshttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Fonts Imageshttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Images Third partieshttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Third_parties Loading javascripthttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Loading_javascript Responsive UIshttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Responsive_UIs Monitoring performancehttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Monitoring_performance Customising WebPageTesthttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Customising_WebPageTest Offline supporthttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#Offline_support User perceptionhttps://wikitech.wikimedia.org/wiki/Performance/Frontend_web_performance_training#User_perception https://wikitech.wikimedia.org/wiki/Performance/Guides/Recommended_Reads This is a list of reading material to learn about web performance, as recommended by the Wikimedia Performance. Bookshttps://wikitech.wikimedia.org/wiki/Performance/Guides/Recommended_Reads#Books Blogshttps://wikitech.wikimedia.org/wiki/Performance/Guides/Recommended_Reads#Blogs Mischttps://wikitech.wikimedia.org/wiki/Performance/Guides/Recommended_Reads#Misc https://wikitech.wikimedia.org/wiki/Performance/Performance_Residency The Performance Residency is a training program aimed at elevating the web performance skills and practices of the Wikimedia Foundation as a whole. It consists of the Performance Team welcoming a temporary team member for the duration of one financial quarter. Rationalehttps://wikitech.wikimedia.org/wiki/Performance/Performance_Residency#Rationale Requirementshttps://wikitech.wikimedia.org/wiki/Performance/Performance_Residency#Requirements Principleshttps://wikitech.wikimedia.org/wiki/Performance/Performance_Residency#Principles How can I apply?https://wikitech.wikimedia.org/wiki/Performance/Performance_Residency#How_can_I_apply? https://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021) A popover (sometimes known as popupThe term "pop-up" is historically associated with pop-up ads in online advertising, where distinct browser windows would appear over top other web pages. Within the Wikimedia technical community, the term is strongly associated with what (as of 2020) is more commonly known as "popovers". Terminologyhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Terminology Performance Gotchashttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Performance_Gotchas Creeping Normality vs. Premature Optimizationshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Creeping_Normality_vs._Premature_Optimizations Best practiceshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Best_practices Positioning the Popuphttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Positioning_the_Popup Positioning the root elementhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Positioning_the_root_element Determine placement Earlyhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Determine_placement_Early Make layout computations in CSShttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Make_layout_computations_in_CSS Use template element instead of re-parsing the same HTMLhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Use_template_element_instead_of_re-parsing_the_same_HTML Use CSS clip-path for clipping the popup shapehttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Use_CSS_clip-path_for_clipping_the_popup_shape Rendering Stepshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Popover_Best_Practices_(2021)#Rendering_Steps https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips Some tips for making PHP code faster. Benchmarkinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips#Benchmarking Array separationhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips#Array_separation Constant factorshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips#Constant_factors Caching and memoizationhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips#Caching_and_memoization The optimisation operatorhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips#The_optimisation_operator Abstractionhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/PHP_optimisation_tips#Abstraction https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices This is a guide to understand and improve frontend web performance. We describe which aspects of a web page impact page loads, and how changes can influence those aspects. Getting startedhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Getting_started Metricshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Metrics Principleshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Principles Shipping frontend assetshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Shipping_frontend_assets General approachhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#General_approach HTTP cachinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#HTTP_caching Size of HTML payloadhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Size_of_HTML_payload Size of stylesheetshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Size_of_stylesheets Size of scriptshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Size_of_scripts Size of startup manifesthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Size_of_startup_manifest Size of module scriptshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Size_of_module_scripts Latencyhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Latency The fastest request is no requesthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#The_fastest_request_is_no_request Speed up the responsehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Speed_up_the_response Start the request earlierhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Start_the_request_earlier Avoid image embedding, sometimeshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Avoid_image_embedding,_sometimes Avoid preloading, sometimeshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Avoid_preloading,_sometimes Processing cost of scriptshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Processing_cost_of_scripts See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#See_also Metahttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Meta Noteshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Frontend_performance_practices#Notes https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices These are the performance guidelines for MediaWiki backend development aimed at being deployed to Wikimedia Foundation wikis. Use the below guidelines together with the [guidelines|Architecture guidelines] and [for developers/Architecture|Security guidelines]. Getting startedhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Getting_started General principleshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#General_principles Ballpark numbershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Ballpark_numbers Percentileshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Percentiles Latencyhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Latency How often will my code run?https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#How_often_will_my_code_run? Caching layershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Caching_layers Cookieshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Cookies Design for cache misshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Design_for_cache_miss Practical examples about caching layershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Practical_examples_about_caching_layers Leverage the platform!https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Leverage_the_platform! You are not alonehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#You_are_not_alone Persistence layerhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Persistence_layer Schema and API designhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Schema_and_API_design Practical examples of persistencehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Practical_examples_of_persistence Example: Permanent nameshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Example:_Permanent_names Example: Large object sizehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Example:_Large_object_size Example: Job queue use caseshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Example:_Job_queue_use_cases Example: Send a notificationhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Example:_Send_a_notification Example: Count active usershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Example:_Count_active_users Indexinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Indexing Multiple datacentershttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Multiple_datacenters Shared resourceshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Shared_resources Transactionshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Transactions Long-running querieshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Long-running_queries Advisory lockshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Advisory_locks Rate limitinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Rate_limiting Further readinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Further_reading Articleshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Articles Talkshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Talks ResourceLoaderhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#ResourceLoader Metahttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#Meta Referenceshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Guides/Backend_performance_practices#References https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Summary Descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Description Regional Implicationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Regional_Implications Recommendationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Recommendations Root Causehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Root_Cause Affected Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Affected_Datasets Followup Stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-06-04_Traffic_Data_Loss#Followup_Steps https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Summary Descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Description Root Causehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Root_Cause Affected Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Affected_Datasets Affected serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Affected_services Remediationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Remediation Reproducing the bughttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2021-02-09_Unique_Devices_By_Family_Overcount#Reproducing_the_bug https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues == All Subpages of == All Subpages ofhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues#All_Subpages_of Annotating Superset Dashboardshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues#Annotating_Superset_Dashboards https://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018) The field of web performance tends to assume that faster is always better, and has produced many guidelines over the years like RAIL that promote the existence of absolute universal values for what feels instantaneous, fast or slow. Over the years, many academic studies have looked into the subject of performance perception, and we attempt here to provide a meaningful literature review for this body of work, to shed some light on what is known and what is yet to be studied. Magic numbershttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Magic_numbers Study qualityhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Study_quality Time perceptionhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Time_perception Performance variabilityhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Performance_variability Cultural variationshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Cultural_variations Context mattershttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Context_matters Blamehttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Blame User surveys and performance metricshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#User_surveys_and_performance_metrics Conclusionhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Conclusion Further readinghttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#Further_reading Referenceshttps://wikitech.wikimedia.org/wiki/Performance/Essay/Perceived_Performance_(2018)#References https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01 ==Week of January 02== Week of January 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01#Week_of_January_02 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01#=== Week of January 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01#Week_of_January_09 Week of January 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01#Week_of_January_16 Week of January 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01#Week_of_January_23 Week of January 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/01#Week_of_January_30 https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide The Datahub data catalog is the central repository of metadata about datasets stored in the systems operated by WMF.  It is currently available under a login to all users who are in the wmf or nda LDAP groups. Data Catalog Core Entities (Data Assets)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Data_Catalog_Core_Entities_(Data_Assets) Types of Metadatahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Types_of_Metadata Documentation Style Guidelineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Documentation_Style_Guidelines Tagshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Tags Glossary Terms and Groupingshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Glossary_Terms_and_Groupings Dataset Schema Documentation (Fields)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Dataset_Schema_Documentation_(Fields) Dataset Documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Dataset_Documentation Special Termshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Data_Catalog_Documentation_Guide#Special_Terms https://wikitech.wikimedia.org/wiki/Data_Platform/Systems These subpages explain in technical detail the systems that process data for analytics at Wikimedia Foundation. Search within the Data Platform/Systems docshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems#Search_within_the_Data_Platform/Systems_docs Child Pages ofhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems#Child_Pages_of All Subpages ofhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems#All_Subpages_of https://wikitech.wikimedia.org/wiki/Check_legal_html icinga::monitor::legal puppet module and the Python 3 script check_legal_html implement production checking of some HTML excerpts that should be present on our wikis, such as a copyright & license notice, the terms of use, the WMF privacy policy and (for Wikipedia only) the Wikipedia registered trademark. At of this writing, 3 checks are implemented, one for desktop English Wikipedia, one for mobile English Wikipedia, and one for Desktop Wikibooks. Background of why this alert was setup and why it is importanthttps://wikitech.wikimedia.org/wiki/Check_legal_html#Background_of_why_this_alert_was_setup_and_why_it_is_important What you should do if you receive this alerthttps://wikitech.wikimedia.org/wiki/Check_legal_html#What_you_should_do_if_you_receive_this_alert As part of the WMF legal teamhttps://wikitech.wikimedia.org/wiki/Check_legal_html#As_part_of_the_WMF_legal_team Part of the technical support of the site / Site Reliability Engineeringhttps://wikitech.wikimedia.org/wiki/Check_legal_html#Part_of_the_technical_support_of_the_site_/_Site_Reliability_Engineering As part of the wiki admin team/editing communityhttps://wikitech.wikimedia.org/wiki/Check_legal_html#As_part_of_the_wiki_admin_team/editing_community Commons problems with the checkhttps://wikitech.wikimedia.org/wiki/Check_legal_html#Commons_problems_with_the_check Script referencehttps://wikitech.wikimedia.org/wiki/Check_legal_html#Script_reference See alsohttps://wikitech.wikimedia.org/wiki/Check_legal_html#See_also https://wikitech.wikimedia.org/wiki/BGPalerter Replacing the now defunct BGPmon. BGPalerter is an opensource NodeJS tool to monitor network prefixes and ASN using RIPE's RIS Live. https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph The Data Platform Engineering team is currently building a pair of Ceph clusters for two primary purposes: Project Statushttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Project_Status Software Componentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Software_Components Monitor Daemonshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Monitor_Daemons Manager Daemonshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Manager_Daemons Object Storage Daemonshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Object_Storage_Daemons Rados Gateway Daemonshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Rados_Gateway_Daemons Cluster Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Cluster_Architecture Storage Device Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Storage_Device_Configuration Ceph Software Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Ceph_Software_Configuration Additional Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Additional_Services Cluster Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Cluster_Configuration Configuration Methodshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Configuration_Methods Puppet Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Puppet_Configuration Manual Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Manual_Configuration CRUSH Ruleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#CRUSH_Rules Poolshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Pools Kubernetes Integrationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Kubernetes_Integration Object Storagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Ceph#Object_Storage https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Timeline 8 December 2022https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#8_December_2022 18 December 2022https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#18_December_2022 19 December 2022https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#19_December_2022 Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-12-18_World_Cup#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Summary Effect for usershttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Effect_for_users Probable cause / chain of eventshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Probable_cause_/_chain_of_events Graphshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Graphs Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-09_API_errors_-_db1143#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-10_eqsin_network_outage#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#Detection What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#What_went_poorly? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-14_asw-b2-codfw_failure#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_asw-b2-codfw_failure_redux#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-17_MediaWiki#Scorecard https://wikitech.wikimedia.org/wiki/Bast3006 bast3006 was the main bastion for the Esams cluster. It replaced bast3005 per [and was in turn replaced by bast3007] ([Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast3006#Services https://wikitech.wikimedia.org/wiki/Bast4004 bast4004 was a bastion for Ulsfo. It replaced bast4003 per [It was replaced by bast4005] per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast4004#Services https://wikitech.wikimedia.org/wiki/Bast5003 bast5003 was the main bastion for Eqsin. It replaced bast5002 per [It was replaced by bast5004] per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast5003#Services https://wikitech.wikimedia.org/wiki/Bast6002 bast6002 was the main bastion for drmrs. It replaced bast6001 per [It was replaced by [[bast6003] per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast6002#Services https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board Origin task: [of the decision: 2023-01-17 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Problem Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T322756_WMCS_Kanban_board#Option_3 https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum Magnum is the OpenStack Kubernetes as a Service offering. It can be used to easily deploy kubernetes clusters to a cloud VPS project. Deploy a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Deploy_a_cluster Get kube config filehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Get_kube_config_file Noteshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Notes Templateshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Templates Create a templatehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Create_a_template Template optionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Template_options Scale a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Scale_a_cluster Upgrade a clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Upgrade_a_cluster Add cinder csi to clusterhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Add_cinder_csi_to_cluster Provisioning with OpenTofuhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Magnum#Provisioning_with_OpenTofu https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview This page contains a system overview of Toolforge from the engineering point of view. Find here high level information of the different bits and pieces that make Toolforge what it is. Summaryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Summary Use caseshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Use_cases webserviceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#webservices jobshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#jobs They key componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#They_key_components LDAPhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#LDAP Bastionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Bastions NFShttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#NFS Kuberneteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Kubernetes RBAC and securityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#RBAC_and_security jobs frameworkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#jobs_framework Networkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Network Other componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Other_components strikerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#striker databaseshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#databases Some historyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#Some_history See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/System_Overview#See_also https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Exchange_rates Uses https://wikitech.wikimedia.org/wiki/Sandbox-votesting == Upcoming business hours oncall schedule (experimental) == Upcoming business hours oncall schedule (experimental)https://wikitech.wikimedia.org/wiki/Sandbox-votesting#Upcoming_business_hours_oncall_schedule_(experimental) https://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-24_sessionstore_quorum_issues#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2022-10-04_jupyterhub-conda_outage#Scorecard https://wikitech.wikimedia.org/wiki/MariaDB/Changing_user_passwords How to rotate user passwords. Under construction. wikiuser and wikiadminhttps://wikitech.wikimedia.org/wiki/MariaDB/Changing_user_passwords#wikiuser_and_wikiadmin https://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-01-30_kartotherian#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Ownership === Support levels === Support levelshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Ownership#Support_levels https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62 == 2023-01-31 == 2023-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-31 2023-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-30 2023-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-29 2023-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-28 2023-01-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-27 2023-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-26 2023-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-25 2023-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-24 2023-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-23 2023-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-20 2023-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-19 2023-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-18 2023-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-17 2023-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-16 2023-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-14 2023-01-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-13 2023-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-12 2023-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-11 2023-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-10 2023-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-09 2023-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-06 2023-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-05 2023-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-04 2023-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-03 2023-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#2023-01-02 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_62#Other_archives https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31 = Toolforge Workgroup meeting 2023-01-31 notes = Toolforge Workgroup meeting 2023-01-31 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#Toolforge_Workgroup_meeting_2023-01-31_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#Notes pywikibot @ toolforge kuberneteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#pywikibot_@_toolforge_kubernetes T325196 Toolforge kubernetes upgrade cadencehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#T325196_Toolforge_kubernetes_upgrade_cadence T296729: Support ASGI on Toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#T296729:_Support_ASGI_on_Toolforge lima-kilo https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#lima-kilo_https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-01-31#Action_items https://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2020_Call_for_Participation FOSDEM 2020 Call for Participation: Web Performance Web Performance devroomhttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2020_Call_for_Participation#Web_Performance_devroom Submission processhttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2020_Call_for_Participation#Submission_process Important dateshttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2020_Call_for_Participation#Important_dates Recordingshttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2020_Call_for_Participation#Recordings https://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2021_Call_for_Participation FOSDEM 2021 Call for Participation: Web Performance Web Performance devroomhttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2021_Call_for_Participation#Web_Performance_devroom Submission processhttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2021_Call_for_Participation#Submission_process Important dateshttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2021_Call_for_Participation#Important_dates https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design Origin task: [of the decision: 2023-02-06 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Decision_taken Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Constraints_and_risks Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T326136_Toolforge_build_service_to_move_to_an_API_design#Option_2 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service Documentation of components and common admin procedures for Toolforge/Build Service. Componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Components Alertshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Alerts Dashboardshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Dashboards Administrative taskshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Administrative_tasks Starting a servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Starting_a_service Harborhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Harbor Buildservice APIhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Buildservice_API Tektonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Tekton Stopping a servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Stopping_a_service Checking all components are alivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Checking_all_components_are_alive Updating the builder imagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Updating_the_builder_image Adding a new buildpackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#Adding_a_new_buildpack Historyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Build_Service#History https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes This page details information about the changes to Cloud VPS metrics systems in mid 2023. What is changing?https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#What_is_changing? Relevant changes that happened previouslyhttps://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#Relevant_changes_that_happened_previously What is changing now?https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#What_is_changing_now? What should I do?https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#What_should_I_do? Migrate dashboards (and other tools) to use Prometheus datahttps://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#Migrate_dashboards_(and_other_tools)_to_use_Prometheus_data Migrate dashboards from grafana-cloud.wikimedia.org to grafana.wmcloud.orghttps://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#Migrate_dashboards_from_grafana-cloud.wikimedia.org_to_grafana.wmcloud.org Why are we doing this?https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#Why_are_we_doing_this? See alsohttps://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes#See_also https://wikitech.wikimedia.org/wiki/Podman Podman is a daemonless container engine to run OCI containers. It is notably able to run containers in rootless mode. Debian Bullseyehttps://wikitech.wikimedia.org/wiki/Podman#Debian_Bullseye Install from sourcehttps://wikitech.wikimedia.org/wiki/Podman#Install_from_source https://wikitech.wikimedia.org/wiki/WordPress As a prevention of [this article is living on [https://office.wikimedia. https://wikitech.wikimedia.org/wiki/Incident_response/Training This training attempts to expose the reader to functional, direct information for effective incident response. This training attempts to bake thought patterns for a more prepared response. Goalshttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Goals Prerequisite knowledgehttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Prerequisite_knowledge Scope of respondershttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Scope_of_responders Available toolshttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Available_tools Incident action guidelineshttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Incident_action_guidelines Priorityhttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Priority Responsehttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Response Diagnose the problemhttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Diagnose_the_problem Fixing the problemhttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Fixing_the_problem Reviewhttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Review Practicehttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Practice Debugginghttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Debugging Fixinghttps://wikitech.wikimedia.org/wiki/Incident_response/Training#Fixing See alsohttps://wikitech.wikimedia.org/wiki/Incident_response/Training#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/02 ==Week of February 06== Week of February 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/02#Week_of_February_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/02#=== Week of February 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/02#Week_of_February_13 Week of February 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/02#Week_of_February_20 Week of February 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/02#Week_of_February_27 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway This document is a proposal to set up a single API ingress/gateway solution for Toolforge APIs, such as the Jobs API and the upcoming Build service API. Backgroundhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway#Background Proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway#Proposal Accesshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway#Access Authenticationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway#Authentication Possible further workhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway#Possible_further_work Noteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_API_gateway#Notes https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Summary Descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Description Recommendationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Recommendations Root Causehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Root_Cause Affected Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Affected_Datasets Followup Stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Followup_Steps Reproducing the Issueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-01-08_Webrequest_Data_Loss#Reproducing_the_Issues https://wikitech.wikimedia.org/wiki/Incidents/2023-02-07_mediawiki.page-undelete_event_stream == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-07_mediawiki.page-undelete_event_stream#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-07_mediawiki.page-undelete_event_stream#Timeline Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-07_mediawiki.page-undelete_event_stream#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-07_mediawiki.page-undelete_event_stream#Scorecard https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2023#By_month https://wikitech.wikimedia.org/wiki/Data_Platform/Sessions {{Fixme|[page documents the various notions of a "session" used in analytics for Wikimedia projects and Foundation products. Implementationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#Implementations Mobile Appshttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#Mobile_Apps Androidhttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#Android iOShttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#iOS Webhttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#Web See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#See_also Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Sessions#References https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java == Thread Dump == Thread Dumphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Thread_Dump How to take a java thread dumphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#How_to_take_a_java_thread_dump Thread dumps from most Java processeshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Thread_dumps_from_most_Java_processes Thread dumps from Apache Sparkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Thread_dumps_from_Apache_Spark Analyzing the thread dumphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Analyzing_the_thread_dump Spotify provide an interesting online thread dump analyzerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Spotify_provide_an_interesting_online_thread_dump_analyzer Fast Threadhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Fast_Thread GC analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#GC_analysis Enabling GC logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Enabling_GC_logs Analyzing GC logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Analyzing_GC_logs OutOfMemory/HeapDumphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#OutOfMemory/HeapDump Enabling HeapDump on OutOfMemmoryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Enabling_HeapDump_on_OutOfMemmory Generating HeapDump manuallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Generating_HeapDump_manually Analyzing ithttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Analyzing_it Memory Analyzer Toolhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Memory_Analyzer_Tool Jcmdhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Jcmd Profile Analysishttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#Profile_Analysis async-profilerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#async-profiler How to use ithttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Java#How_to_use_it https://wikitech.wikimedia.org/wiki/NFS NFS might refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow This page contains information about the 2023 WMCS team project to evaluate how we deploy openstack for Cloud VPS. Contexthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Context Why doing this researchhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Why_doing_this_research Current model (legacy)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Current_model_(legacy) Pain pointshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Pain_points Things to keephttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Things_to_keep Open questionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Open_questions Final proposalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Final_proposal Final proposal: a new modelhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Final_proposal:_a_new_model New model: puppet layouthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#New_model:_puppet_layout New model: hardwarehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#New_model:_hardware New model: edge networkinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#New_model:_edge_networking New model: testing & upgrade procedureshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#New_model:_testing_&_upgrade_procedures New model: additional considerations about kuberneteshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#New_model:_additional_considerations_about_kubernetes Final proposal: migration strategyhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Final_proposal:_migration_strategy migration stage 1: plan & procure hardwarehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#migration_stage_1:_plan_&_procure_hardware migration stage 2: bootstrap new modelhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#migration_stage_2:_bootstrap_new_model migration stage 3: testinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#migration_stage_3:_testing migration stage 4: migrationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#migration_stage_4:_migration migration stage 5: cleanuphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#migration_stage_5:_cleanup Final proposal: timelinehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Final_proposal:_timeline Other options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Other_options_considered kolla-ansiblehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#kolla-ansible kolla-ansible evaluationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#kolla-ansible_evaluation kolla-ansible evaluation: inside Cloud VPShttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#kolla-ansible_evaluation:_inside_Cloud_VPS kolla-ansible evaluation: code patchinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#kolla-ansible_evaluation:_code_patching openstack-ansiblehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#openstack-ansible openstack-ansible evaluationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#openstack-ansible_evaluation openstack-ansible evaluation: inside Cloud VPShttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#openstack-ansible_evaluation:_inside_Cloud_VPS openstack-ansible evaluation: code patchinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#openstack-ansible_evaluation:_code_patching kayobehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#kayobe why not adopting kayobehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_not_adopting_kayobe tripleohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#tripleo why not adopting tripleohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_not_adopting_tripleo bifrosthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#bifrost why not adopting bifrosthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_not_adopting_bifrost kubernetes openstack-helmhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#kubernetes_openstack-helm why not adopting kubernetes openstack-helmhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_not_adopting_kubernetes_openstack-helm why adopting kubernetes openstack-helmhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_adopting_kubernetes_openstack-helm puppet-openstackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#puppet-openstack why not adopting puppet-openstackhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_not_adopting_puppet-openstack airshiphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#airship Why not adopting airshiphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#Why_not_adopting_airship starlingxhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#starlingx why not adopting starlingxhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#why_not_adopting_starlingx See alsohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2023_Openstack_deployment_workflow#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21 = Toolforge Workgroup meeting 2023-02-21 notes = Toolforge Workgroup meeting 2023-02-21 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Toolforge_Workgroup_meeting_2023-02-21_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Notes Toolforge API gateway https://phabricator.wikimedia.org/T329443https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Toolforge_API_gateway_https://phabricator.wikimedia.org/T329443 cert-manager for Toolforge k8s certificates https://gitlab.wikimedia.org/repos/cloud/toolforge/cert-manager/https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#cert-manager_for_Toolforge_k8s_certificates_https://gitlab.wikimedia.org/repos/cloud/toolforge/cert-manager/ new container image for mariadb: https://phabricator.wikimedia.org/T254636https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#new_container_image_for_mariadb:_https://phabricator.wikimedia.org/T254636 K8s upgrade, Taavi prepping for it?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#K8s_upgrade,_Taavi_prepping_for_it? Which buildpacks to allow for the beta: https://phabricator.wikimedia.org/T330102https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Which_buildpacks_to_allow_for_the_beta:_https://phabricator.wikimedia.org/T330102 Next Toolforge meetings, cadence is right?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Next_Toolforge_meetings,_cadence_is_right? Discussion: Adopt an upgrade policy / cadence for Toolforge Kubernetes https://phabricator.wikimedia.org/T325196 ?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-02-21#Discussion:_Adopt_an_upgrade_policy_/_cadence_for_Toolforge_Kubernetes_https://phabricator.wikimedia.org/T325196_? https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo This page contains information on Toolforge lima-kilo, a development and testing environment for Toolforge that reproduces most of the system components used in production. Rationalehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo#Rationale Basic usage workflowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo#Basic_usage_workflow Code conventionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo#Code_conventions See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo#See_also https://wikitech.wikimedia.org/wiki/Search_Platform Main team page is at the moment on mediawiki.org. https://wikitech.wikimedia.org/wiki/Search_Platform/About The Search Platform team (part of [Technology]) is responsible for maintaining and enhancing the various Search features and APIs for MediaWiki. This includes the[| CirrusSearch extension] which relies on Elasticsearch, the search backend used at the Wikimedia Foundation to support Wikimedia projects and Wikidata Query Service, the SPARQL endpoint used to query Wikidata. Missionhttps://wikitech.wikimedia.org/wiki/Search_Platform/About#Mission Overviewhttps://wikitech.wikimedia.org/wiki/Search_Platform/About#Overview https://wikitech.wikimedia.org/wiki/Search_Platform/Currently_working_on Current work from the Search Platform team is tracked in the [(Current work)] Phabricator board. https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates /|hideredirects=1|stripprefix=1}} Older updateshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates#Older_updates https://wikitech.wikimedia.org/wiki/Search_Platform/Goals = Goals for each quarter = Goals for each quarterhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals#Goals_for_each_quarter Other sources of informationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals#Other_sources_of_information https://wikitech.wikimedia.org/wiki/Search_Platform/Team The canonical version of this page is on OfficeWiki, please report all edits there. Team membershttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Team_members Who to contact when?https://wikitech.wikimedia.org/wiki/Search_Platform/Team#Who_to_contact_when? Organizationalhttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Organizational Searchhttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Search Technical componentshttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Technical_components Featureshttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Features Query Serviceshttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Query_Services Misc skillshttps://wikitech.wikimedia.org/wiki/Search_Platform/Team#Misc_skills https://wikitech.wikimedia.org/wiki/Search_Platform/Accountability = High level = High levelhttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#High_level Technical componentshttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Technical_components Searchhttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Search Servershttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Servers Other componentshttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Other_components Query Serviceshttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Query_Services Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Misc Code repositorieshttps://wikitech.wikimedia.org/wiki/Search_Platform/Accountability#Code_repositories https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Local_customization_and_hacks This page contains information about local customization and hacks for Cloud VPS's Openstack. Listhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Local_customization_and_hacks#List https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_read_only#Scorecard https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3 In Q3, the Search Platform team will continue to primarily focus on fixing the Search Update Pipeline, to address architectural limitations that have been causing failures in edits being accurately reflected in search indexes for users. Q3 OKRshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Q3_OKRs Objective 1: Users can reliably query information on Wikidata, and search on wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Objective_1:_Users_can_reliably_query_information_on_Wikidata,_and_search_on_wikis Objective 2: Searchers of emerging languages can search in their own languagehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Objective_2:_Searchers_of_emerging_languages_can_search_in_their_own_language Objective 3: Paying down technical debt in infrastructurehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Objective_3:_Paying_down_technical_debt_in_infrastructure Project plan (Q3)https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Project_plan_(Q3) Things we shiphttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Things_we_ship Fix update pipeline (2+ quarters of work)https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Fix_update_pipeline_(2+_quarters_of_work) WDQS uptime SLOhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#WDQS_uptime_SLO Spark 3 migrationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Spark_3_migration Unpack language analyzershttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q3#Unpack_language_analyzers https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API NOTE: Follows the discussion to move to an API design or not here [task: phab:T325382] Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325382_Choose_a_lang_for_the_toolforge_build_service_API#Option_2 https://wikitech.wikimedia.org/wiki/Sandbox-sre-oncall-schedule-legacy == Upcoming business hours oncall schedule (experimental) == Upcoming business hours oncall schedule (experimental)https://wikitech.wikimedia.org/wiki/Sandbox-sre-oncall-schedule-legacy#Upcoming_business_hours_oncall_schedule_(experimental) https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Interest_matrix This is an attempt to identify who knows what about which Cloud Services subject areas. Started: October 2018. Legendhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Interest_matrix#Legend https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal == Synthetic tests on a physical server == Synthetic tests on a physical serverhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Synthetic_tests_on_a_physical_server Synthetic testshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Synthetic_tests Setup a bare metal serverhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Setup_a_bare_metal_server Install Dockerhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Install_Docker Setup the userhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Setup_the_user Run test without Dockerhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Run_test_without_Docker Install dependencies for sitespeed.iohttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Install_dependencies_for_sitespeed.io Install sitespeed.iohttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Install_sitespeed.io Install browsershttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Install_browsers Setup unattended-upgradeshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Setup_unattended-upgrades Pin the CPU frequency and use performance governorhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Pin_the_CPU_frequency_and_use_performance_governor Set DNShttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Set_DNS Open Graphite firewall for the machinehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Open_Graphite_firewall_for_the_machine Change hostnamehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Change_hostname Install collectdhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Install_collectd Add Slack error reporterhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Add_Slack_error_reporter Enable the firewallhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Enable_the_firewall Add configuration and baseline directorieshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Bare_metal#Add_configuration_and_baseline_directories https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24#What_we've_accomplished Spark 3 migrationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24#Spark_3_migration Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24#Search_Update_Pipeline Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-02-24#Misc https://wikitech.wikimedia.org/wiki/Search_Platform/Contact The canonical version of this page is on OfficeWiki, please report all edits there. Which channels to use to contact the teamhttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Which_channels_to_use_to_contact_the_team Communication channelshttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Communication_channels Mailing listshttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Mailing_lists Phabricatorhttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Phabricator IRC channelshttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#IRC_channels Office Hourshttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Office_Hours Weekly status updateshttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Weekly_status_updates Meetup groupshttps://wikitech.wikimedia.org/wiki/Search_Platform/Contact#Meetup_groups https://wikitech.wikimedia.org/wiki/Search_Platform/Intake_Standards The Search Platform team does not have documented intake standards at the moment. Please contact the Product Manage (Mike) and/or Engineering Manager (Guillaume) directly. https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal Note: This is a guide that installs kserve 0.10 in a local minikube kubernetes cluster that follows the instructions from the official documentation to install kserve in RawDeployment mode that doesn't need knative (and cannot scale down to zero). Recommended Version Matrixhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#Recommended_Version_Matrix 1. Install minikube and start a clusterhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#1._Install_minikube_and_start_a_cluster 2. Install istiohttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#2._Install_istio 3. Install Cert Managerhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#3._Install_Cert_Manager 4. Install KServehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#4._Install_KServe 5. Deploy first InferenceService and access our apphttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#5._Deploy_first_InferenceService_and_access_our_app 6. Install Minio (model storage)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#6._Install_Minio_(model_storage) 8. Deploy enwiki-goodfaith and run a predictionhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/KServe/DeployLocal#8._Deploy_enwiki-goodfaith_and_run_a_prediction https://wikitech.wikimedia.org/wiki/People2002 people2002 was a virtual machine running on Ganeti on Debian bullseye. It hosted the service People. Connectinghttps://wikitech.wikimedia.org/wiki/People2002#Connecting https://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-28_GitLab_data_loss#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63 == 2023-02-28 == 2023-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-28 2023-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-27 2023-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-26 2023-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-25 2023-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-24 2023-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-23 2023-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-22 2023-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-21 2023-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-20 2023-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-18 2023-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-17 2023-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-16 2023-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-15 2023-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-14 2023-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-13 2023-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-11 2023-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-10 2023-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-09 2023-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-08 2023-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-07 2023-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-06 2023-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-05 2023-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-03 2023-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-02 2023-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#2023-02-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_63#Other_archives https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/APIs Toolforge is slowly moving towards an API-oriented model where client tools (such as those installed on bastions) contact custom Toolforge APIs to make changes instead of making them directly. API gatewayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/APIs#API_gateway Accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/APIs#Access Backendshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/APIs#Backends https://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award The Web Perf Hero award is given to individuals who have gone above and beyond to improve the web performance of Wikimedia projects. 2023https://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#2023 Máté Szabóhttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Máté_Szabó 2022https://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#2022 Valentín Gutierrezhttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Valentín_Gutierrez Amir Sarabadanihttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Amir_Sarabadani 2021https://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#2021 SD0001https://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#SD0001 Umherirrenderhttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Umherirrender Kunal Mehtahttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Kunal_Mehta Giuseppe Lavagettohttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Giuseppe_Lavagetto 2020https://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#2020 Nick Rayhttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Nick_Ray Jon Robsonhttps://wikitech.wikimedia.org/wiki/Web_Perf_Hero_award#Jon_Robson https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph Origin task: [of the decision: 2023-03-06 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Decision_taken Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Option_4 Option 5https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T325223_Upgrade_cadence_for_Ceph#Option_5 https://wikitech.wikimedia.org/wiki/REST_Gateway The REST Gateway is an Envoy instance for proxying and rewriting requests that would have previously gone to RESTBase as part of our migration away from the platform. It is a subconfiguration of the API Gateway chart. Services currently supportedhttps://wikitech.wikimedia.org/wiki/REST_Gateway#Services_currently_supported Gateway configurationhttps://wikitech.wikimedia.org/wiki/REST_Gateway#Gateway_configuration Per-service configuration and traffic routinghttps://wikitech.wikimedia.org/wiki/REST_Gateway#Per-service_configuration_and_traffic_routing Headershttps://wikitech.wikimedia.org/wiki/REST_Gateway#Headers Acceptance criteriahttps://wikitech.wikimedia.org/wiki/REST_Gateway#Acceptance_criteria Testinghttps://wikitech.wikimedia.org/wiki/REST_Gateway#Testing https://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Detection Graphshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Graphs Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-23_PHP_worker_threads_exhaustion#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-02-11_logstash_latency#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta Origin task: [of the decision: 2022-11-22 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T330102_What_buildpacks_to_allow_and_include_for_toolforge_build_service_beta#Option_4 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#What_we've_accomplished Search Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#Search_Analysis Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#Search_Update_Pipeline Spark 3 Upgradehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#Spark_3_Upgrade Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-10#Misc https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/03 ==Week of March 06== Week of March 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/03#Week_of_March_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/03#=== Week of March 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/03#Week_of_March_13 Week of March 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/03#Week_of_March_20 Week of March 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/03#Week_of_March_27 https://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-03-09_mailman#Scorecard https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations ==Data Engineer== Data Engineerhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#Data_Engineer SREhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#SRE Tech Leadhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#Tech_Lead Engineering Managerhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#Engineering_Manager Directorhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#Director Project Managerhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#Project_Manager Product Managerhttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Team_roles_and_expectations#Product_Manager https://wikitech.wikimedia.org/wiki/SRE/Oncall Being on-call means you may be paged anytime during your shift to investigate and fix issues in our production environment. You are expected to be able to respond to issues with a reasonable response time (less than five minutes) during your business hours. Preparing for your shifthttps://wikitech.wikimedia.org/wiki/SRE/Oncall#Preparing_for_your_shift On-call acknowledgementhttps://wikitech.wikimedia.org/wiki/SRE/Oncall#On-call_acknowledgement Handoffhttps://wikitech.wikimedia.org/wiki/SRE/Oncall#Handoff Business hourshttps://wikitech.wikimedia.org/wiki/SRE/Oncall#Business_hours Change of working hourshttps://wikitech.wikimedia.org/wiki/SRE/Oncall#Change_of_working_hours Vacations, holidays, and sick dayshttps://wikitech.wikimedia.org/wiki/SRE/Oncall#Vacations,_holidays,_and_sick_days Communication when IRC is downhttps://wikitech.wikimedia.org/wiki/SRE/Oncall#Communication_when_IRC_is_down See alsohttps://wikitech.wikimedia.org/wiki/SRE/Oncall#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers#Common_issues Connectivity issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers#Connectivity_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_unit_status_of_maintain_dbusers#Old_incidents https://wikitech.wikimedia.org/wiki/VRT_System/Failover VRTS has one active host (currently vtrs1001) and one replica (vrts2001). Introductionhttps://wikitech.wikimedia.org/wiki/VRT_System/Failover#Introduction Prerequisiteshttps://wikitech.wikimedia.org/wiki/VRT_System/Failover#Prerequisites Planned Failoverhttps://wikitech.wikimedia.org/wiki/VRT_System/Failover#Planned_Failover Unplanned Failoverhttps://wikitech.wikimedia.org/wiki/VRT_System/Failover#Unplanned_Failover https://wikitech.wikimedia.org/wiki/MOSS Misc Object Storage Service. See T279621. https://wikitech.wikimedia.org/wiki/Setup_a_new_network_device Checklist to not get lost when setting up a new network device Initial setuphttps://wikitech.wikimedia.org/wiki/Setup_a_new_network_device#Initial_setup Monitoringhttps://wikitech.wikimedia.org/wiki/Setup_a_new_network_device#Monitoring https://wikitech.wikimedia.org/wiki/IDM/Design == Design overview == Design overviewhttps://wikitech.wikimedia.org/wiki/IDM/Design#Design_overview accountshttps://wikitech.wikimedia.org/wiki/IDM/Design#accounts keymanagementhttps://wikitech.wikimedia.org/wiki/IDM/Design#keymanagement ldapbackendhttps://wikitech.wikimedia.org/wiki/IDM/Design#ldapbackend requisitionshttps://wikitech.wikimedia.org/wiki/IDM/Design#requisitions signupshttps://wikitech.wikimedia.org/wiki/IDM/Design#signups Technical Designhttps://wikitech.wikimedia.org/wiki/IDM/Design#Technical_Design Use of packageshttps://wikitech.wikimedia.org/wiki/IDM/Design#Use_of_packages Authenticationhttps://wikitech.wikimedia.org/wiki/IDM/Design#Authentication Background taskshttps://wikitech.wikimedia.org/wiki/IDM/Design#Background_tasks Configurationhttps://wikitech.wikimedia.org/wiki/IDM/Design#Configuration De-couplinghttps://wikitech.wikimedia.org/wiki/IDM/Design#De-coupling Expiring linkshttps://wikitech.wikimedia.org/wiki/IDM/Design#Expiring_links Storagehttps://wikitech.wikimedia.org/wiki/IDM/Design#Storage https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17#Search_Update_Pipeline Search Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17#Search_Analysis Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-17#Misc https://wikitech.wikimedia.org/wiki/Gerrit/Bot_account A bot account is a user account reporting to Gerrit without human interactions, in Gerrit such accounts are referred to as being a service user. A typical example is the Zuul/Jenkins CI reporting as jenkins-bot. Checks UIhttps://wikitech.wikimedia.org/wiki/Gerrit/Bot_account#Checks_UI Referenceshttps://wikitech.wikimedia.org/wiki/Gerrit/Bot_account#References https://wikitech.wikimedia.org/wiki/Sel The system event log is used to log hardware events directly to the BMC. This allows events to be logged even if the Os is unable to. Addtional informationhttps://wikitech.wikimedia.org/wiki/Sel#Addtional_information ipmi-selhttps://wikitech.wikimedia.org/wiki/Sel#ipmi-sel racadmhttps://wikitech.wikimedia.org/wiki/Sel#racadm Alertshttps://wikitech.wikimedia.org/wiki/Sel#Alerts Memory Errorshttps://wikitech.wikimedia.org/wiki/Sel#Memory_Errors Clearing SELhttps://wikitech.wikimedia.org/wiki/Sel#Clearing_SEL https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#What_we've_accomplished Spark 3 Upgradehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#Spark_3_Upgrade Search Analyzershttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#Search_Analyzers Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#Search_Update_Pipeline Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-24#Misc https://wikitech.wikimedia.org/wiki/SLO/linkrecommendation Status: approved Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/linkrecommendation#Service_Level_Objectives https://wikitech.wikimedia.org/wiki/SRE/Traffic/Intake_Standards Until our intake standards are defined, please connect with us via the methods outlined in SRE/Traffic/Contact. https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#What_we've_accomplished Search - Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#Search_-_Analysis Spark 3 Upgradehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#Spark_3_Upgrade Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#Search_Update_Pipeline Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-03-31#Misc https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64 == 2023-03-31 == 2023-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-31 2023-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-30 2023-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-29 2023-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-28 2023-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-27 2023-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-25 2023-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-24 2023-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-23 2023-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-22 2023-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-21 2023-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-20 2023-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-19 2023-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-18 2023-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-17 2023-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-16 2023-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-15 2023-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-14 2023-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-13 2023-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-12 2023-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-10 2023-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-09 2023-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-08 2023-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-07 2023-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-06 2023-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-04 2023-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-03 2023-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-02 2023-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#2023-03-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_64#Other_archives https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage Lift Wing's model servers can be exposed in two ways: Internal endpointshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#Internal_endpoints When do I need to use the internal endpoint?https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#When_do_I_need_to_use_the_internal_endpoint? Example usage of internal endpointhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#Example_usage_of_internal_endpoint External endpointshttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#External_endpoints When do I need to use the external endpoint?https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#When_do_I_need_to_use_the_external_endpoint? Example usage of external endpointhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#Example_usage_of_external_endpoint Authenticationhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#Authentication Request a bearer tokenhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#Request_a_bearer_token ML Admins onlyhttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#ML_Admins_only Differences using Lift Wing instead of OREShttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#Differences_using_Lift_Wing_instead_of_ORES https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Streams If you want to call a specific Lift Wing model server every time that an event is posted to an event stream in Kafka, we suggest to use our ChangeProp rules defined for Lift Wing. ChangeProp can be configured to listen to a Kafka topics and call Lift Wing to generate a score. Streams (Admins only, Machine Learning team)https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Streams#Streams_(Admins_only,_Machine_Learning_team) Staging configuration and testinghttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Streams#Staging_configuration_and_testing https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports We get data to import to CiviCRM from various external sources in csv format. Historically we have uploaded this data through our custom `offline2civicrm` drupal module (drupal import) but this extension relies heavily on Drupal functionality (that we have to adjust to changing) so we are working towards using CiviCRM core functionality (Civi-Import). The following are handled using the alterMappedRow import specific hookhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#The_following_are_handled_using_the_alterMappedRow_import_specific_hook Selecting the organizationhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Selecting_the_organization Selecting the individualhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Selecting_the_individual Gatewayhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Gateway Gateway Trxn IDhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Gateway_Trxn_ID No thank youhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#No_thank_you Sourcehttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Source The following is handled through the pre hookhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#The_following_is_handled_through_the_pre_hook Create employer relationship for all workplace giving and matching gifts soft creditshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Create_employer_relationship_for_all_workplace_giving_and_matching_gifts_soft_credits For consideration - things in our drupal importshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#For_consideration_-_things_in_our_drupal_imports Source fieldshttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/Imports#Source_fields https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-04-04 = Toolforge Workgroup meeting 2023-04-04 notes = Toolforge Workgroup meeting 2023-04-04 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-04-04#Toolforge_Workgroup_meeting_2023-04-04_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-04-04#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-04-04#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-04-04#Notes Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-04-04#Action_items https://wikitech.wikimedia.org/wiki/Search_Platform/Documentation = Docs and Other Links = Docs and Other Linkshttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Docs_and_Other_Links Main Documentationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Main_Documentation Searchhttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Search Wikidata Query Service (WDQS)https://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Wikidata_Query_Service_(WDQS) Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Misc Blog postshttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Blog_posts SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#SLOs Dashboardshttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Dashboards Supersethttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Superset Historical documentationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Documentation#Historical_documentation https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets Origin task: [of the decision: 2023-04-05 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Decision_taken Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Option_3 Option 3bishttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T332191_subdomain_for_new_cloud_private_subnets#Option_3bis https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-07 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-07#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-07#What_we've_accomplished Search Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-07#Search_Analysis Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-07#Search_Update_Pipeline Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-07#Misc https://wikitech.wikimedia.org/wiki/SONiC/initial-setup 3Note that most of the steps below need to be automated through some ZTP flow. Until then they are needed to get a base config on a device. Runbookhttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Runbook Cabling/Netboxhttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Cabling/Netbox Dell OS10 uninstallhttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Dell_OS10_uninstall SONiC installhttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#SONiC_install Onsite (USB)https://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Onsite_(USB) Remote (HTTP)https://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Remote_(HTTP) SONiC IP setuphttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#SONiC_IP_setup Dell SONiChttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Dell_SONiC OSS SONiChttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#OSS_SONiC Additional informationhttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Additional_information DHCP Discover contenthttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#DHCP_Discover_content Automatic upgrade image searchhttps://wikitech.wikimedia.org/wiki/SONiC/initial-setup#Automatic_upgrade_image_search https://wikitech.wikimedia.org/wiki/News/2023_ToolsDB_upgrade In April 2023, ToolsDB was migrated to a new Cloud VPS instance, and is now running MariaDB 10.4 with Ceph-based storage. Timelinehttps://wikitech.wikimedia.org/wiki/News/2023_ToolsDB_upgrade#Timeline What you need to dohttps://wikitech.wikimedia.org/wiki/News/2023_ToolsDB_upgrade#What_you_need_to_do What you should be aware ofhttps://wikitech.wikimedia.org/wiki/News/2023_ToolsDB_upgrade#What_you_should_be_aware_of Performancehttps://wikitech.wikimedia.org/wiki/News/2023_ToolsDB_upgrade#Performance Linkwatcherhttps://wikitech.wikimedia.org/wiki/News/2023_ToolsDB_upgrade#Linkwatcher https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes = Toolforge Kubernetes 1.22 upgrade = Toolforge Kubernetes 1.22 upgradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#Toolforge_Kubernetes_1.22_upgrade prephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#prep control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#control_nodes tools-k8s-control-4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#tools-k8s-control-4 tools-k8s-control-5https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#tools-k8s-control-5 tools-k8s-control-6https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#tools-k8s-control-6 workershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#workers ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#ingress_nodes afterwardshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.21_to_1.22_notes#afterwards https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/04 ==Week of April 03== Week of April 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/04#Week_of_April_03 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/04#=== Week of April 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/04#Week_of_April_10 Week of April 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/04#Week_of_April_17 Week of April 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/04#Week_of_April_24 https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Transaction_IDs Each financial transaction has IDs associated, with a range of targets and granularities. https://wikitech.wikimedia.org/wiki/Performance/Essay/Performance_survey_(2019) We started the Performance survey with the intention to identify which metrics best represent a satisfying experience, as defined by real people, with the assumption that generally "faster is better" (which we confirmed, no surprises there!) and with the hope that there is or are metrics available (or computable) in modern browsers that would correlate with a positive experience. Howhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Performance_survey_(2019)#How Learnedhttps://wikitech.wikimedia.org/wiki/Performance/Essay/Performance_survey_(2019)#Learned Further readinghttps://wikitech.wikimedia.org/wiki/Performance/Essay/Performance_survey_(2019)#Further_reading See alsohttps://wikitech.wikimedia.org/wiki/Performance/Essay/Performance_survey_(2019)#See_also https://wikitech.wikimedia.org/wiki/Performance/Real_user_monitoring Real user monitoring involves collecting [metrics] from readers that browse the live Wikipedia.org site. Metricshttps://wikitech.wikimedia.org/wiki/Performance/Real_user_monitoring#Metrics Dashboardshttps://wikitech.wikimedia.org/wiki/Performance/Real_user_monitoring#Dashboards How we collect metricshttps://wikitech.wikimedia.org/wiki/Performance/Real_user_monitoring#How_we_collect_metrics How to add a new metrichttps://wikitech.wikimedia.org/wiki/Performance/Real_user_monitoring#How_to_add_a_new_metric See alsohttps://wikitech.wikimedia.org/wiki/Performance/Real_user_monitoring#See_also https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Maintenance_notification When scheduled system maintenance will cause service outages, we try to provide our users with advance notice of the downtime. For serious outages, we also try to provide advance notice to our users' users. https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing == Organizational == Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Organizational What is the service?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#What_is_the_service? Service structure and frameworkshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Service_structure_and_frameworks Glossaryhttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Glossary Who are the responsible teams?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Who_are_the_responsible_teams? Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Architectural What are the service's dependencies?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#What_are_the_service's_dependencies? Hard dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Hard_dependencies ML-Serve Kuberneteshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#ML-Serve_Kubernetes Inference Serviceshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Inference_Services Soft dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Soft_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Client-facing Who are the service's clients?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Who_are_the_service's_clients? External usershttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#External_users Internal usershttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Internal_users Write the service level indicatorshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Write_the_service_level_indicators Operationalhttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Operational How is the service monitored?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#How_is_the_service_monitored? How complex is the service to troubleshoot?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#How_complex_is_the_service_to_troubleshoot? How is the service deployed?https://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#How_is_the_service_deployed? Write the service level objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Write_the_service_level_objectives Calculate the realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Calculate_the_realistic_targets Calculate the ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Calculate_the_ideal_targets Reconcile the realistic vs ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#Reconcile_the_realistic_vs_ideal_targets Referenceshttps://wikitech.wikimedia.org/wiki/SLO/Lift_Wing#References https://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Timeline Graphshttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Graphs Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-04-17_eqiad/LVS#Scorecard https://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing (moved from SONiC) Leaf/spine configurationhttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#Leaf/spine_configuration Interface mappinghttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#Interface_mapping Interface configurationhttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#Interface_configuration BGP configurationhttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#BGP_configuration EVPN/VXLAN Configurationhttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#EVPN/VXLAN_Configuration Spinehttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#Spine Leafhttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#Leaf End devices connectivityhttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#End_devices_connectivity Some routes informationshttps://wikitech.wikimedia.org/wiki/SONiC/Leaf-spine_testing#Some_routes_informations https://wikitech.wikimedia.org/wiki/Auto_schema/examples This page is for examples of check functions: https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22#What_we've_accomplished Search - Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22#Search_-_Analysis Search - Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22#Search_-_Update_Pipeline Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-22#Misc https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/RabbitmqNetworkPartition == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/RabbitmqNetworkPartition#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/RabbitmqNetworkPartition#Debugging https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/foxtrot-ldap This page contains information on Toolforge foxtrot-ldap, a project to help setting up a fake LDAP server deployment mainly for Toolforge lima-kilo, local kubernetes environment in a given local machine (like a laptop), to help develop some of the Toolforge internal components. https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#What_we've_accomplished Search Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#Search_Analysis Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#Search_Update_Pipeline Search SLOhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#Search_SLO Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28#Misc https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65 == 2023-04-30 == 2023-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-30 2023-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-29 2023-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-28 2023-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-27 2023-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-26 2023-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-25 2023-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-24 2023-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-22 2023-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-21 2023-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-20 2023-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-19 2023-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-18 2023-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-17 2023-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-16 2023-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-15 2023-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-14 2023-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-13 2023-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-12 2023-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-11 2023-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-10 2023-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-08 2023-04-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-07 2023-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-06 2023-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-05 2023-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-04 2023-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-03 2023-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#2023-04-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_65#Other_archives https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4 In Q4, the Search Platform team will primarily focus on finishing the Search Update Pipeline work, to address architectural limitations that have been causing failures in edits being accurately reflected in search indexes for users. Q4 OKRshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Q4_OKRs Objective 1: Users can reliably query information on Wikidata, and search on wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Objective_1:_Users_can_reliably_query_information_on_Wikidata,_and_search_on_wikis Objective 2: Searchers of emerging languages can search in their own languagehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Objective_2:_Searchers_of_emerging_languages_can_search_in_their_own_language Project plan (Q4):https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Project_plan_(Q4): Things we shiphttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Things_we_ship Fix update pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Fix_update_pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Improve_multilingual_zero-results_rate Things we planhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Things_we_plan Create project plan for WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Create_project_plan_for_WDQS_graph_splitting Finalize Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2022-2023_Q4#Finalize_Search_SLOs https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02 = Toolforge Workgroup meeting 2023-05-02 notes = Toolforge Workgroup meeting 2023-05-02 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Toolforge_Workgroup_meeting_2023-05-02_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Notes Meeting facilitator rotationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Meeting_facilitator_rotation Toolforge stability issues https://phabricator.wikimedia.org/T335009https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Toolforge_stability_issues_https://phabricator.wikimedia.org/T335009 Creating APIs from swagger definitionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Creating_APIs_from_swagger_definitions Continuous deployment experimentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Continuous_deployment_experiments Toolforge: consider replacing admission controllers with an existing policy admin projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Toolforge:_consider_replacing_admission_controllers_with_an_existing_policy_admin_project May 8th buildpack betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#May_8th_buildpack_beta Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-05-02#Action_items https://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-02_Phabricator_outage_during_GitLab_maintenance#Scorecard https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-05 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-05#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-05#What_we've_accomplished Search Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-05#Search_Analysis Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-05#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-05#Misc https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown This happens when the prometheus host is not able to do an https request to the harbor instance. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown#Common_issues Issue 1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown#Issue_1 Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown This happens when prometheus has no data from the blackbox exported on the harbor instance for the project. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown#Common_issues Issue 1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown#Issue_1 Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborProbeUnknown#Old_incidents https://wikitech.wikimedia.org/wiki/Sandbox-oncallregions == Upcoming business hours oncall schedule (experimental) == Upcoming business hours oncall schedule (experimental)https://wikitech.wikimedia.org/wiki/Sandbox-oncallregions#Upcoming_business_hours_oncall_schedule_(experimental) Oncall & Clinic Duty Schedulehttps://wikitech.wikimedia.org/wiki/Sandbox-oncallregions#Oncall_&_Clinic_Duty_Schedule https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Summary Hypothesis:https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Hypothesis: Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_prometheus_down_in_ulsfo_and_eqsin#Scorecard https://wikitech.wikimedia.org/wiki/Puppet/Runbooks = Puppet Disabled = Puppet Disabledhttps://wikitech.wikimedia.org/wiki/Puppet/Runbooks#Puppet_Disabled https://wikitech.wikimedia.org/wiki/Service/IPoid | heading5 = Contacts Queryinghttps://wikitech.wikimedia.org/wiki/Service/IPoid#Querying Data pipelinehttps://wikitech.wikimedia.org/wiki/Service/IPoid#Data_pipeline Service Dependencieshttps://wikitech.wikimedia.org/wiki/Service/IPoid#Service_Dependencies Databasehttps://wikitech.wikimedia.org/wiki/Service/IPoid#Database Service Monitoringhttps://wikitech.wikimedia.org/wiki/Service/IPoid#Service_Monitoring Ownershiphttps://wikitech.wikimedia.org/wiki/Service/IPoid#Ownership Cronjobshttps://wikitech.wikimedia.org/wiki/Service/IPoid#Cronjobs Deploymenthttps://wikitech.wikimedia.org/wiki/Service/IPoid#Deployment Prepare the deployment patchhttps://wikitech.wikimedia.org/wiki/Service/IPoid#Prepare_the_deployment_patch Commit message guidelineshttps://wikitech.wikimedia.org/wiki/Service/IPoid#Commit_message_guidelines See alsohttps://wikitech.wikimedia.org/wiki/Service/IPoid#See_also Deploy the patchhttps://wikitech.wikimedia.org/wiki/Service/IPoid#Deploy_the_patch staginghttps://wikitech.wikimedia.org/wiki/Service/IPoid#staging eqiadhttps://wikitech.wikimedia.org/wiki/Service/IPoid#eqiad codfwhttps://wikitech.wikimedia.org/wiki/Service/IPoid#codfw Checking output from a containerhttps://wikitech.wikimedia.org/wiki/Service/IPoid#Checking_output_from_a_container Monitor progress after deploymenthttps://wikitech.wikimedia.org/wiki/Service/IPoid#Monitor_progress_after_deployment Supporting documentation and relevant informationhttps://wikitech.wikimedia.org/wiki/Service/IPoid#Supporting_documentation_and_relevant_information https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown This is when the tekton-pipelines-controller pod in the tekton-pipelines namespace of tools/toolsbeta k8s cluster is down or can't be reached. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Debugging Doing a manual curl for the statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Doing_a_manual_curl_for_the_stats Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Common_issues Prometheus k8s cert expiredhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Prometheus_k8s_cert_expired Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonDown#Old_incidents https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Upgrading We have the following procedures in place to upgrade Airflow versions. Configure feature branchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Upgrading#Configure_feature_branch Update conda environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Upgrading#Update_conda_environment Execute unit testshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Upgrading#Execute_unit_tests Update debian packaging parametershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Upgrading#Update_debian_packaging_parameters Build the package with GitLab CIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Upgrading#Build_the_package_with_GitLab_CI https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown This happens when prometheus has no data from k8s on the tekton-pipelines-controller pod. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown#Common_issues Prometheus k8s cert expiredhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown#Prometheus_k8s_cert_expired Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/TektonUpMetricUnknown#Old_incidents https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator ==Quick Links== Quick Linkshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Quick_Links Managing the backlog and sprintshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Managing_the_backlog_and_sprints The backloghttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#The_backlog Sprintshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Sprints Sprint switch-over processhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Sprint_switch-over_process Sprint planning prephttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Sprint_planning_prep Sprint Planning Meetinghttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Sprint_Planning_Meeting Writing the sprint report emailhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Writing_the_sprint_report_email Updating future sprint columnshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Updating_future_sprint_columns Tools / Processes to make things easierhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/How_we_use_Phabricator#Tools_/_Processes_to_make_things_easier https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-05_wdqs_not_updating_in_codfw#Scorecard https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05 ==Week of May 01== Week of May 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05#Week_of_May_01 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05#=== Week of May 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05#Week_of_May_08 Week of May 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05#Week_of_May_15 Week of May 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05#Week_of_May_22 Week of May 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/05#Week_of_May_29 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-12 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-12#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-12#What_we've_accomplished Search - Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-12#Search_-_Analysis Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-12#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-12#Misc https://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps This page contains steps needed to migrate static miscweb sites from dedicated miscweb hosts to Kubernetes. This steps are for static sites only, dynamic applications (with databases for example) need additional steps. Information gatheringhttps://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps#Information_gathering Migration to GitLabhttps://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps#Migration_to_GitLab Setup GitLab CI pipelinehttps://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps#Setup_GitLab_CI_pipeline Deploy to Kuberneteshttps://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps#Deploy_to_Kubernetes Switch service traffichttps://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps#Switch_service_traffic Cleanuphttps://wikitech.wikimedia.org/wiki/Miscweb/Kubernetes_migration_steps#Cleanup https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Maintenance This page lists various common maintenance and content infrastructure tasks to be performed on Wikidata: https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client = Enabling a Wikidata Client on Wikimedia Wikis = Enabling a Wikidata Client on Wikimedia Wikishttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client#Enabling_a_Wikidata_Client_on_Wikimedia_Wikis Preparationhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client#Preparation Adding a new Wikidata Clienthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client#Adding_a_new_Wikidata_Client Follow-uphttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client#Follow-up Checklisthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client#Checklist Noteshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Enable_Client#Notes https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-18 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-18#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-18#What_we've_accomplished Search - Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-18#Search_-_Analysis Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-18#Operations_/_SRE https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Convert_Properties = Convert Properties to External IDs = Convert Properties to External IDshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Convert_Properties#Convert_Properties_to_External_IDs Preparationhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Convert_Properties#Preparation Converting Data Typeshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Convert_Properties#Converting_Data_Types https://wikitech.wikimedia.org/wiki/Incident_homepage_test Looking for information about incidents or have to report an incident? This page will help you find the right resource! Is there an ongoing incident?https://wikitech.wikimedia.org/wiki/Incident_homepage_test#Is_there_an_ongoing_incident? Want to check past incidents?https://wikitech.wikimedia.org/wiki/Incident_homepage_test#Want_to_check_past_incidents? New SRE or need training on incidents?https://wikitech.wikimedia.org/wiki/Incident_homepage_test#New_SRE_or_need_training_on_incidents? https://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-19_videoscaler/jobrunner#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-23_wdqs_CODFW_5xx_errors#Scorecard https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment [is a repository of [https://flink.apache. Whyhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Why Enrichment Jobshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Enrichment_Jobs mw-page-content-change-enrichhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#mw-page-content-change-enrich mediawiki.page_content_change semanticshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#mediawiki.page_content_change_semantics Missing contenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Missing_content Monitoringhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Monitoring Flink UIhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Flink_UI Upgrades and Deploymenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Upgrades_and_Deployment Local development and debugging with Kafkahttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Local_development_and_debugging_with_Kafka Running Kafkahttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Running_Kafka Running Flink using local Kafkahttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Running_Flink_using_local_Kafka Replaying events through Kafkahttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment#Replaying_events_through_Kafka https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2 == hgztools == hgztoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#hgztools mpaatoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#mpaatools novem-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#novem-bot wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wiki quipshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#quips update-transclusion-counthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#update-transclusion-count templatecreatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#templatecreator pg2wshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#pg2ws revisionstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#revisionstats commons-maintenance-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#commons-maintenance-bot ashotbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ashotbot fiwiki-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#fiwiki-tools sunafterrain-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#sunafterrain-bot urduspellcheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#urduspellchecker fiwiki-tool-webhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#fiwiki-tool-web mdanielsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#mdanielsbot videotutorialshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#videotutorials abothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#abot video2commons-socketiohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#video2commons-socketio ranghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#rang monmonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#monmon toolschecker-k8s-wshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#toolschecker-k8s-ws voiceintrohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#voiceintro msynbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#msynbot acoustidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#acoustid webarchivebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#webarchivebot stradbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#stradbot adhs-wdehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#adhs-wde binglehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#bingle directoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#directory ramzbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ramzbot ores-support-checklisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ores-support-checklist examplehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#example geograph2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#geograph2commons digitaltmuseumhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#digitaltmuseum article-locationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#article-locations taxonbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#taxonbot svwiktionaryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#svwiktionary wdreconcilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wdreconcile hsshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#hss jawihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#jawi irc-wmthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#irc-wmt gyanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#gyan wcdohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wcdo mybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#mybot friybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#friybot tesseract-ocr-servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#tesseract-ocr-service embeddeddatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#embeddeddata osmcountshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#osmcounts suggestbotbnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#suggestbotbn lifewebhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#lifeweb indic-ocrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#indic-ocr datacon-schedule-apphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#datacon-schedule-app outreachy-sayani-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#outreachy-sayani-tool aaabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#aaabot magoghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#magog periodssuckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#periodssuck zabe-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#zabe-test unpkghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#unpkg derobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#derobot speedpatrollinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#speedpatrolling kanzatimagerequestshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#kanzatimagerequests chocobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#chocobot elvisorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#elvisor wlminhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wlmin kaspar2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#kaspar2commons lshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ls csskhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#cssk stats-backhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#stats-back ibrahimhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ibrahim ninthcircuithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ninthcircuit entityshapehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#entityshape loggerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#logger yahyashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#yahyas shiladhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#shilad steinsplitterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#steinsplitter parliament-diagram-generatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#parliament-diagram-generator menobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#menobot quentinv57-botshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#quentinv57-bots wikidata-delinkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikidata-delinker signposthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#signpost citytimehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#citytime depiction-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#depiction-game wiktioutilshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wiktioutils signature-checkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#signature-checker jackbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#jackbot hunsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#hunsbot wikimotivoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikimotivos afch-updaterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#afch-updater wmde-reference-previewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wmde-reference-previews oscoorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#oscoor webservicenghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#webserviceng bub2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#bub2 sql-optimizerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#sql-optimizer quickcategorieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#quickcategories bd808-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#bd808-test randmojihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#randmoji notif-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#notif-bot missingpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#missingpages featured-content-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#featured-content-bot peekhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#peek ipythonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ipython rubin16https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#rubin16 autoedithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#autoedit force-rebasehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#force-rebase wiki2htmlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wiki2html wakthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wakt board-elections-compass-2022https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#board-elections-compass-2022 maintgraphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#maintgraph pywikibot-twhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#pywikibot-tw wikiusoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikiusos my-first-django-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#my-first-django-tool witshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wits wmbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wmb nopapayahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#nopapaya betabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#betabot fastily-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#fastily-test zygservhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#zygserv gerrit-reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#gerrit-reports pageviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#pageviews renderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#render mariahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#maria geocommonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#geocommons grouplenshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#grouplens repihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#repi accounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#account tichyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#tichy betawebhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#betaweb templatecheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#templatecheck map-searchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#map-search wikitriphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikitrip taiwaniabot1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#taiwaniabot1 asaifmbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#asaifmbot scotus-recordingshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#scotus-recordings betacommand-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#betacommand-dev section-topics-schemahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#section-topics-schema render-testshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#render-tests sau226testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#sau226test g8-patrolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#g8-patrol cluebotng-reviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#cluebotng-review emausbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#emausbot wikimetrics-developmenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikimetrics-development zedlikbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#zedlikbot portal-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#portal-stats parahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#para admin-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#admin-test xdebugtesting1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#xdebugtesting1 irchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#irc interactoahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#interactoa alberobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#alberobot searchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#search wikimediaui-styleguidehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikimediaui-styleguide usernamesearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#usernamesearch add-texthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#add-text komla-test1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#komla-test1 wbwcalculatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wbwcalculator mikasa-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#mikasa-bot tool-accounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#tool-account test001https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#test001 sbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#sbot wikimetricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikimetrics wiki-as-githttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wiki-as-git wudelehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wudele sparrowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#sparrow arbotahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#arbota wikibookassamesehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikibookassamese wikistreakhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikistreak wikidata-externalid-urlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikidata-externalid-url iabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#iabot wmk-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wmk-dev checkpersondatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#checkpersondata spamforbreakfasthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#spamforbreakfast mjlbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#mjlbot suchaserverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#suchaserver wiki2emailhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wiki2email wikifunc-labelizehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikifunc-labelize wikiatlas2014https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikiatlas2014 contrabandhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#contraband wikiroupashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikiroupas ashottoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ashottools xtools-mab-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#xtools-mab-dev wmfdbbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wmfdbbot jjmc89-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#jjmc89-bot image-recommendation-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#image-recommendation-api cxdebuggerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#cxdebugger wlxjuryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wlxjury itemsubjector-jsamwriteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#itemsubjector-jsamwrites transclusioncounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#transclusioncount simplehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#simple wikimenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikiment digerohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#digero joinedventurehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#joinedventure simplewdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#simplewd hirokbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#hirokbot denohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#deno taweethamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#taweetham thankscounterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#thankscounter liangent-toolserverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#liangent-toolserver new-q5https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#new-q5 linkybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#linkybot commons-potyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#commons-poty seachstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#seachstats xfd-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#xfd-stats common-interestshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#common-interests pbbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#pbbot monitorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#monitor refill-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#refill-api authorlang-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#authorlang-game currenteventshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#currentevents newusershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#newusers cliverbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#cliverbot icalendarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#icalendar supercounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#supercount hawk-eye-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#hawk-eye-bot wikitranslatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikitranslator slfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#slf dannys712-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#dannys712-bot wdq_checkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wdq_checker itwiki-scuola-italianahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#itwiki-scuola-italiana yichengtryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#yichengtry suyash-sandarbhhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#suyash-sandarbh bytesaddedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#bytesadded wizarbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wizarbot kumahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#kuma jbbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#jbbot obaidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#obaid trusty-deprecationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#trusty-deprecation patrol-daily-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#patrol-daily-stats herculebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#herculebot attributionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#attribution wlm-italyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wlm-italy freddy2001https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#freddy2001 incubatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#incubator reviewtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#reviewtools wikiloveshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikiloves intelibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#intelibot wikinews-pagestatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikinews-pagestats pathbot-test-1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#pathbot-test-1 dump-torrentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#dump-torrents wm-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wm-bot graminbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#graminbot k8s-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#k8s-status catbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#catbot super-admin-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#super-admin-bot nyandatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#nyandata article-link-gender-datahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#article-link-gender-data xtools-articleinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#xtools-articleinfo cvnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#cvn svgedit-dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#svgedit-dashboard toolviewstesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#toolviewstest hroesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#hroest ifttt-testinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ifttt-testing t187305-demohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#t187305-demo nimble-serverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#nimble-server lbenedixhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#lbenedix alphatesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#alphatest death-anomalieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#death-anomalies sdzerobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#sdzerobot global-search-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#global-search-test v-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#v-wiki eatchabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#eatchabot pileviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#pileviews authorbot-duplicates-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#authorbot-duplicates-game wmithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wmit schubotahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#schubota ryanbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ryanbot ramphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#ramp wikisource-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#wikisource-api testtool-101https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/2#testtool-101 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4 == contropedia == contropediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#contropedia oabot-wd-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#oabot-wd-game multideschttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#multidesc hiw-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hiw-bot refillhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#refill dyk-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#dyk-tools hroest2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hroest2 narahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#nara redirtalkdeleterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#redirtalkdeleter raymondyee-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#raymondyee-test database-reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#database-reports wikiedudashboard-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikiedudashboard-test qedkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#qedkbot adminhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#admin embeddedincounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#embeddedincount teghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#teg archive-thingshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#archive-things ocr-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ocr-test global-search-prohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#global-search-pro wordpilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wordpile local-southparkfanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#local-southparkfan eizenchanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#eizenchan maintainershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#maintainers geonoticehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#geonotice completerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#completer peachy-docshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#peachy-docs swviewer-servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#swviewer-service leekbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#leekbot retentionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#retention view-ithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#view-it wikivoyagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikivoyage darwin-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#darwin-test telefabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#telefabot unpaywall-importerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#unpaywall-importer wm-whathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wm-what danilohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#danilo everythingisconnectedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#everythingisconnected toolhub-gadget-demohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#toolhub-gadget-demo c01bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#c01bot plstoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#plstools editgroupshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#editgroups krinklebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#krinklebot import-500pxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#import-500px onetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#onetools jogobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#jogobot irishbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#irishbot flickrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#flickr totoazerohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#totoazero rc-vikidiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#rc-vikidia nomadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#nomad msynabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#msynabot archive-things-1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#archive-things-1 commons-app-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#commons-app-stats rotbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#rotbot botadventureshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#botadventures omegabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#omegabot alkamidbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#alkamidbot mediaviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mediaviews hostbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hostbot hsfbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hsfbot shuaibhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#shuaib pywikibot-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#pywikibot-test api-citationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#api-citations push-notifications-helperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#push-notifications-helper wikibattlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikibattle queryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#query wscdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wscd inactive-bureaucratshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#inactive-bureaucrats gitlabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#gitlab mapillary-commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mapillary-commons video-cut-tool-front-endhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#video-cut-tool-front-end shexstatementshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#shexstatements weapon-of-mass-descriptionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#weapon-of-mass-description twl17https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#twl17 metaminehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#metamine vicbot2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#vicbot2 arwp10https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#arwp10 isbn2tplhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#isbn2tpl rotatebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#rotatebot scratchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#scratch sulinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#sulinfo panoviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#panoviewer test-webservice-generichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#test-webservice-generic glamtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#glamtools croptool-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#croptool-test local-roothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#local-root query-universehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#query-universe atriskwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#atriskwiki gerrit-reviewer-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#gerrit-reviewer-bot shieldshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#shields highly-agitated-pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#highly-agitated-pages ffbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ffbot shufflehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#shuffle merl-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#merl-dev zoomviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#zoomviewer benin1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#benin1 interbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#interbot protectionpredictorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#protectionpredictor jira-bugimporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#jira-bugimport bodh-backend-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#bodh-backend-test wdcmtqlinkinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wdcmtqlinking jshinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#jshint ftlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ftl helphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#help wikitrendshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikitrends xinugodwikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#xinugodwikibot nodetreehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#nodetree basebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#basebot refcreatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#refcreator commonsedgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#commonsedge manishearthhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#manishearth wiki-embedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wiki-embed votehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#vote nordic-museum-depictshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#nordic-museum-depicts non-reverted-edit-counterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#non-reverted-edit-counter denisahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#denisa i-want-to-votehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#i-want-to-vote bomwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#bomwiki buphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#bup thebookhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#thebook citationgraphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#citationgraph projektneuheiten-feedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#projektneuheiten-feed datasetshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#datasets ltahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#lta namkoronhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#namkoron orthohinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#orthohin chlodbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#chlodbot wiki3dhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wiki3d crosswatch2019https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#crosswatch2019 misc2svghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#misc2svg book2scrollv2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#book2scrollv2 lahitoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#lahitools community-tech-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#community-tech-tools toolscheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#toolschecker goodarticlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#goodarticle agpbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#agpb captionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#captions ichijohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ichijo mediaviews-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mediaviews-api wikisobahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikisoba relaxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#relax mohibhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mohib topic-finderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#topic-finder wikipedia-fetch-contenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikipedia-fetch-content ri-diff-fixture-updaterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ri-diff-fixture-updater gitlab-webhookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#gitlab-webhooks useredit2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#useredit2 alexabotsihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#alexabotsi lastactiveadmshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#lastactiveadms ptablehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ptable nadahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#nada wordyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wordy privacy-budgethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#privacy-budget doc-test-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#doc-test-tool reftoolbarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#reftoolbar wlmjudginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wlmjudging klossebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#klossebot eranbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#eranbot cdrbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#cdrbot lestatyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#lestaty bbc-tv-citehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#bbc-tv-cite dummy-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#dummy-tool pathoschild-contribhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#pathoschild-contrib dumpshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#dumps hkjacksonhk-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hkjacksonhk-bot toolforge-galleryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#toolforge-gallery parliamentdiagramtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#parliamentdiagramtest item-quality-evaluatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#item-quality-evaluator shex-simplehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#shex-simple blockaroundhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#blockaround glamshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#glams campaigns-retentionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#campaigns-retention code-essayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#code-essay tedbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#tedbot wdmmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wdmm ru_monumentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ru_monuments openipmaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#openipmap zonestamphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#zonestamp outreachy-wikicvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#outreachy-wikicv db-nameshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#db-names verifyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#verify sal-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#sal-test apersonbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#apersonbot jeremyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#jeremy idsgenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#idsgen edit-wizardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#edit-wizard antigng-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#antigng-bot wahldiagrammhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wahldiagramm paws-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#paws-status img-usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#img-usage diff-privacyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#diff-privacy botutorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#botutor sergobot-statisticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#sergobot-statistics vlsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#vlsbot editshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#edits nitlowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#nitlow helperpadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#helperpad rfa-voting-historyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#rfa-voting-history audetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#audetools taxoboxalyzerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#taxoboxalyzer thparkthsqlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#thparkthsql botwikiawkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#botwikiawk testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#test jjmc89-bot-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#jjmc89-bot-dev ml-article-descriptionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ml-article-descriptions bridgebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#bridgebot audehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#aude funpediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#funpedia swtdemohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#swtdemo recentcxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#recentcx icelabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#icelab selimhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#selim fengtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#fengtools livingstyleguide-prototypehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#livingstyleguide-prototype maiwiki-editathonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#maiwiki-editathon registro-cancellazionihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#registro-cancellazioni dockerregistryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#dockerregistry seealsologyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#seealsology withoutanamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#withoutaname rembothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#rembot wlmpthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wlmpt mohammedbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mohammedbot tooltranslatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#tooltranslate mscbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mscbot dluxbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#dluxbot osm-gadget-leaflethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#osm-gadget-leaflet ipbehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ipbe hello-playhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hello-play potd-feedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#potd-feed sp1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#sp1 borrachohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#borracho sqlcheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#sqlchecker w2cmonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#w2cmon enwp10https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#enwp10 wikithon-hall-of-famehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikithon-hall-of-fame linkrecommenderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#linkrecommender test-lighttpd-precisehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#test-lighttpd-precise rfxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#rfx flossbrowserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#flossbrowser section-image-suggestions-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#section-image-suggestions-test review-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#review-stats pubchem-wikidata-updateshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#pubchem-wikidata-updates snapshotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#snapshots ores-afchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#ores-afc bennofsplayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#bennofsplay helperbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#helperbot mwphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#mwp farhangestanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#farhangestan wp-worldhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wp-world yellowbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#yellowbot kanzatcopyviohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#kanzatcopyvio blockyqueryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#blockyquery wikintuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikintu wikisource-penguin-classicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#wikisource-penguin-classics gerrit-newcomer-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#gerrit-newcomer-bot linksearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#linksearch zhwiki-teleirchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#zhwiki-teleirc billsbotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#billsbots enterpriseybot-rshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#enterpriseybot-rs yapperbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#yapperbot reise-reisehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#reise-reise voxelbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#voxelbot primebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#primebot hashtags-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#hashtags-test karsilayicihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#karsilayici revihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#revi thedavetoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#thedavetool cobainhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/4#cobain https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5 == backstage-api-catalog == backstage-api-cataloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#backstage-api-catalog ajapaikhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ajapaik zygimantus-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#zygimantus-dev c02bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#c02bot wfindhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wfind shrinitoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#shrinitools missingtopicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#missingtopics ferdibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ferdibot countryiphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#countryip etwelvetesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#etwelvetest wdpdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wdpd javatesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#javatest trendhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#trend ptwikishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ptwikis mdaniels-refill-ng-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mdaniels-refill-ng-api sitelinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#sitelinks iwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#iw title-searchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#title-search listshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#lists popularpages-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#popularpages-dev shotbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#shotbot legoktm-adminbotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#legoktm-adminbots kokoloreshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#kokolores wd-rankhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wd-rank pablo-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pablo-test scholiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#scholia octrabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#octrabot paws-publishedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#paws-published liepphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#liepp quickqueryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#quickquery otrsreportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#otrsreports patsabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#patsabot welcomebots-bnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#welcomebots-bn sam-2727bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#sam-2727bot switchmasterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#switchmaster dibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dibot earwig-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#earwig-dev zhuyifei1999-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#zhuyifei1999-test linkcheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#linkchecker fastilybot-reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#fastilybot-reports languagebar-uihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#languagebar-ui bracketbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#bracketbot wasianhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wasian genedbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#genedb tuschttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tusc gsoc-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#gsoc-dev wikilovesbrasilhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikilovesbrasil statanalyserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#statanalyser yacbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#yacbot wm-cee-springhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wm-cee-spring itwp-deletionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#itwp-deletions wikifactmine-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikifactmine-api android-sdk-buildshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#android-sdk-builds prop-explorerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#prop-explorer kiranbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#kiranbot new-page-linkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#new-page-linker wiki-importerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wiki-importer movestatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#movestats inforobbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#inforobbot commons-aiuserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#commons-aiuser porttihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#portti pointyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pointy xlinkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#xlinkbot osmbstathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#osmbstat globalusagecounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#globalusagecount fireflytoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#fireflytools wikigradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikigrade njsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#njsbot rankhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#rank bnwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#bnwiki local-awbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#local-awb gutrshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#gutrs bot873https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#bot873 cdnjshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#cdnjs mismatch-finderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mismatch-finder order-user-by-reghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#order-user-by-reg telegram-wikilinksbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#telegram-wikilinksbot xxn-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#xxn-tools infogeohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#infogeo outreachy-recent-edits-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#outreachy-recent-edits-tool elphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#elph etwikibotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#etwikibots a-list-bulding-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#a-list-bulding-tool janethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#janet hujihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#huji spi-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#spi-tools dewikinews-rsshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dewikinews-rss stylizehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#stylize mwph-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mwph-api koishihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#koishi yf-rfcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#yf-rfcbot wikilinkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikilinkbot continuitybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#continuitybot energybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#energybot sixdegreeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#sixdegrees reasomicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#reasomics ksamsok-resthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ksamsok-rest prime-draftnocathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#prime-draftnocat sprinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#sprint itwikinews-rsshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#itwikinews-rss copypatrolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#copypatrol wahranihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wahrani aiko-citationhunthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#aiko-citationhunt citation-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#citation-bot arambothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#arambot gpsexifhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#gpsexif tfaprotbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tfaprotbot roccerbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#roccerbot is-deployedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#is-deployed xn--dk8hv9ghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#xn--dk8hv9g fvcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#fvcbot wikiwhatsappbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikiwhatsappbot lil-cvnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#lil-cvn fireflybot2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#fireflybot2 reflinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#reflinks semgrep-rule-mergehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#semgrep-rule-merge legobot-2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#legobot-2 botomatikhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#botomatik p4-linkiehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#p4-linkie visualeditorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#visualeditor wcam-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wcam-bot ocrtoyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ocrtoy ultraviolethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ultraviolet outreachy-usereditshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#outreachy-useredits winterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#winter maphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#map ashikbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ashikbot hirisehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#hirise pywikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pywikibot cargo-hierarchyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#cargo-hierarchy hippietesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#hippietest wikicite-dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikicite-dashboard mobilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mobile ldaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ldap forrestbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#forrestbot chatwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#chatwiki denkmallistehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#denkmalliste mw2sparqlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mw2sparql revibot-ivhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#revibot-iv ephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ep isinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#isin csbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#csbot dewikivpncheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dewikivpncheck wmve-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wmve-dev cats-phphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#cats-php ebraminio-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ebraminio-dev citation-template-fillinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#citation-template-filling fwdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#fwd spacemediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#spacemedia dixondbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dixondbot pearbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pearbot geekbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#geekbot taim-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#taim-bot neuromathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#neuromat pisgbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pisgbot wikiauthbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikiauthbot kasper-data-translatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#kasper-data-translator ifttthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ifttt poiimporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#poiimport uaacheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#uaachecker frondshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#fronds cluebotng-staginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#cluebotng-staging actrialhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#actrial footygenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#footygen itwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#itwiki serviceawardshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#serviceawards mabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mabot wiki-embed-pochttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wiki-embed-poc patrubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#patrubot whichsubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#whichsub lua-catscan2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#lua-catscan2 speedydeletionwikiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#speedydeletionwikia dawikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dawikibot wugbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wugbot cluebot3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#cluebot3 nkcr-catmanduhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#nkcr-catmandu wd-ref-islandhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wd-ref-island mathqahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mathqa draftifyhistoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#draftifyhistory wikimetrics-productionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikimetrics-production gorlingorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#gorlingor largedatasetbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#largedatasetbot xtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#xtools suggestbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#suggestbot bookreaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#bookreader stashbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#stashbot dykmoverbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dykmoverbot ocr4wikisourcehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ocr4wikisource wdbeoupdatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wdbeoupdate universalviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#universalviewer erinnermichhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#erinnermich prvnotificationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#prvnotifications postcardcatfinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#postcardcatfinder fthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ft reviewershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#reviewers dispenserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dispenser uhaibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#uhaibot goatidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#goatid wjazhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wjaz communityguidelineshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#communityguidelines covidbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#covidbot api-docshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#api-docs tools-galleryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tools-gallery shbibbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#shbibbot sblhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#sbl shorturlshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#shorturls booksplitterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#booksplitter wpbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wpb wdmaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wdmap pyshexyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pyshexy mcdc-election-compasshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mcdc-election-compass aswnbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#aswnbot texbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#texbot bstorm-tool2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#bstorm-tool2 matthobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#matthobot toolserver-home-archivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#toolserver-home-archive tnthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tnt wikimetrics-staginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikimetrics-staging wordtowiki-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wordtowiki-dev morfeuszhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#morfeusz wikiauthbot-discordbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikiauthbot-discordbot best-imagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#best-image dragobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dragobot airflowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#airflow firefly-maintainer1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#firefly-maintainer1 snaevar-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#snaevar-bot spellbot-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#spellbot-dev ws-searchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ws-search purgerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#purger tts-comparisonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tts-comparison galobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#galobot ws-contest-backendhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#ws-contest-backend eulenwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#eulenwiki vukkybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#vukkybot phamhi-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#phamhi-tool tronbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tronbot zh-afc-helperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#zh-afc-helper vpsalertmanagerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#vpsalertmanager lziadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#lziad wikiedudashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikiedudashboard hashtagwatcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#hashtagwatcher wikipedia-android-buildshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikipedia-android-builds heinterwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#heinterwiki alvarohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#alvaro glamorous-maintenancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#glamorous-maintenance tsreportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tsreports taxonkatbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#taxonkatbot aivanalysishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#aivanalysis svgtranslatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#svgtranslate glamifyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#glamify dewikigreetbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#dewikigreetbot wm-commons-emoji-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wm-commons-emoji-bot phetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#phetools alaabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#alaabot openstack-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#openstack-browser deletion-notification-bot-2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#deletion-notification-bot-2 tbloeminkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tbloemink bubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#bub leptibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#leptibot sequencerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#sequencer anomiebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#anomiebot wikidata-todohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#wikidata-todo tree-of-lifehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#tree-of-life abbe98toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#abbe98tools masscampshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#masscamps amdbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#amdb pdlarcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#pdlarcher mwversionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/5#mwversion https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6 == tabulist == tabulisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#tabulist content-gaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#content-gap fikarummethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#fikarummet sonitoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#sonitool oauthtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#oauthtest grantsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#grantsbot catfoodhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#catfood simplewikthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#simplewikt ananthrk-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ananthrk-test beastiebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#beastiebot articleplaceholderwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#articleplaceholderwiki patrollerinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#patrollerinfo isa-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#isa-dev vizbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#vizbot monumental-glamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#monumental-glam kirstentesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#kirstentest ciaworldfactbookbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ciaworldfactbookbot image-content-filtrationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#image-content-filtration zhnotofuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#zhnotofu wiki-zulip-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wiki-zulip-bot ireashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ireas oudabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#oudabot ashbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ashbot articleimpacthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#articleimpact created-articles-mapperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#created-articles-mapper a-z-phttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#a-z-p interact-oahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#interact-oa wikiprovenancehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikiprovenance daniuu-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#daniuu-bot clickstream-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#clickstream-api scholia-analyticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#scholia-analytics dupdethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#dupdet mrmetadatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#mrmetadata arowfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#arowf topictagginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#topictagging xstoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#xstools tabletophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#tabletop glamalignhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#glamalign mdaniels-acc-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#mdaniels-acc-dev orator-matcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#orator-matcher yashehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#yashe wikibase-olympics-builderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikibase-olympics-builder wikipedia-readabilityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikipedia-readability map-of-monumentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#map-of-monuments test-vvvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#test-vvv mjolnirhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#mjolnir linkcounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#linkcount drewbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#drewbot my-first-django-oauth-apphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#my-first-django-oauth-app ndbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ndbot local-mapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#local-maps revertstathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#revertstat dijkstrasprojecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#dijkstrasproject analyticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#analytics freebasehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#freebase vectorizerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#vectorizer cvrminerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cvrminer morphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#morph timescalehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#timescale svgtranslate-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#svgtranslate-test guchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#guc unpatrollededitstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#unpatrollededitstats samhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#sam articlerequest-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#articlerequest-dev autometricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#autometrics contacthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#contact gerakibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#gerakibot citationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#citations sibutesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#sibutest twltoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#twltools cydebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cydebot lrbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#lrbot authorshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#authors shbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#shbot dalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#dal wlmpacommonscathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wlmpacommonscat phpinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#phpinfo cabalbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cabalbot geographhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#geograph osm-add-tagshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#osm-add-tags abibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#abibot giftbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#giftbot airbubblehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#airbubble copyedithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#copyedit revibot-iiihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#revibot-iii h2bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#h2bot cbng-sql-5https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cbng-sql-5 matthewrbowker-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#matthewrbowker-dev wikiarthistoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikiarthistory commons-android-apphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#commons-android-app liangent-phphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#liangent-php testwikishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#testwikis itwikiarticlebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#itwikiarticlebot analytalkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#analytalks botqahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#botqa wikifile-transferhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikifile-transfer animanga-db-matcher-backendhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#animanga-db-matcher-backend statisticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#statistics murbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#murbot railwayshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#railways unblockhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#unblock pirsquaredhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#pirsquared toolinfo-scraperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#toolinfo-scraper bodh-backendhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#bodh-backend citeimagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#citeimage congresseditshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#congressedits boringhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#boring yellowcardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#yellowcard languageproofinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#languageproofing seijabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#seijabot wmk-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wmk-tools erwin85https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#erwin85 maplayers-demohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#maplayers-demo ancestors2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ancestors2 heberhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#heber shrugbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#shrugbot typo-fixerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#typo-fixer testtool-103https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#testtool-103 discogs2pisteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#discogs2pistes cpbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cpb pandatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#pandata simple-view-pagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#simple-view-page wikilinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikilint dynbot-srv1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#dynbot-srv1 logojudgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#logojudge faceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#faces contrabandapphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#contrabandapp editcount-frhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#editcount-fr irc-cloudbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#irc-cloudbot jitse-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#jitse-bot luke081515bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#luke081515bot gguhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ggu dpkghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#dpkg furveyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#furvey statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#stats saperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#saper refswikipediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#refswikipedia raehhamsanghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#raehhamsang igloohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#igloo sdmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#sdm enwikt-translationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#enwikt-translations wdumpshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wdumps locktoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#locktool article-ideas-generatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#article-ideas-generator lambarchiverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#lambarchiver media-search-signal-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#media-search-signal-test redpandahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#redpanda ircservservhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ircservserv wikinity-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikinity-test wdvdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wdvd nagfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#nagf trusty-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#trusty-tools citeplatohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#citeplato ajapaik2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ajapaik2commons botriconfermehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#botriconferme kotoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#kotools leksem-indonesiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#leksem-indonesia abigorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#abigor ping08bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ping08bot wd-analysthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wd-analyst fa-checkwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#fa-checkwiki first-paragraph-readabilityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#first-paragraph-readability user-contributions-feedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#user-contributions-feed wikidata-slicerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikidata-slicer svg-map-makerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#svg-map-maker gawahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#gawa enhourlyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#enhourly bd808-rubyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#bd808-ruby geoexporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#geoexport iepcbm-bot1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#iepcbm-bot1 napalmbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#napalmbot olsibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#olsibot emijrpbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#emijrpbot catscan2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#catscan2 extendrorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#extendror mortarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#mortar lp-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#lp-tools lexeme-senseshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#lexeme-senses idwiki-marathonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#idwiki-marathon abohadihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#abohadi w-slackbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#w-slackbot chie-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#chie-bot valhallasw-testing-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#valhallasw-testing-tool hrwphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#hrwp osm-gadgethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#osm-gadget descriptionsuggesterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#descriptionsuggester osmkmlmaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#osmkmlmap searchyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#searchy outreachy-sagorika1996https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#outreachy-sagorika1996 imageryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#imagery scribehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#scribe urlinktranslatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#urlinktranslator bullseyehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#bullseye pinyin-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#pinyin-wiki pagelisterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#pagelister matthewrbot-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#matthewrbot-dev rfastatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#rfastats sawtpediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#sawtpedia stretch-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#stretch-tools wikiblamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikiblame liangent-migration-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#liangent-migration-test whodunnithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#whodunnit itnsynhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#itnsyn pagecounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#pagecount mlwikisourcehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#mlwikisource wlm-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wlm-stats fpcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#fpcbot zinbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#zinbot translatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#translate wikitracetesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikitracetest artuploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#artuploader mide-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#mide-dev amarbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#amarbot cuaggbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cuaggbot heimdallhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#heimdall historicmapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#historicmaps sanaahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#sanaa kizulebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#kizulebot wyimportbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wyimportbot editathonstathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#editathonstat knowledge-gapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#knowledge-gaps quarrybot-enwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#quarrybot-enwiki inkpenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#inkpen muninnbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#muninnbot edinbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#edinbot bambotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#bambots matildahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#matilda dbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#db search-filtershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#search-filters arsivleyicipwbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#arsivleyicipwb wikicrowdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikicrowd wam-article-suggestionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wam-article-suggestions superyetkinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#superyetkin visualcategorieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#visualcategories twitterbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#twitterbot books-for-bindinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#books-for-binding coibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#coibot wikitoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikitools wafaashohdyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wafaashohdy unblockbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#unblockbot ijchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ijc extremehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#extreme maintenance-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#maintenance-bot ktchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ktc catscorehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#catscore commonshelperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#commonshelper wlmitaly2019https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wlmitaly2019 cdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#cd orphan-groupshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#orphan-groups commonsuploadsumhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#commonsuploadsum anticompositetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#anticompositetools reviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#reviewer bovlbbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#bovlbbot bikeshedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#bikeshed metahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#meta drinihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#drini compare-accountshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#compare-accounts nskaggs-playgroundhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#nskaggs-playground indic-wscontesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#indic-wscontest xdebugtestinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#xdebugtesting readmorehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#readmore ricordisamoahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#ricordisamoa wmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wm afchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#afch wikidata-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#wikidata-game section-redirecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#section-redirect catwatchbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#catwatchbot dixtosahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/6#dixtosa https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7 == mfw-bww == mfw-bwwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mfw-bww genealogyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#genealogy symabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#symabot meta-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#meta-dev rillkehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#rillke prosjektbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#prosjektbot wikitanvirbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikitanvirbot securityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#security local-oclc-referencehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#local-oclc-reference mediawiki2latexhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mediawiki2latex juryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#jury elobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#elobot datawiki-complete-gadgethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#datawiki-complete-gadget cihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ci wikidata-trendshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikidata-trends hermeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hermes wibihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wibi twofivesixhubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#twofivesixhub thumb-pokehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#thumb-poke wikiwatchdoghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikiwatchdog isitdeployedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#isitdeployed mpghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mpg production-error-tasks-metricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#production-error-tasks-metrics commonsnotificationbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#commonsnotificationbot aftabbotbnwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#aftabbotbnwiki ruprechthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ruprecht osmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#osm widarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#widar redwarnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#redwarn twlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#twl wikihistoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikihistory sejmeditshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#sejmedits wikinewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikinews stretchquestionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#stretchquestion incubatordashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#incubatordashboard telegram-auth-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#telegram-auth-bot parsechttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#parsec wlmukhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wlmuk dvorapabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#dvorapabot inkowikhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#inkowik article2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#article2 odder-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#odder-dev okmapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#okmaps baljeetsinghhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#baljeetsingh eagleeyehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#eagleeye mywikitoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mywikitool zhwpafcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#zhwpafcbot tpbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tpbot heritagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#heritage disambinatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#disambinator wdq-checkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wdq-checker fountain-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#fountain-test graham87https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#graham87 kianhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#kian wiper-languagetoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wiper-languagetool wdprophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wdprop librewikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#librewiki commonsarchivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#commonsarchive cluebotng-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#cluebotng-api lightmessagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#lightmessage revitalizebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#revitalizebot massviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#massviews archiveleafhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#archiveleaf duplicate-coordshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#duplicate-coords sparqlblockshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#sparqlblocks wd-deletedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wd-deleted wlemapdehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wlemapde quickstatementshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#quickstatements articles-needing-linkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#articles-needing-links toolhub-extension-demohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#toolhub-extension-demo depictionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#depictions enbotenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#enboten piglobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#piglobot bookwormhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bookworm weeklypediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#weeklypedia wlmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wlm earlywarningbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#earlywarningbot ws-google-ocrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ws-google-ocr mix-n-matchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mix-n-match kharbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#kharbot petscan-mdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#petscan-md bibliodatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bibliodata dschwenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#dschwenbot author-disambiguatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#author-disambiguator authhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#auth ia-uploadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ia-upload ideedarticleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ideedarticles wikiportretdevhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikiportretdev gsoc-worklist-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#gsoc-worklist-tool chemobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#chemobot kolegahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#kolega asanack-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#asanack-bot fischbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#fischbot globalrenamereviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#globalrenamereview baljeetdhaliwalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#baljeetdhaliwal alertlivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#alertlive videocuttoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#videocuttool rpi2026f1-taxonomy-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#rpi2026f1-taxonomy-bot emoocievhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#emoociev templatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#templator ukwiki-analysishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ukwiki-analysis canarybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#canarybot testwikistatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#testwikistats findithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#findit imageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#images amorybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#amorybot luke081515bot-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#luke081515bot-dev custom-utilshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#custom-utils otrs-helperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#otrs-helper vipbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#vipbot wlmushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wlmus transcriberhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#transcriber zhwiki-username-checkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#zhwiki-username-check edinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#edin file-reuse-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#file-reuse-test panopticonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#panopticon commonshelper2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#commonshelper2 peachyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#peachy dexibotnethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#dexibotnet hypobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hypobot hat-collectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hat-collector tnt-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tnt-dev wembedderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wembedder cassandra-israelhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#cassandra-israel hashtags-hubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hashtags-hub fatemihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#fatemi mediawiki-mchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mediawiki-mc mdwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mdwiki datavizhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#dataviz montage-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#montage-beta wm-metricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wm-metrics scholiaanalyticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#scholiaanalytics bluehillbotbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bluehillbotb mifterbot-enhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mifterbot-en tensthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tenst bashhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bash mdaniels-ogrebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mdaniels-ogrebot merlbot2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#merlbot2 prefbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#prefbot alanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#alan nsfwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#nsfw urbanecm-test-1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#urbanecm-test-1 lijebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#lijebot tc-rchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tc-rc liangent-sharedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#liangent-shared enethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#enet librarybase-updaterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#librarybase-updater githubstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#githubstats periodibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#periodibot web2cithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#web2cit toolviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#toolviews tgwikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tgwikibot atohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ato sitematrixhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#sitematrix zh-fwdreview-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#zh-fwdreview-bot sqidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#sqid rxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#rxy botundohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#botundo pdlbotarchiverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#pdlbotarchiver ace2018https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ace2018 wikijourneyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikijourney spellcheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#spellcheck rwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#rw merlbot-webhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#merlbot-web metricslibrary-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#metricslibrary-dev yemenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#yemen ws-songbirdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ws-songbird cobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#cobot pavlochembothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#pavlochembot bnwiki8https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bnwiki8 delliehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#dellie flickr-rsshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#flickr-rss mwlinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mwlint translatemplatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#translatemplate qrcode-generatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#qrcode-generator hatjitsuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hatjitsu plantel2wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#plantel2wiki jackpomihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#jackpomi awbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#awb constcollectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#constcollector governance-timelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#governance-timeline midehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mide inkobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#inkobot thankshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#thanks redirecterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#redirecter sficbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#sficbot andrewtesttoolfourhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#andrewtesttoolfour wikiresearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikiresearch rlutshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#rluts wmde-accesshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wmde-access md-archbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#md-archbot zppixbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#zppixbot youtubereviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#youtubereviewer osmviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#osmviews vahurzpubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#vahurzpubot citationdetectivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#citationdetective machtsinn-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#machtsinn-dev detoxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#detox image-annotatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#image-annotator citerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#citer weapon-of-mass-description-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#weapon-of-mass-description-test section-linkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#section-links wordcounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wordcount asgi-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#asgi-test wikigrokhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wikigrok test0https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#test0 ipa-speakerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ipa-speaker threepbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#threepbot enbbsbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#enbbsb statisticsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#statisticsbot fireflydevhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#fireflydev dicomptehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#dicompte image-suggestion-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#image-suggestion-api ruwikisourcehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ruwikisource pagetriagebnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#pagetriagebn zkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#zkbot wn-api-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wn-api-test contributionsurveyorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#contributionsurveyor panderinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#panderine ytcleanerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ytcleaner bodhhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bodh mphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#mp wlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wle lingua-librehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#lingua-libre cluebotnghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#cluebotng hjhhghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hjhhg musikbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#musikbot tool-galleryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tool-gallery reminderbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#reminderbot linkrechttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#linkrec connectivityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#connectivity repohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#repo hahhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#hah altostratushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#altostratus wpphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wpp testingtoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#testingtool bn-googleocrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bn-googleocr vocabulary-indexhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#vocabulary-index shuaib-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#shuaib-bot enwnrchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#enwnrc pltoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#pltools wdtreehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wdtree tessdatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#tessdata demibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#demibot l235-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#l235-bot raunbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#raunbot jbbot2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#jbbot2 commtech-commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#commtech-commons wanderwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wanderwiki slumpartikelhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#slumpartikel syunminbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#syunminbot wp-signposthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#wp-signpost taintcheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#taintcheck yabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#yabot bsauthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bsaut octodatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#octodata giftpasthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#giftpast bl-assisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#bl-assist algo-accountabilityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#algo-accountability apps-galleryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#apps-gallery pywikibot-testwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#pywikibot-testwiki upcoming-mainpagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#upcoming-mainpage diff-privacy-beamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#diff-privacy-beam covid-obithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#covid-obit htoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#htools ideasbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#ideasbot sociology-wikiconcourshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#sociology-wikiconcours aemisinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/7#aemisinfo https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8 == ecmabot == ecmabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#ecmabot passlicensehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#passlicense quasarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#quasar usrd-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#usrd-tools mardetanha-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mardetanha-dev c19dataczbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#c19dataczbot integraalityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#integraality wiki13https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wiki13 sonarqubebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#sonarqubebot mc8https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mc8 hersfold-hacbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#hersfold-hacb deadlinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#deadlinks rightstoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#rightstool swviewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#swviewer jobshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#jobs tools-dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tools-dashboard articles-recommenderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#articles-recommender hasteurbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#hasteurbot beleg-tallyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#beleg-tally locator-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#locator-tool medusatesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#medusatest mjbmrbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mjbmrbot limesmaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#limesmap catalog-to-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#catalog-to-wiki neechalbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#neechalbot startisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#startist security-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#security-tools fpbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#fpbot svwikihostbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#svwikihostbot datbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#datbot edit-counterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#edit-counter jarallahhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#jarallah rangecontribhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#rangecontrib converthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#convert oubli-signature-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#oubli-signature-bot logo-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#logo-test payravihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#payravi zhtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#zhtest wikiloop-testflighthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikiloop-testflight macfanlogbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#macfanlogbot verification-pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#verification-pages editcountitishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#editcountitis parliamentarchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#parliamentarch winputhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#winput annohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#anno wikiviewstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikiviewstats requesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#request quotenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#quotenbot enwnarchivebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#enwnarchivebot wdrdrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wdrdr sightinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#sighting scfc-test-can-be-deleted-anytimehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#scfc-test-can-be-deleted-anytime trainbowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#trainbow openhatch-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#openhatch-wiki wdcathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wdcat os-deprecationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#os-deprecation viafbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#viafbot assamesecalendarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#assamesecalendar wmczhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wmcz aneun-sandboxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#aneun-sandbox botmahmoodhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#botmahmood dimensionerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dimensioner histsearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#histsearch media-search-measure-hitshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#media-search-measure-hits notwikilambdahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#notwikilambda everyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#every reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#reports commons-mass-description-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#commons-mass-description-test churcheshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#churches air7538toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#air7538tools man-pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#man-pages dibyaduttahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dibyadutta captcha-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#captcha-dev goransmtoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#goransmtool boteashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#boteas wikivisualizationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikivisualization fscbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#fscbot dimastbkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dimastbkbot enwiktdefnshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#enwiktdefns catimageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#catimages wikicontentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikicontents hennalabshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#hennalabs crossactivityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#crossactivity find-and-replacehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#find-and-replace zoomable-imageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#zoomable-images jeh-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#jeh-dev usage-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#usage-bot nominatimhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nominatim fawiki-editathonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#fawiki-editathon nitolwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nitolw wikistreamshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikistreams growthtaskshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#growthtasks isbnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#isbn lziad-cvnbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#lziad-cvnbot salhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#sal pmidtoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#pmidtool wikiholichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikiholic geolochttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#geoloc yifeibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#yifeibot pywikibot-grrtbthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#pywikibot-grrtbt klexibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#klexibot oojs-uihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#oojs-ui wrcphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wrcp t1943bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#t1943bot datacompletewikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#datacompletewiki anorangehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#anorange mapyczhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mapycz phabbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#phabbot wmopbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wmopbot pharchivisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#pharchivist afdstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#afdstats badgeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#badges dplbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dplbot women-in-redhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#women-in-red iluvatarbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#iluvatarbot tools-infohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tools-info wikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikibot wikibase-previewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikibase-preview sge-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#sge-status orwell01https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#orwell01 docker-registryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#docker-registry hewiki-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#hewiki-tools rcqueryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#rcquery glamingesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#glamingest video2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#video2commons deshhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#desh wlm-nl-table-genhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wlm-nl-table-gen ganfilterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#ganfilter parliamentdiagramhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#parliamentdiagram wiki17an-watcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wiki17an-watcher ws-cat-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#ws-cat-browser connecting-senseshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#connecting-senses sphinxcapt-leaderboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#sphinxcapt-leaderboard goblinbot4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#goblinbot4 tom29739-testinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tom29739-testing hackprowikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#hackprowiki erex-yomihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#erex-yomi russbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#russbot swtimebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#swtimebot nppbrowserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nppbrowser shrihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#shri eulenwiki3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#eulenwiki3 wiki-stat-portalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wiki-stat-portal fixsuggesterbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#fixsuggesterbot taxonbotahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#taxonbota phantombothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#phantombot enkorehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#enkore lihaohong-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#lihaohong-bot cx-storybookhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#cx-storybook personabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#personabot fredrikas-lupphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#fredrikas-lupp isprangefinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#isprangefinder delinkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#delinker wlh-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wlh-api itsourcehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#itsource wiki-gadgetshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wiki-gadgets wikiemojibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikiemojibot alfa80https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#alfa80 dewpmonobookupdaterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dewpmonobookupdater wikilovesdownloadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikilovesdownloads dutchbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dutchbot aramtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#aramtest rmstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#rmstats furutanihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#furutani tolbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tolbot geophotoreqhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#geophotoreq zhwikiircchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#zhwikiircc miradorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mirador ib2testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#ib2test quality-analyzerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#quality-analyzer event-live-sessionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#event-live-session tewptrendshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tewptrends mgp-cewbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mgp-cewbot vvotershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#vvoters etoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#etools wikipedia-contributor-locationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikipedia-contributor-locations wikibase-termbox-storybookhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikibase-termbox-storybook recom-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#recom-tool spdxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#spdx loltrshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#loltrs laaknortoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#laaknortools test-generic-webservicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#test-generic-webservice adminstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#adminstats faebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#faebot xoxoxo-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#xoxoxo-dev wikidata-terminatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikidata-terminator gabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#gabot tool-db-usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tool-db-usage alicebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#alicebot saamihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#saami wiki-embed-poc-2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wiki-embed-poc-2 ws-statisticianhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#ws-statistician stonesoup-fetcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#stonesoup-fetcher cohhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#coh veertjehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#veertje wcna-2018-registrationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wcna-2018-registration anni-mehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#anni-me copywhathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#copywhat phansearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#phansearch maintunhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#maintun navlink-recommendationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#navlink-recommendation xslackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#xslack smv-description-translationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#smv-description-translations openrefine-wikidatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#openrefine-wikidata mirusbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mirusbot wikitennisbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikitennisbot calak-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#calak-dev thehelpfulbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#thehelpfulbot deep-learning-serviceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#deep-learning-services roccerbot-newhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#roccerbot-new gmthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#gmt dnbtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dnbtools nn1l2bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nn1l2bot becomehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#become amazigh-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#amazigh-bot dvtbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#dvtbot video-cut-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#video-cut-tool pagecountshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#pagecounts arcanisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#arcanist pipenghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#pipeng indentbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#indentbot demo-unicornhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#demo-unicorn mhwikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mhwikibot cluebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#cluebot machtsinnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#machtsinn moedatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#moedata perrybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#perrybot deputyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#deputy gsoc-petscan-query-articleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#gsoc-petscan-query-articles quarryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#quarry aobohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#aobo isahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#isa swedishforsamlinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#swedishforsamling popularpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#popularpages crisis-responsehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#crisis-response magnus-toolserverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#magnus-toolserver bstorm-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#bstorm-tool maureliohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#maurelio citing-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#citing-bot spamwatchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#spamwatch phabricator-reporterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#phabricator-reporter cerabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#cerabot legobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#legobot nearby-places-viewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nearby-places-viewer video-cat-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#video-cat-bot fshbibbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#fshbibbot toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tool every-other-wiki-hashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#every-other-wiki-has mg-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#mg-bot matvaretabellenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#matvaretabellen suggestorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#suggestor outreachy-hiteshprhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#outreachy-hiteshpr nppdashhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nppdash wikinityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wikinity rchvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#rchv vitalarticlesbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#vitalarticlesbot tasmaniahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#tasmania camelbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#camelbot refreshlinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#refreshlinks my-first-flask-oauth-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#my-first-flask-oauth-tool nasirkhanbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#nasirkhanbot wm-ve-needcheck-reporterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#wm-ve-needcheck-reporter grapedoghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#grapedog jeltebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#jeltebot dirihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#diri lighttpd-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#lighttpd-test npptechhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#npptech emojiwiki-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/8#emojiwiki-test https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9 == wikithon-contributions-grafana == wikithon-contributions-grafanahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikithon-contributions-grafana mahdizhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mahdiz hroest3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hroest3 wd-shex-inferhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wd-shex-infer dtzhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#dtz wawewewihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wawewewi geoplotterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#geoplotter anchor-correctorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#anchor-corrector wikifeedshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikifeeds mysql-php-session-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mysql-php-session-test cite-o-meterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cite-o-meter cropbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cropbot scannerbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#scannerbot framabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#framabot my-first-flask-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#my-first-flask-tool first-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#first-tool deltaquad-botshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#deltaquad-bots jarry-commonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#jarry-common oddolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#oddol memberbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#memberbot among-us-wiki-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#among-us-wiki-bot five-millionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#five-million msbitshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#msbits napalmtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#napalmtools toolflowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#toolflow ipfshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ipfs mathhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#math wikiphemehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikipheme lokasbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#lokasbot statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#status fb-translate-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#fb-translate-bot calling-cardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#calling-card ramp2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ramp2 wpcleanerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wpcleaner func-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#func-bot gdrive-to-commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#gdrive-to-commons quentintoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#quentintools imagebulkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#imagebulk studiesworldhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#studiesworld croptoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#croptool pearbot2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pearbot2 kuwaity-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#kuwaity-tool wikiscannerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikiscanner milhistbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#milhistbot cyberwormhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cyberworm linkwatcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#linkwatcher commonscategorycounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#commonscategorycount persondatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#persondata quentinv57-commonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#quentinv57-common wikimedia-francehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikimedia-france bowleerinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#bowleerin xtools-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#xtools-dev pvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pv hubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hub alphawakthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#alphawakt exambothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#exambot url2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#url2commons wdimagecheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wdimagecheck watch-translationshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#watch-translations drawshieldhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#drawshield phabsearchemailhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#phabsearchemail movecathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#movecat quarry-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#quarry-dev spurhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#spur ragesossbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ragesossbot pacetrackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pacetrack fixdatebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#fixdatebot gurmukhispellhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#gurmukhispell template-inclusionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#template-inclusions mbrt1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mbrt1 tweephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#tweep commons-mass-descriptionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#commons-mass-description lutzhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#lutz kolberthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#kolbert editsynergyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#editsynergy uniquehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#unique potd-viewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#potd-viewer essaihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#essai valstathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#valstat orpheushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#orpheus themesquitobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#themesquitobot github-notif-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#github-notif-bot wikibase-nearest-neighborshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikibase-nearest-neighbors unreviewedlisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#unreviewedlist editfulhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#editful wlbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wlb ensocksfinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ensocksfinder phabricator-bug-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#phabricator-bug-status dykstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#dykstats patroclehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#patrocle spi-tools-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#spi-tools-dev docshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#docs svgworkaroundbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#svgworkaroundbot veertje-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#veertje-tools citation-toolkithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#citation-toolkit file-reuse-reviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#file-reuse-review meetbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#meetbot giovannitoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#giovannitool archive-things-4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#archive-things-4 network-testshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#network-tests pagelistbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pagelistbot citation-jshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#citation-js plaigsossbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#plaigsossbot animanga-db-matcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#animanga-db-matcher list-unpatrolled-pages-zhwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#list-unpatrolled-pages-zhwiki prismhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#prism icommonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#icommons pastoribothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pastoribot wikisensehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikisense officewikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#officewikibot commonsfairuseuploadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#commonsfairuseupload hersfold-irchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hersfold-irc extreg-woshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#extreg-wos shex-authorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#shex-author tombot3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#tombot3 sockshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#socks danorton-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#danorton-dev assamesetoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#assamesetool hersfold-webhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hersfold-web lst-guardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#lst-guard nkdddbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#nkdddbot wikibrasoeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikibrasoes prostoprosport-news-fetcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#prostoprosport-news-fetcher intuitionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#intuition wratinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wrating benehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#bene boxybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#boxybot fb2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#fb2commons zoomproofhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#zoomproof newbie-uploadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#newbie-uploads abbrevisohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#abbreviso depictassisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#depictassist newfileshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#newfiles hub-wiki-projecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hub-wiki-project invadibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#invadibot dykfeedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#dykfeed twofivesixlexhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#twofivesixlex brgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#brgroup book2scrollhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#book2scroll wiperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wiper wdvaliditycheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wdvaliditycheck ip-range-calchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ip-range-calc olympicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#olympics checkwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#checkwiki test999https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#test999 ascalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ascal fountainhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#fountain familyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#family wikisaurusbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikisaurusbot vuln-checkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#vuln-checker expose-datahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#expose-data wikiquantoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikiquantos ores-demoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ores-demos mwnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mwn aharonitelegrambot002https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#aharonitelegrambot002 girhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#gir www-portal-staginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#www-portal-staging videoconverthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#videoconvert nrhpservicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#nrhpservice wikinews-importerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikinews-importer volby2wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#volby2wiki pywikipediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pywikipedia torproxyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#torproxy mobile-html-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mobile-html-bot inactive-adminshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#inactive-admins isbn-usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#isbn-usage cropcrophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cropcrop gridengine-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#gridengine-status watroleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#watroles hebbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hebbot media-reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#media-reports mostlinkedmissinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mostlinkedmissing soda-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#soda-test wlmsuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wlmsu hoohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hoo copyvioshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#copyvios ignatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ignator wlm-analyticshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wlm-analytics blocksearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#blocksearch jayprakashbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#jayprakashbot cbng-sql-1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cbng-sql-1 ipwatcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ipwatcher stubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#stub potdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#potd granitsteinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#granitstein nlwikt-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#nlwikt-tools giraffehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#giraffe ws-contesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ws-contest toolhubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#toolhub toolserverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#toolserver piagetenwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#piagetenwiki ircredirecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ircredirect wikicontesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikicontest mormegilhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mormegil slipjackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#slipjack planettoearthhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#planettoearth article-interactionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#article-interactions atirohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#atiro urdusignhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#urdusign zayenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#zayenbot pagepile-visual-filterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#pagepile-visual-filter copyclearhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#copyclear perfect-venn-diagram-generatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#perfect-venn-diagram-generator scaldingbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#scaldingbot macfanbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#macfanbot templatehoardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#templatehoard covidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#covid orphantalkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#orphantalk mdaniels-refill-nghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mdaniels-refill-ng cbng-sql-2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cbng-sql-2 cloud-ceph-performance-testshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#cloud-ceph-performance-tests article-creation-mapperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#article-creation-mapper local-library-fulltexthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#local-library-fulltext autodeschttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#autodesc transhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#trans labdajiwabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#labdajiwabot ptbotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ptbots wptestbloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wptestblog trwikisignaturebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#trwikisignaturebot chaoyueltryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#chaoyueltry xiplushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#xiplus tool123https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#tool123 dbrepshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#dbreps mediawiki-feedshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#mediawiki-feeds grillitushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#grillitus locatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#locator wikiapiconnectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikiapiconnector proxieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#proxies rook-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#rook-test siwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#siwiki ninobotthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ninobott noaabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#noaabot derivativehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#derivative botsisterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#botsister phoenix9https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#phoenix9 source-infohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#source-info paws-publichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#paws-public wd-arthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wd-art newwebtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#newwebtest articles-by-lat-lon-without-imageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#articles-by-lat-lon-without-images geograph-update-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#geograph-update-bot ptoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ptools clpo13-flaskhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#clpo13-flask wikidata-editshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikidata-edits wikidata-redirects-conflicts-reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#wikidata-redirects-conflicts-reports ankitbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ankitbot gerrit-avatar-uploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#gerrit-avatar-uploader ext-lnk-discoverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ext-lnk-discover andxorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#andxor centralnotice-bannergeneratorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#centralnotice-bannergenerator noclaimshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#noclaims citations-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#citations-dev kiranbot2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#kiranbot2 bawolffhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#bawolff hcclabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#hcclab grafanahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#grafana listhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#list healthcheckshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#healthchecks rileybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#rileybot torintoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#torintool oabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#oabot weatherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#weather catscan3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#catscan3 irclogshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#irclogs crocodyliahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#crocodylia gpyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#gpy rm-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#rm-stats ket-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/9#ket-bot https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10 == drvstats == drvstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#drvstats time-convertorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#time-convertor oreshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ores wiki-topichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wiki-topic blubberhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#blubber pictogramhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#pictogram gallicahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#gallica verificabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#verificabot majavah-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#majavah-test ldap-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ldap-beta enwiki-user-editshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#enwiki-user-edits index-page-moverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#index-page-mover alchimistahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#alchimista ores-inspecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ores-inspect tantan-wwwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tantan-www globalcsdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#globalcsd nasirkhantoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#nasirkhantools pawshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#paws wlm-ushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wlm-us martin-urbanechttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#martin-urbanec johnlewishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#johnlewis vector-darkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#vector-dark meta2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#meta2 tamilwikitoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tamilwikitools typoscanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#typoscan pageshifthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#pageshift wikipedia-zh-message-transporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikipedia-zh-message-transport tabular-wikidatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tabular-wikidata coursestatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#coursestats wsdetoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wsdetool wamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wam hexacorehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#hexacore outreachy-user-ranking-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#outreachy-user-ranking-tool commons-campaign-commanderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#commons-campaign-commander tahirhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tahir itemlisterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#itemlister readabilityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#readability liangent-pyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#liangent-py wikyrillomathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikyrillomat isbn-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#isbn-bot usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#usage stockholm-maniahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#stockholm-mania spellhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#spell wikinavhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikinav tsreports-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tsreports-dev wikiloophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikiloop mapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#maps activityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#activity drift-trackerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#drift-tracker aivhelperbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#aivhelperbot wm-lolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wm-lol mdann52bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#mdann52bot spi-table-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#spi-table-bot wikitablehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikitable zhmrtbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#zhmrtbot david-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#david-tool sge-jobshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#sge-jobs daselabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#daselab vote-trackerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#vote-tracker awthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#awt enwnbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#enwnbot irc-cloakshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#irc-cloaks wikimaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikimap italian-wikipedia-barhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#italian-wikipedia-bar ws-page-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ws-page-game csv2qshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#csv2qs efenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#efenbot alignmentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#alignments mjbmr-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#mjbmr-tools mathbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#mathbot thankyouhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#thankyou static-bzhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#static-bz jatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#jata position-holder-historyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#position-holder-history testtool-104https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#testtool-104 clunkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#clunk cyberbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#cyberbot spiarticleanalyzerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#spiarticleanalyzer cartodatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#cartodata justincbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#justincbot wiki-talkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wiki-talk ash-djangohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ash-django bot-ash-nazghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#bot-ash-nazg ws-bridgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ws-bridge sochttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#soc listunpatrolledpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#listunpatrolledpages glam2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#glam2commons blahmahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#blahma lexeme-formshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#lexeme-forms assumptionbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#assumptionbot signatureshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#signatures sonihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#soni nklinkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#nklink kmlexporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#kmlexport archive-things-2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#archive-things-2 wmcsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wmcsbot recommendationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#recommendation ameenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ameen webchathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#webchat tptoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tptools hangatewayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#hangateway ninobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ninobot validatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#validator opendatasetshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#opendatasets sru-cataloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#sru-catalog sz-iwbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#sz-iwbot global-searchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#global-search dpl-trackerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#dpl-tracker cphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#cp osm4wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#osm4wiki fatamehhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#fatameh query2maphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#query2map dapete-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#dapete-dev refereehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#referee hall-of-famehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#hall-of-fame wolfgangbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wolfgangbot wd-depictshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wd-depicts catlivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#catlive deskanahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#deskana bibleversefinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#bibleversefinder fourohfourhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#fourohfour xhhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#xh section-watchlisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#section-watchlist yadkardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#yadkard tabular-data-from-sparqlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tabular-data-from-sparql afc-researchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#afc-research kenrick95bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#kenrick95bot glaisherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#glaisher mwstewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#mwstew paws-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#paws-stats zoomiebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#zoomiebot thedavetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#thedavetools editor-retention-dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#editor-retention-dashboard paws-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#paws-beta kaleem-bot-ihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#kaleem-bot-i rankerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ranker facstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#facstats drnclerkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#drnclerkbot wikitreehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikitree list-building-interactivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#list-building-interactive mediacountshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#mediacounts nodejs-mw-oauth-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#nodejs-mw-oauth-tool entsuggesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#entsuggest tmghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tmg wikicaptchahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikicaptcha wiki-needs-pictureshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wiki-needs-pictures spi-indexerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#spi-indexer whois-referralhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#whois-referral apthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#apt charttableconverterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#charttableconverter merge2pdfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#merge2pdf dribperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#dribper most-readable-pageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#most-readable-pages a-z-p-0-9-zhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#a-z-p-0-9-z dispatcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#dispatcher translate-categoryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#translate-category wmvehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wmve jamesur-usergroupsearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#jamesur-usergroupsearch bldrwnschhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#bldrwnsch bing-mapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#bing-maps non-robothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#non-robot itemfinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#itemfinder gnubotmarcoohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#gnubotmarcoo gnshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#gns iphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ip jarbot-iiihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#jarbot-iii beleg-test-14568913402https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#beleg-test-14568913402 wikidata-nolabelshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikidata-nolabels jpxg-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#jpxg-test skinshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#skins wikitoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikitool local-wikipedia-library-referencehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#local-wikipedia-library-reference wlm-mapshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wlm-maps denkmalbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#denkmalbot covermehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#coverme abdumubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#abdumubot legavolleyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#legavolley bothasavahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#bothasava hugglehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#huggle refill-api-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#refill-api-test ameisenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ameisenbot lynxbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#lynxbot akkakkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#akkakkbot wiki-android-appshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wiki-android-apps shextranslatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#shextranslator wmukeventshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wmukevents disabled-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#disabled-tools t13bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#t13bot flaggedrevspromotioncheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#flaggedrevspromotioncheck toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#toolforge xxn-testtoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#xxn-testtool awmd-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#awmd-stats zenithbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#zenithbot tulsibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tulsibot pgrmevalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#pgrmeval timerelengteamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#timerelengteam schema2codehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#schema2code dtcheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#dtcheck signature-manquante-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#signature-manquante-bot bajohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#bajo sb-test-1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#sb-test-1 stewardbots-legacyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#stewardbots-legacy chathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#chat revdiffsearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#revdiffsearch helloeverydayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#helloeveryday wikigraphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikigraph comohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#como image-recommendation-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#image-recommendation-test stewardbotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#stewardbots infogeek244-grammabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#infogeek244-grammabot wiki-ltthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wiki-ltt anticompositetesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#anticompositetest cite-web-helperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#cite-web-helper timebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#timebot rfx-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#rfx-dev jbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#jb wd-query-builderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wd-query-builder remarkup2wikitexthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#remarkup2wikitext kowikitoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#kowikitools wwwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#www bloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#blog useredits1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#useredits1 axelhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#axel jarbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#jarbot randominwikiprojecthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#randominwikiproject wdichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wdic loltools-testinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#loltools-testing wikipathways2wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikipathways2wiki technischewuenschehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#technischewuensche zabesbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#zabesbot autopromote-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#autopromote-status anagrimeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#anagrimes wikipedia-libraryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikipedia-library permission-denied-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#permission-denied-test stc-covidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#stc-covid addhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#add articlerequesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#articlerequest twitter-retweet-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#twitter-retweet-bot wikipulsehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikipulse soweegohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#soweego wikishootmehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikishootme phabtest1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#phabtest1 chobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#chobot fpexphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#fpexp primary-sources-v2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#primary-sources-v2 wiki-talk2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wiki-talk2 tilescraperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#tilescraper sleepybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#sleepybot user-activityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#user-activity alephhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#aleph fisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#fist etytreehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#etytree davodhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#davod monacohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#monaco youtube-channelhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#youtube-channel cloud-statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#cloud-status ooui-debughttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#ooui-debug convenient-discussionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#convenient-discussions csfdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#csfd wikt-mwtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikt-mwtest wikiwhohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wikiwho r96340-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#r96340-bot fnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#fn dabsolverhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#dabsolver earwigbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#earwigbot wdpvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#wdpv primerpediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#primerpedia devyashahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/10#devyasha https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11 == hll == hllhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#hll alex-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#alex-wiki morphtoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#morphtool thenoun-uploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#thenoun-uploader taqpol-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#taqpol-test frettieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#fretties hrwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#hrwiki arkivbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#arkivbot cdnjs-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#cdnjs-beta useredithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#useredit kaleem-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#kaleem-bot readerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#reader naggobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#naggobot textcatdemohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#textcatdemo outreachy-shiprahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#outreachy-shipra rank4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#rank4 deprecated-fixer-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#deprecated-fixer-bot multicomparehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#multicompare replaghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#replag worklist-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#worklist-tool user-idhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#user-id ocounterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ocounter wikitimehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikitime ia-upload-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ia-upload-test autoreviewbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#autoreviewbot mzmcbridehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mzmcbride tochttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#toc giftbot-factorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#giftbot-factor h78c67c-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#h78c67c-bot freefileshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#freefiles rangeblockfinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#rangeblockfinder metaviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#metaviews disclaimhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#disclaim wdqs-tutorialhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wdqs-tutorial commons-coveragehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#commons-coverage dioceseshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#dioceses consultation-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#consultation-stats yf-bambotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#yf-bambots outreachy-user-contribution-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#outreachy-user-contribution-tool backstagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#backstage excel2wiki-uploadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#excel2wiki-upload ederporto-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ederporto-dev video2commons-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#video2commons-test shumariyathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#shumariyat excel2wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#excel2wiki chisatohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#chisato wiki-tennishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wiki-tennis citelearnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#citelearn global-user-activityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#global-user-activity topictaggerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#topictagger manypediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#manypedia cluestuffhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#cluestuff bkstats-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#bkstats-test potracehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#potrace gulphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#gulp crosswatchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#crosswatch defconbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#defconbot denkmallistehamburghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#denkmallistehamburg quality-assisted-editorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#quality-assisted-editor wikiloveslovehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikiloveslove countcounttesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#countcounttest natlibuploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#natlibuploader farotbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#farotbot botvegashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#botvegas abshirhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#abshir usereditshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#useredits rfahelperhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#rfahelper perfectbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#perfectbot thesandbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#thesandbot vggbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#vggbot paste-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#paste-test symacbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#symacbot zimmerbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#zimmerbot mehrdadbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mehrdadbot palmleaf-transcriberhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#palmleaf-transcriber editor-contributionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#editor-contribution inactiveadminshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#inactiveadmins checkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#checker mmthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mmt linkspamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#linkspam dicarehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#dicare jorobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#jorobot pronevalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#proneval nlwiki-herhaalbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#nlwiki-herhaalbot filedupeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#filedupes ipchangeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ipchanges blablablahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#blablabla wikiplayerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikiplayer getsentryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#getsentry kasparbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#kasparbot wikitweetshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikitweets wikiconcursoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikiconcursos arbclerkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#arbclerkbot discord-irchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#discord-irc indic-techcomhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#indic-techcom mohiburduhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mohiburdu sammourhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#sammour negative24-bottestinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#negative24-bottesting owinteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#owintes nimblehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#nimble explorehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#explore bot24https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#bot24 zbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#zbot keystone-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#keystone-browser citationbasehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#citationbase smallemhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#smallem test-trans-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#test-trans-tool mjbmrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mjbmr mdvthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mdvt templatedata-fillerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#templatedata-filler wdwsbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wdwsbot query-builder-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#query-builder-test jurgennlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#jurgennl afctesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#afctest edgarsdevhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#edgarsdev languageproofing-uihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#languageproofing-ui ebrahim-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ebrahim-dev friskobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#friskobot dumpcattreehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#dumpcattree ltfeedcheckerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ltfeedchecker wikiminiatlashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikiminiatlas pib-uploadhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#pib-upload hashtagshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#hashtags twinklehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#twinkle proxyblockshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#proxyblocks mstoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mstools wikilaeumhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikilaeum wikibugshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikibugs wikidata-timelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikidata-timeline articlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#article sign-language-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#sign-language-browser lambdabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#lambdabot perebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#perebot wiki-loves-earth-2019https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wiki-loves-earth-2019 oudahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ouda tourhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#tour certmonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#certmon fpcstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#fpcstats matsubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#matsubot userhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#user wsexporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wsexport reasonatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#reasonator slow-parsehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#slow-parse cbench2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#cbench2 mifterbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mifterbot wikilogoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikilogos eagerbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#eagerbot projectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#projector apt-browserhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#apt-browser assessorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#assessor quickpreset-migratehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#quickpreset-migrate hdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#hd bd808-pywikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#bd808-pywikibot musikanimalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#musikanimal afcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#afcbot indic-wdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#indic-wd wmf-wiki-infohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wmf-wiki-info holidays-viewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#holidays-viewer localtestwhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#localtestw wmgmcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wmgmcbot mapillary2commons2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mapillary2commons2 topicmatcherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#topicmatcher pitsilemuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#pitsilemu multichillhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#multichill wikicontribhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikicontrib ut-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ut-bot reports-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#reports-bot wikinearbyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikinearby testtool-102https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#testtool-102 indic-wsstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#indic-wsstats jtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#jtools wikiteihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikitei patesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#patest etwikthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#etwikt did-i-break-ithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#did-i-break-it ipcheck-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ipcheck-dev sbdjwhshhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#sbdjwhsh dewkinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#dewkin perflogbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#perflogbot wbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wb drooghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#droog add-informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#add-information grantmetricshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#grantmetrics portalboxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#portalbox summary-generatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#summary-generator drbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#drbot fast-echttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#fast-ec dexbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#dexbot huntleybotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#huntleybots catsizehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#catsize grantmetrics-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#grantmetrics-test ipcheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ipcheck android-maven-repohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#android-maven-repo file-reusehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#file-reuse hazard-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#hazard-bot edinchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#edinc anonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#anon vishwinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#vishwin graphqlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#graphql jouncebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#jouncebot linedwellhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#linedwell bibleversefinder2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#bibleversefinder2 recoinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#recoin account-creatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#account-creator pettimehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#pettime muhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mu linkstranslatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#linkstranslator gohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#go mlbthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mlbt user-statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#user-stats makerefhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#makeref dykbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#dykbot lastpicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#lastpics translate-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#translate-bot plasmahelphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#plasmahelp prinssbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#prinssbot yabbrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#yabbr nioshhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#niosh wdmlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wdml typoshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#typos versionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#versions wikidata-reconcilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikidata-reconcile slakrtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#slakrtools wd-constraints-precheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wd-constraints-precheck terabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#terabot ptbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ptbot plagiabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#plagiabot zhwiki-qualifications-checkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#zhwiki-qualifications-check blankpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#blankpages ut-interwiki-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#ut-interwiki-bot wikidata-primary-sourceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikidata-primary-sources zhdeletionpediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#zhdeletionpedia kanzattool1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#kanzattool1 statistics-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#statistics-api iacrophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#iacrop top500importerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#top500importer yadfahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#yadfa imagesimilarityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#imagesimilarity cocubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#cocubot list-buildinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#list-building outreachy-userrankhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#outreachy-userrank not-in-the-other-languagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#not-in-the-other-language raunhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#raun shtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#shtest wikibase-unicornhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikibase-unicorn wptestblog2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wptestblog2 vikidiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#vikidia event-streamshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#event-streams rezabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#rezabot wikisource-tweetshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikisource-tweets npp-lvhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#npp-lv mavrikanthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mavrikant amhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#am vtwohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#vtwo cycling-init-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#cycling-init-bot translate-linkhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#translate-link paws-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#paws-dev joanjochttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#joanjoc mywikitelegrambothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#mywikitelegrambot fixexternallinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#fixexternallinks aw-pairinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#aw-pairing gtirloni-sandboxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#gtirloni-sandbox whois-referral-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#whois-referral-dev text2hashhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#text2hash cbng-sql-4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#cbng-sql-4 liangent-djangohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#liangent-django wikidata-maphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#wikidata-map germancon-mobilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/11#germancon-mobile https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12 == deltabot == deltabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#deltabot dynamicbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#dynamicbot lschttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#lsc whoishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#whois ahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#a hotarticleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#hotarticles jembothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#jembot intersect-contribshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#intersect-contribs stangbotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#stangbots linkscounthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#linkscount oshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#os avicbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#avicbot robinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#robin calakbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#calakbot ammarbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ammarbot irclogbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#irclogbot tutorial-exampleshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#tutorial-examples npphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#npp automated-toolforge-testshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#automated-toolforge-tests toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#tools contribstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#contribstats aaaaaahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#aaaaaa wd-analysishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wd-analysis logshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#logs mlwikidbupdatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#mlwikidbupdate zhwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#zhwiki nlwiki-bronlinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#nlwiki-bronlinks huwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#huwiki wmds-archivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wmds-archive zumrabandhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#zumraband signpostlabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#signpostlab wikihoaxbusterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikihoaxbuster admin-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#admin-beta borkedbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#borkedbot masssly-test-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#masssly-test-tool xmlfeedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#xmlfeed iamnetx-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#iamnetx-test whois-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#whois-beta abcgameshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#abcgames wikiintenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikiintent thibtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#thibtools joaquinito01https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#joaquinito01 goodbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#goodbot basetoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#basetool traffic-grapherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#traffic-grapher lebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#lebot siteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#sites toolscripthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#toolscript gaelan-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#gaelan-bot imagemapedithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#imagemapedit catnaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#catnap mdipietrohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#mdipietro reza-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#reza-dev metricslibraryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#metricslibrary grid-webserviceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#grid-webservices zhaofeng-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#zhaofeng-test pastehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#paste wikidashhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikidash piagetbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#piagetbot linkedpageviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#linkedpageviews wmchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wmch xdebugtesting2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#xdebugtesting2 cradlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cradle wikishieldhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikishield jeremybhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#jeremyb mdbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#mdbot doodlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#doodle wikitext-deprecationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikitext-deprecation asseeibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#asseeibot snowolfhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#snowolf papayawebhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#papayaweb l235-irchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#l235-irc montage-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#montage-dev ganreportbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ganreportbot submitterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#submitter oqtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#oqtools wmdiscordbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wmdiscordbot nicepediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#nicepedia iplookuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#iplookup deployment-calendarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#deployment-calendar eportohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#eporto srr-sandboxhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#srr-sandbox ifttt-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ifttt-dev catrenamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#catrename ruarbcom-jshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ruarbcom-js searchsblhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#searchsbl pagepilehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#pagepile shfbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#shfbot archaeohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#archaeo wikiviewstats2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikiviewstats2 revisions-blacklisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#revisions-blacklist cauchy7https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cauchy7 coveragehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#coverage adamanthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#adamant ftoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ftools spamfactshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#spamfacts cdrini-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cdrini-dev abohadi1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#abohadi1 matrixgchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#matrixgc mrakinseyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#mrakinsey krdbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#krdbot wigihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wigi ocrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ocr listeriahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#listeria captchahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#captcha botleohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#botleo agpb-server-v1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#agpb-server-v1 datasettehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#datasette test3https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#test3 rank1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#rank1 rangecalc-improvedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#rangecalc-improved napalmbot-sahhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#napalmbot-sah sdbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#sdbot wdgamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wdgame wdq2sparqlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wdq2sparql plnodehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#plnode templatetransclusioncheckhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#templatetransclusioncheck hinotetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#hinotetools wscontesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wscontest templatetigerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#templatetiger dnahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#dna wikipathwayshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikipathways anticompositebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#anticompositebot wikiprojectlisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikiprojectlist wikimediadchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikimediadc hangorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#hangor crosswatch-monitoringhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#crosswatch-monitoring wikidata-analysishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikidata-analysis mrbluebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#mrbluebot usersearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#usersearch wikitaskshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikitasks cinemahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cinema logger-discordbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#logger-discordbot wikiinfohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikiinfo wikijournalbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikijournalbot isbn-tmptesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#isbn-tmptest phab-banhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#phab-ban haukihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#hauki jogotoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#jogotools wlmtrafohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wlmtrafo wikilinkbot-discordhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikilinkbot-discord nfcbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#nfcbot iztoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#iztools svenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#svenbot prompterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#prompter duplicatehunterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#duplicatehunter pythonixhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#pythonix fr-wikiversity-nshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#fr-wikiversity-ns lkftoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#lkftools likwalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#likwal wikidata-comparehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikidata-compare fundraising-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#fundraising-tools commtechhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#commtech khanomalumathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#khanomalumat canaryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#canary tivenbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#tivenbot pibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#pibot pangolinbot1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#pangolinbot1 twitter-to-commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#twitter-to-commons zhwpvg-article-listhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#zhwpvg-article-list galleryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#gallery originhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#origin declarehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#declare sn1pebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#sn1pebot telegrambothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#telegrambot watchrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#watchr pinyin-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#pinyin-api randomhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#random usualsuspectshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#usualsuspects komla-appshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#komla-apps mitmachenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#mitmachen bloop42https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#bloop42 shahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#sha ordiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ordia ibrahimidhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ibrahimid stimmberechtigunghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#stimmberechtigung orejasbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#orejasbot test-lighttpd-trustyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#test-lighttpd-trusty lcm-dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#lcm-dashboard addscholartopicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#addscholartopics strephithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#strephit dateienhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#dateien jimmyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#jimmy brandonbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#brandonbot sibuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#sibu wmde-wd-teamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wmde-wd-team durl-shortenerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#durl-shortener random-featuredhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#random-featured fiwiki-tools-webhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#fiwiki-tools-web omarghridabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#omarghridabot cewbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cewbot foundationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#foundation libraryupgraderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#libraryupgrader countcountbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#countcountbot dawikitoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#dawikitool similarityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#similarity whois-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#whois-dev advertisedetectorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#advertisedetector valutabothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#valutabot tb-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#tb-dev danmicholobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#danmicholobot userviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#userviews wikitest-rtlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikitest-rtl blogconverterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#blogconverter lyanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#lyan nlwikibotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#nlwikibots ruby-suspected-plagiarismhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ruby-suspected-plagiarism animanga-db-import-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#animanga-db-import-bot flickr2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#flickr2commons bugellohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#bugello ws-image-uploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ws-image-uploader bkllchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#bkllc wiki-osm-markershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wiki-osm-markers autolisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#autolist loltoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#loltools jhstoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#jhstools wgmchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wgmc botyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#boty macommunehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#macommune potyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#poty isbn2wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#isbn2wiki yarlhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#yarl southparkfanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#southparkfan replacerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#replacer lekhakihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#lekhaki talk-page-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#talk-page-bot botwatchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#botwatch wprequestshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wprequests klexiboxenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#klexiboxen missing-from-wikipediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#missing-from-wikipedia cr-grants-team-metasynchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cr-grants-team-metasync firmenbuchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#firmenbuch graveshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#graves urbanecmbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#urbanecmbot qrhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#qr wd-flaw-finderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wd-flaw-finder artemisiahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#artemisia vendorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#vendor ocgepubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#ocgepub sowhyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#sowhy trajohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#trajo githubhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#github elasticdashhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#elasticdash liangent-mischttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#liangent-misc indic-techcom-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#indic-techcom-wiki doggobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#doggobot statichttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#static wikisource-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikisource-bot dekelhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#dekel editcomparehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#editcompare archivesearchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#archivesearch batchreverthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#batchrevert image-unicornhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#image-unicorn stereoskopiehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#stereoskopie wikilisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikilist newyorkadamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#newyorkadam edgarshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#edgars wikimarcashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikimarcas my-threadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#my-threads update-1lib1refhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#update-1lib1ref tutorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#tutor cil2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#cil2 splinetoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#splinetools pilot-flag-labhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#pilot-flag-lab editgroups-commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#editgroups-commons wikistreamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#wikistream arkbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#arkbot merliwbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/12#merliwbot https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3 == file-reuse-piwik == file-reuse-piwikhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#file-reuse-piwik squirrelnestbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#squirrelnestbot topviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#topviews thibaut120094https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#thibaut120094 alexhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#alex test-tool-aishahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#test-tool-aisha as-infohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#as-info xtools-echttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#xtools-ec ttthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ttt toolschecker-ge-wshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#toolschecker-ge-ws catmonitorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#catmonitor extjsonuploaderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#extjsonuploader kdbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kdb goodarticlebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#goodarticlebot lolrrit-wmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lolrrit-wm tildehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#tilde relgenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#relgen portalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#portal kiranbot4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kiranbot4 most-wantedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#most-wanted cuddlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cuddle amstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#amstats resizeimagesbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#resizeimagesbot wiki2maphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiki2map ws2wdhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ws2wd cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cleanup socksfinderhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#socksfinder scrotbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#scrotbot josve05a-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#josve05a-test realtime-watchlisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#realtime-watchlist github-pr-closerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#github-pr-closer ralgisbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ralgisbot refill-tnthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#refill-tnt nli-wikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#nli-wiki eathomhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#eathom hayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#hay dykautobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#dykautobot wikidata-annotation-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikidata-annotation-tool interlanghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#interlang linkypediahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#linkypedia adashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#adas interaction-timelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#interaction-timeline esfichataxonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#esfichataxon phab-searchhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#phab-search welcomebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#welcomebot siteviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#siteviews theoslittlebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#theoslittlebot pywowbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pywowbot matthewrbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#matthewrbot whymbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#whymbot thegoodplacehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#thegoodplace watchlist-webhookshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#watchlist-webhooks article-topicshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#article-topics name-to-qhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#name-to-q afrobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#afrobot stemmeberettigelsehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#stemmeberettigelse ruptho-interaction-classifierhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ruptho-interaction-classifier lincolnbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lincolnbot procbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#procbot t-inclusionshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#t-inclusions sqoop-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#sqoop-tool mfnf-exporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mfnf-export magnustoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#magnustools bd808-test2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#bd808-test2 bookmanagerv2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#bookmanagerv2 wlm-de-utilshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wlm-de-utils megacronhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#megacron hartmanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#hartman wikidipendenzahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikidipendenza test-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#test-tool hassenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#hassen wantedpageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wantedpages iglhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#igl brandbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#brandbot twlbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#twlbot kc-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kc-test aftabbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#aftabbot wikioverdatahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikioverdata suhahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#suha my-first-pywikibot-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#my-first-pywikibot-tool fawikiautohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fawikiauto lonelylinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lonelylinks salebothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#salebot stewbotshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#stewbots papapybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#papapybot flickrdashhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#flickrdash paws-supporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#paws-support wiki-task-locatorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiki-task-locator spi-experimentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#spi-experiments pageviews-testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pageviews-test codeqchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#codeqc service001https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#service001 picturesquehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#picturesque wikivizhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikiviz namakemonohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#namakemono commonsapihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#commonsapi bluehillbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#bluehillbot wmcounterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wmcounter checklinkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#checklinks eventshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#events metmuseumhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#metmuseum usergraphhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#usergraph w2c-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#w2c-beta tools-edit-counthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#tools-edit-count wdapihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wdapi wikisphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikisp wordtowikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wordtowiki grid-deprecationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#grid-deprecation powowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#powow wikicitevishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikicitevis wiki-patrimoniohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiki-patrimonio telnethttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#telnet cocytushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cocytus php-security-checkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#php-security-checker labstore-profilinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#labstore-profiling knowledgegrapherhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#knowledgegrapher daahbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#daahbot ahechtbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ahechtbot fubarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fubar alanajjarhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#alanajjar monumentalhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#monumental questhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#quest corhisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#corhist cybertoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cybertools mwhook-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mwhook-bot dbbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#dbbot ashleybothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ashleybot langviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#langviews eulenwiki2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#eulenwiki2 archivinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#archiving stabilizerbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#stabilizerbot spellbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#spellbot fajrbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fajrbot dowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#dow endumenhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#endumen kolega2357https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kolega2357 deploy-commandshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#deploy-commands global-wiki-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#global-wiki-tools sithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#sit montagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#montage article-suggestionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#article-suggestion as-info-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#as-info-dev mismatch-finder-staginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mismatch-finder-staging ru-unreliable-music-sourceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ru-unreliable-music-sources certifyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#certify bcxfu75kbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#bcxfu75kbot media-dubietyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#media-dubiety newiki-editathonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#newiki-editathon xqtoolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#xqtools mvchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mvc stwalkersterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#stwalkerster ccmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ccm rustuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#rustup dreamyjazzbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#dreamyjazzbot codelookuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#codelookup recitation-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#recitation-bot arnaubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#arnaubot rubinwebhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#rubinweb dibabelhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#dibabel majavah-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#majavah-bot urdubothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#urdubot csp-reporthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#csp-report himohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#himo vcathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#vcat ttshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#tts grid-jobshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#grid-jobs kaarehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kaare intelirchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#intelirc unicornifyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#unicornify honeypot95https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#honeypot95 gerrit-to-redishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#gerrit-to-redis mediawiki-mirrorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mediawiki-mirror wdrchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wdrc lowhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#low redis-blueprinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#redis-blueprint ryuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ryu neuraltricityhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#neuraltricity merlbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#merlbot steinsplitter2https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#steinsplitter2 srwiki-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#srwiki-dev mbhhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mbh redirectviewshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#redirectviews wiktionnaire-pamputthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiktionnaire-pamputt irfanhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#irfan teyora-glitchtiphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#teyora-glitchtip oauth-hello-worldhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#oauth-hello-world matthewrbowkerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#matthewrbowker verb-import-gamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#verb-import-game zhwp-afchttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#zhwp-afc pm20timelinehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pm20timeline precise-toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#precise-tools wikiradiohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wikiradio top25reportbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#top25reportbot cloudvpshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cloudvps scholia-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#scholia-dev imagetracerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#imagetracer artlisthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#artlist userimpacthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#userimpact prehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pre revibot-ihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#revibot-i wiki2prophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiki2prop denkmalliste-hamburghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#denkmalliste-hamburg historyviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#historyview patrolstatshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#patrolstats lalmhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lalm fontcdnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fontcdn blamehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#blame liangenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#liangent kuwikibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kuwikibot commonsinterwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#commonsinterwiki docwizardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#docwizard entity-maphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#entity-map funhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fun wiki-retweet-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiki-retweet-bot openstack-browser-devhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#openstack-browser-dev meteofrancetoclimathttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#meteofrancetoclimat indicwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#indicwiki sistercitieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#sistercities cauchyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cauchy arturo-test-toolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#arturo-test-tool kanikbot-bnhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#kanikbot-bn labelimgohshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#labelimgohs wmchartshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wmcharts lilbithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lilbit dddhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ddd xyzbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#xyzbot tristessahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#tristessa featured-articlehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#featured-article pastebinhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pastebin enkore-toolkithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#enkore-toolkit revibothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#revibot brazilianlawshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#brazilianlaws mgpxhhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mgpxh lets-translatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lets-translate discordsysbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#discordsysbot missing-valuehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#missing-value nccroptoolhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#nccroptool checkdictation-fahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#checkdictation-fa cbng-sql-6https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#cbng-sql-6 hamishbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#hamishbot lozbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#lozbot wiki-geohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wiki-geo ukbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#ukbot locatorbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#locatorbot fingerprinthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fingerprint wakt-betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wakt-beta abstract-wiki-dshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#abstract-wiki-ds threed2commonshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#threed2commons fabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#fab flaky-cihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#flaky-ci icu-transliteratehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#icu-transliterate geohackhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#geohack taxobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#taxobot gsochttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#gsoc image-metadata-viewerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#image-metadata-viewer catscan-pophttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#catscan-pop wbothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#wbot externalitemsuggesterhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#externalitemsuggester srwikihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#srwiki rotpunkt-bothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#rotpunkt-bot germancontributioncountshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#germancontributioncounts pickmehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pickme massmailerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#massmailer mwcoreteamhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#mwcoreteam altobothttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#altobot redirtesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#redirtest pbhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#pb patrallhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep/Lists/3#patrall https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images Origin task: phab:T336669 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Options_considered Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336669_How_to_provide_a_way_to_install_system_dependencies_for_buildpack-based_images#Option_3 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service Origin task: [of the decision: 2023-05-26 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Options_considered Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T335979_Toolforge_envvars/secrets_service#Option_3 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files Origin task: phab:T336376 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files#Options_considered Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files#Option_1 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T336376_Find_a_standard_place_for_all_the_toolforge-related_config_files# https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#Search_Update_Pipeline Finalize Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#Finalize_Search_SLOs Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-05-23#Misc https://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-25_eqiad/LVS#Scorecard https://wikitech.wikimedia.org/wiki/Clinic_duty You may be looking for: https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment === Service === Servicehttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Service Teamshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Clients Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/MediaWiki_Event_Enrichment/SLO/Mediawiki_Page_Content_Change_Enrichment#Reconciliation https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation In 2022, the [Platform Value Stream], did an evaluation of Stream Processing frameworks for use with WMF's Event Platform. This page contains the results of that evaluation. Features we need now (2022)https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Features_we_need_now_(2022) Things we might want in the futurehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Things_we_might_want_in_the_future Other considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Other_considerations General Remarkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#General_Remarks Multi DChttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Multi_DC Flinkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Flink Spark Structured Streaminghttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Spark_Structured_Streaming Kafka Streamshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Kafka_Streams Knative Eventinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Knative_Eventing Use Case Considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Use_Case_Considerations Decision Recordhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Decision_Record Supplementary Researchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Event_Platform/Stream_Processing/Framework_Evaluation#Supplementary_Research https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Use_cases Here we collect a list of projects that would benefit from a stream processing platform. This page categorizes these use cases with the following requirements. Use Caseshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Use_cases#Use_Cases https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy == CiviProxy On Docker == CiviProxy On Dockerhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#CiviProxy_On_Docker Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Overview Setuphttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Setup Hard-code CIVICRM_SITE_KEY to docker_site_keyhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Hard-code_CIVICRM_SITE_KEY_to_docker_site_key Update `civicrm`.`contact` api_key field for admin user to 'docker-api-key'https://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Update_`civicrm`.`contact`_api_key_field_for_admin_user_to_'docker-api-key' Otherhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Other Docker stack CiviProxy Test URLhttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Docker_stack_CiviProxy_Test_URL Gerrit patcheshttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Gerrit_patches Local Troubleshootinghttps://wikitech.wikimedia.org/wiki/Fundraising/External-facing/CiviProxy#Local_Troubleshooting https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66 == 2023-05-31 == 2023-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-31 2023-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-30 2023-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-29 2023-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-28 2023-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-27 2023-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-26 2023-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-25 2023-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-24 2023-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-23 2023-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-22 2023-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-21 2023-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-20 2023-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-19 2023-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-18 2023-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-17 2023-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-16 2023-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-15 2023-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-12 2023-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-11 2023-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-10 2023-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-09 2023-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-08 2023-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-07 2023-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-06 2023-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-05 2023-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-04 2023-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-03 2023-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-02 2023-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_66#2023-05-01 https://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-30_Unintentional_%2B2_on_a_config_patch_without_deployment#Scorecard https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg Apache Iceberg adds a layer between Hadoop SQL engines and filesystems like HDFS and Ceph so that the semantics of data read and write are more familiar to users of relational databases. That is, Iceberg is atomic, as in writes don’t mess up reads, and more scalable since query plan computations are done locally without depending on external catalogs or walking file systems trees. Query Engine Supporthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#Query_Engine_Support Accessing metadatahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#Accessing_metadata Migration from Hive Tableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#Migration_from_Hive_Tables What to expect in terms of queryinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#What_to_expect_in_terms_of_querying Changes to database nameshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#Changes_to_database_names Table migration check listhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#Table_migration_check_list Which tables are migrated?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg#Which_tables_are_migrated? https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#What_we've_accomplished Search Analysishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#Search_Analysis Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#WDQS_graph_splitting Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#Search_SLOs Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-02#Misc https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication This runbook is about different types of problems in the ToolsDB replication from the primary instance to the replica instance. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Debugging Checking the replication statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Checking_the_replication_status If the replication is runninghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#If_the_replication_is_running If the replication is NOT runninghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#If_the_replication_is_NOT_running Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Common_issues Transactions way slower on the secondary than the primaryhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Transactions_way_slower_on_the_secondary_than_the_primary Replication stops because of "invalid event"https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Replication_stops_because_of_"invalid_event" Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBReplication#Old_incidents https://wikitech.wikimedia.org/wiki/PCS https://wikitech.wikimedia.org/wiki/Page_Content_Service https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy == Key concepts == Key conceptshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Key_concepts Project Roleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Project_Roles Domain Roleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Domain_Roles Scopehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Scope Policyhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Policy Testinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Testing See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#See_also Related taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_roles_and_policy#Related_tasks https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli == openstack == openstackhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#openstack wmcs-openstackhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#wmcs-openstack project-specific toolshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#project-specific_tools Authhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#Auth command-line flagshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#command-line_flags shell environmenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#shell_environment clouds.yamlhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#clouds.yaml Project selectionhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#Project_selection See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#See_also Related taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_cli#Related_tasks https://wikitech.wikimedia.org/wiki/Image-suggestion/Runbook Sometimes some of the data that the [pipeline] (or pipelines]) relies on fails to generate What to do when that happenshttps://wikitech.wikimedia.org/wiki/Image-suggestion/Runbook#What_to_do_when_that_happens DAGs timeouthttps://wikitech.wikimedia.org/wiki/Image-suggestion/Runbook#DAGs_timeout Search indiceshttps://wikitech.wikimedia.org/wiki/Image-suggestion/Runbook#Search_indices Cassandra TTLhttps://wikitech.wikimedia.org/wiki/Image-suggestion/Runbook#Cassandra_TTL https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06 = Toolforge Workgroup meeting 2023-06-06 notes = Toolforge Workgroup meeting 2023-06-06 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Toolforge_Workgroup_meeting_2023-06-06_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Notes Build service status and next stepshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Build_service_status_and_next_steps Image build and publish automation on gitlabhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Image_build_and_publish_automation_on_gitlab Envvars service almost readyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Envvars_service_almost_ready State of lima-kilohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#State_of_lima-kilo Any reflections on Toolforge vs Hellforge (PaaS vs(and?) managed-k8s). How to drive this initiative forward?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Any_reflections_on_Toolforge_vs_Hellforge_(PaaS_vs(and?)_managed-k8s)._How_to_drive_this_initiative_forward? Would some serverless offering be part of Toolforge, or a new brand/product? How to drive this initiative forward?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Would_some_serverless_offering_be_part_of_Toolforge,_or_a_new_brand/product?_How_to_drive_this_initiative_forward? Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-06-06#Action_items https://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-06_dawiktionary/dawiki/svwiktionary_partial_outage#Scorecard https://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots This page documents the various cookbooks/commands that need to be run to reboot hosts in the Traffic cluster. cache-proxyhttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#cache-proxy DNS recursors/authoritativehttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#DNS_recursors/authoritative acmechiefhttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#acmechief ncredirhttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#ncredir Wikimedia DNShttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#Wikimedia_DNS durumhttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#durum lvshttps://wikitech.wikimedia.org/wiki/SRE/Traffic/Cluster_Reboots#lvs https://wikitech.wikimedia.org/wiki/Performance/SlackBot The Slackbot offers an easy to use testing experience by starting testing right from the slack workspace. Overviewhttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Overview Getting Startedhttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Getting_Started Installation and Setuphttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Installation_and_Setup Authentication and External dependencies or integration requiredhttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Authentication_and_External_dependencies_or_integration_required Authenticationhttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Authentication Bot Functionalityhttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Bot_Functionality Command Usagehttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Command_Usage Test Resulthttps://wikitech.wikimedia.org/wiki/Performance/SlackBot#Test_Result https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09#What_we've_accomplished Language analysis harmonizationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09#Language_analysis_harmonization Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09#Search_Update_Pipeline Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-09#Misc https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/06 ==Week of June 05== Week of June 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/06#Week_of_June_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/06#=== Week of June 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/06#Week_of_June_12 Week of June 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/06#Week_of_June_19 Week of June 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/06#Week_of_June_26 https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Bigtop_Packages === Overview === Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Bigtop_Packages#Overview WMF Build Scripthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Bigtop_Packages#WMF_Build_Script Package Amendmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Bigtop_Packages#Package_Amendment https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps In the course of planning a new architecture for dumps.wikimedia. Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Architecture Near-Real Timehttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Near-Real_Time Flinkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Flink Spark Streaminghttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Spark_Streaming Decisionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Decision Batchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Batch Sparkhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations/Dumps#Spark https://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations An index page for any technical evaluations we have gone through on the Data Engineering or Analytics teams. Child Pages ofhttps://wikitech.wikimedia.org/wiki/Data_Platform/Evaluations#Child_Pages_of https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering == Guides == Guideshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Guides Development toolshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Development_tools Frontend developmenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Frontend_development Backend developmenthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Backend_development Internal runbookshttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Internal_runbooks Contacthttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Contact Intake processhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#Intake_process [Platform Team]https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering#[Platform_Team] https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Access_control == Phabricator == Phabricatorhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Access_control#Phabricator Gerrithttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Access_control#Gerrit IRChttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Access_control#IRC See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Access_control#See_also https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle High level overview of how an event makes it into the analytics-hadoop cluster. Event Ingestion Lifecyclehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#Event_Ingestion_Lifecycle Canary Eventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#Canary_Events Why?https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#Why? Problemhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#Problem Solutionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#Solution ProduceCanaryEventshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#ProduceCanaryEvents See alsohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Hadoop_Event_Ingestion_Lifecycle#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service Documentation of components and common admin procedures for Build Service. Componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Components Alertshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Alerts Dashboardshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Dashboards Main phabricator boardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Main_phabricator_board Administrative taskshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Administrative_tasks Starting a servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Starting_a_service Envvars APIhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Envvars_API Envvars admission controllerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Envvars_admission_controller Stopping a servicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Stopping_a_service Checking all components are alivehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Envvars_Service#Checking_all_components_are_alive https://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Summary Example tools which rely on the wikireplicas:https://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Example_tools_which_rely_on_the_wikireplicas: Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-05-28_wikireplicas_lag#Scorecard https://wikitech.wikimedia.org/wiki/People1004 people1004 is a virtual machine running on Ganeti on Debian bookworm. It hosts the service People. Connectinghttps://wikitech.wikimedia.org/wiki/People1004#Connecting https://wikitech.wikimedia.org/wiki/People2003 people2003 is a virtual machine running on Ganeti on Debian bookworm. It hosts the service People. Connectinghttps://wikitech.wikimedia.org/wiki/People2003#Connecting https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16#Search_Update_Pipeline Improve multilngual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16#Improve_multilngual_zero-results_rate Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-16#Misc https://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Timeline Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-06-18_search_broken_on_wikidata_and_commons#Scorecard https://wikitech.wikimedia.org/wiki/Puppet/Bootstrap When installing the puppet server for the first time there is a bit of a bootstrapping step specifically because we want to use out own CA. Standard Puppetserverhttps://wikitech.wikimedia.org/wiki/Puppet/Bootstrap#Standard_Puppetserver Puppet CAhttps://wikitech.wikimedia.org/wiki/Puppet/Bootstrap#Puppet_CA https://wikitech.wikimedia.org/wiki/IDM/Runbook === Infrastructure === Infrastructurehttps://wikitech.wikimedia.org/wiki/IDM/Runbook#Infrastructure Failed serviceshttps://wikitech.wikimedia.org/wiki/IDM/Runbook#Failed_services Failoverhttps://wikitech.wikimedia.org/wiki/IDM/Runbook#Failover Debugging on the standby hosthttps://wikitech.wikimedia.org/wiki/IDM/Runbook#Debugging_on_the_standby_host Debug logginghttps://wikitech.wikimedia.org/wiki/IDM/Runbook#Debug_logging https://wikitech.wikimedia.org/wiki/SRE/LDAP/Sysusers A few special accounts are owned by a given team, but not representing a human user. They are stored under the special LDAP OU ou=sysusers. https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog This page documents the initial prototype of the Event Catalog for Apache Flink. Getting Startedhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Getting_Started Optionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Options Catalog Optionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Catalog_Options Table Optionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Table_Options Exampleshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Examples Creating a table for inserting events into a topichttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Creating_a_table_for_inserting_events_into_a_topic Creating a table with additional columnshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Creating_a_table_with_additional_columns Creating a custom table based off an event schema but with a different connectorhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Creating_a_custom_table_based_off_an_event_schema_but_with_a_different_connector Limitationshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Limitations Internalshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Internals Creating Tableshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Creating_Tables Validationhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Validation Meta-Definitionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Meta-Definitions Pseudo-Table Optionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Pseudo-Table_Options Override Optionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Override_Options Shared Optionshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Shared_Options Overlaphttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink_Catalog#Overlap https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink/FailureScenarios == Known/Observed Flink Failure Scenarios == Known/Observed Flink Failure Scenarioshttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink/FailureScenarios#Known/Observed_Flink_Failure_Scenarios Kubernetes Operatorhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink/FailureScenarios#Kubernetes_Operator Workaroundhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Processing/Flink/FailureScenarios#Workaround https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#What_we've_accomplished Improve multilngual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#Improve_multilngual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#Search_Update_Pipeline WDQS Split the graphhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#WDQS_Split_the_graph Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#Operations Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-23#Misc https://wikitech.wikimedia.org/wiki/GitLab/Runbook A runbook is a set of instructions for a human what to do. More specifically what to do when a certain monitoring alert triggers. GitLabCIJobErrorshttps://wikitech.wikimedia.org/wiki/GitLab/Runbook#GitLabCIJobErrors GitLabCIPipelineErrorshttps://wikitech.wikimedia.org/wiki/GitLab/Runbook#GitLabCIPipelineErrors GitLabCIPipelineLatencyhttps://wikitech.wikimedia.org/wiki/GitLab/Runbook#GitLabCIPipelineLatency GitLabRunnerTrustedConfigMissinghttps://wikitech.wikimedia.org/wiki/GitLab/Runbook#GitLabRunnerTrustedConfigMissing https://wikitech.wikimedia.org/wiki/Event_Platform/Decision_Log {| class="wikitable" Decision loghttps://wikitech.wikimedia.org/wiki/Category:Decision_log https://wikitech.wikimedia.org/wiki/Katran Katran is a C++ library and [Packet Filter|BPF] program intended for use in building a high-performance layer 4 load balancing forwarding plane. It is currently being evaluated by the [Site Reliability Engineering#Traffic|Traffic Team] as a replacement for PyBal in a project [code name|code named] LiBerica. Noteshttps://wikitech.wikimedia.org/wiki/Katran#Notes Vagrant lab environmenthttps://wikitech.wikimedia.org/wiki/Katran#Vagrant_lab_environment Compile Katran lib (gRPC example)https://wikitech.wikimedia.org/wiki/Katran#Compile_Katran_lib_(gRPC_example) Compile katran libs in debian bullseye (deprecated, preferred distribution will be bookworm)https://wikitech.wikimedia.org/wiki/Katran#Compile_katran_libs_in_debian_bullseye_(deprecated,_preferred_distribution_will_be_bookworm) Compile katran libs in debian bookwormhttps://wikitech.wikimedia.org/wiki/Katran#Compile_katran_libs_in_debian_bookworm Compiling the gRPC clienthttps://wikitech.wikimedia.org/wiki/Katran#Compiling_the_gRPC_client Compiling BPF moduleshttps://wikitech.wikimedia.org/wiki/Katran#Compiling_BPF_modules Cleanuphttps://wikitech.wikimedia.org/wiki/Katran#Cleanup DOCS & stuffhttps://wikitech.wikimedia.org/wiki/Katran#DOCS_&_stuff TODOhttps://wikitech.wikimedia.org/wiki/Katran#TODO https://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy == Problem Statement == Problem Statementhttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#Problem_Statement Policyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#Policy Potential reviewershttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#Potential_reviewers Best practices for adoption of upstream helm chartshttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#Best_practices_for_adoption_of_upstream_helm_charts Non Upstream patcheshttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#Non_Upstream_patches Special considerations considering privilegeshttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#Special_considerations_considering_privileges The case of ClusterRoleshttps://wikitech.wikimedia.org/wiki/Kubernetes/Upstream_Helm_charts_policy#The_case_of_ClusterRoles https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts This page holds a list of upstream charts that have been evaluated for usage in the Wikimedia Production Kubernetes clusters using Kubernetes/Upstream_Helm_charts_policy. Evaluated Chartshttps://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts#Evaluated_Charts Charts in progresshttps://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts#Charts_in_progress https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/Template Chart name: To Be Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:To_Be_Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse#Debugging Operationshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse#Operations Services restarthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse#Services_restart Increase number of workerhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse#Increase_number_of_worker Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse#Old_incidents https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Terraform_Alert Split into per-alert runbooks following team practices: https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details Origin task: phab:T339198 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Options_considered Partial Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Partial_Options Versioning schemehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Versioning_scheme VS Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#VS_Option_1 VS Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#VS_Option_2 VS Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#VS_Option_3 Artifactshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Artifacts Arts option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Arts_option_1 Arts option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Arts_option_2 When to shiphttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#When_to_ship Shipping Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Shipping_Option_1 Shipping Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Shipping_Option_2 Shipping Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Shipping_Option_3 Shipping Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Shipping_Option_4 Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Option_4 Option 5https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T339198_Toolforge_component_deployment_flow_details#Option_5 https://wikitech.wikimedia.org/wiki/Python/Development_Tools == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Introduction Overviewhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Overview Prerequisiteshttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Prerequisites Pyenvhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Pyenv Installationhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Installation Usagehttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Usage Pyenv-virtualenvhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Pyenv-virtualenv Poetryhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Poetry Setting the Python versionhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Setting_the_Python_version Dependency managementhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Dependency_management Virtual environments and Poetryhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Virtual_environments_and_Poetry Toxhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Tox Running commands with Toxhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Running_commands_with_Tox Direnvhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Direnv Integrate direnv with pyenv-virtualenvhttps://wikitech.wikimedia.org/wiki/Python/Development_Tools#Integrate_direnv_with_pyenv-virtualenv https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30#Search_Update_Pipeline Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-06-30#Misc https://wikitech.wikimedia.org/wiki/Contint2002 contint2002 will run the continuous integration tools such as Jenkins and Zuul and replace contint2001 hardware. Aliashttps://wikitech.wikimedia.org/wiki/Contint2002#Alias Serviceshttps://wikitech.wikimedia.org/wiki/Contint2002#Services Mischttps://wikitech.wikimedia.org/wiki/Contint2002#Misc https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67 == 2023-06-30 == 2023-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-30 2023-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-29 2023-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-28 2023-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-27 2023-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-26 2023-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-25 2023-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-23 2023-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-22 2023-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-21 2023-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-20 2023-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-19 2023-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-18 2023-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-16 2023-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-15 2023-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-14 2023-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-13 2023-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-12 2023-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-11 2023-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-10 2023-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-09 2023-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-08 2023-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-07 2023-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-06 2023-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-05 2023-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-03 2023-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-02 2023-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#2023-06-01 Othe archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_67#Othe_archives https://wikitech.wikimedia.org/wiki/W3C Wikimedia Foundation is a member organisation of the World Wide Web Consortium (W3C) as of March 2019. Any Foundation staff member, or [volunteer, may join and participate in W3C Working Groups, W3C Interest Groups, and W3C Community Groups on behalf of WMF. AC rephttps://wikitech.wikimedia.org/wiki/W3C#AC_rep What is the W3C and what do they do?https://wikitech.wikimedia.org/wiki/W3C#What_is_the_W3C_and_what_do_they_do? Costhttps://wikitech.wikimedia.org/wiki/W3C#Cost Purpose of our membershiphttps://wikitech.wikimedia.org/wiki/W3C#Purpose_of_our_membership How to participatehttps://wikitech.wikimedia.org/wiki/W3C#How_to_participate Create an accounthttps://wikitech.wikimedia.org/wiki/W3C#Create_an_account Join working groups, interest groups, or community groupshttps://wikitech.wikimedia.org/wiki/W3C#Join_working_groups,_interest_groups,_or_community_groups Current participationhttps://wikitech.wikimedia.org/wiki/W3C#Current_participation Further readinghttps://wikitech.wikimedia.org/wiki/W3C#Further_reading https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-07 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-07#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-07#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-07#Search_Update_Pipeline Operations/SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-07#Operations/SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-07#Misc https://wikitech.wikimedia.org/wiki/MediaModeration This section describes the configuration and operation of maintenance scripts associated with [and the [[phab:project/view/6841/|MediaModeration 2.0 milestone]. Processing images manually, November 2024https://wikitech.wikimedia.org/wiki/MediaModeration#Processing_images_manually,_November_2024 Processing images manually, January 2024https://wikitech.wikimedia.org/wiki/MediaModeration#Processing_images_manually,_January_2024 Alertshttps://wikitech.wikimedia.org/wiki/MediaModeration#Alerts Overviewhttps://wikitech.wikimedia.org/wiki/MediaModeration#Overview Metricshttps://wikitech.wikimedia.org/wiki/MediaModeration#Metrics PhotoDNAhttps://wikitech.wikimedia.org/wiki/MediaModeration#PhotoDNA https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07 ==Week of July 03== Week of July 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07#Week_of_July_03 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07#=== Week of July 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07#Week_of_July_10 Week of July 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07#Week_of_July_17 Week of July 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07#Week_of_July_24 Week of July 31https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/07#Week_of_July_31 https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works == What is in a MediaWiki kubernetes pod == What is in a MediaWiki kubernetes podhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#What_is_in_a_MediaWiki_kubernetes_pod mediawiki-httpd (apache)https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#mediawiki-httpd_(apache) Resource utilizationhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#Resource_utilization The docker image layeringhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#The_docker_image_layering In the charthttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#In_the_chart Logginghttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#Logging Metricshttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#Metrics mediawiki-app (php-fpm)https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#mediawiki-app_(php-fpm) mediawiki-mcrouterhttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#mediawiki-mcrouter The docker imagehttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#The_docker_image tls-proxy (envoy)https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#tls-proxy_(envoy) Syncing with puppethttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#Syncing_with_puppet rsysloghttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/How_it_works#rsyslog https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11 = Toolforge Workgroup meeting 2023-07-11 notes = Toolforge Workgroup meeting 2023-07-11 noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Toolforge_Workgroup_meeting_2023-07-11_notes Participantshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Participants Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Notes K8s infra rough edgeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#K8s_infra_rough_edges Second round of buildservicehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Second_round_of_buildservice Toolforge deploy statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Toolforge_deploy_status Action pointshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-07-11#Action_points https://wikitech.wikimedia.org/wiki/Stat1009 The stat1009 server is an Analytics Cluster client node for accessing Analytics MariaDB databases or Hadoop. Successor to stat1006. Usagehttps://wikitech.wikimedia.org/wiki/Stat1009#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1009#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1009#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1009#Notes https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Common_issues Quota errors when creating the trove databaseshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Quota_errors_when_creating_the_trove_databases Quota usage and requests out of synchttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Quota_usage_and_requests_out_of_sync Rabbitmq issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Rabbitmq_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestDestroyFailed == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestDestroyFailed#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestDestroyFailed#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestDestroyFailed#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestDestroyFailed#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestDestroyFailed#Old_incidents https://wikitech.wikimedia.org/wiki/Kokkuri https://wikitech.wikimedia.org/wiki/SONiC/cheatsheet == OSS SONiC == OSS SONiChttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#OSS_SONiC Software upgradeshttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Software_upgrades Run commands from the MGMT vrfhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Run_commands_from_the_MGMT_vrf Configurationhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Configuration Database Operationshttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Database_Operations Dumping DBhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Dumping_DB JSONhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#JSON Key/valuehttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Key/value Writing datahttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Writing_data Deleting datahttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Deleting_data Dockerhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Docker For example, which DB keys control the gNMI daemon and where do the cert/key files need to be located ?https://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#For_example,_which_DB_keys_control_the_gNMI_daemon_and_where_do_the_cert/key_files_need_to_be_located_? Users managementhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Users_management gNMIhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#gNMI Sethttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Set See alsohttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#See_also RESTCONFhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#RESTCONF Dell SONiChttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Dell_SONiC Software upgradehttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Software_upgrade Cleanuphttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Cleanup TLS certificate operationshttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#TLS_certificate_operations User managementhttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#User_management Dochttps://wikitech.wikimedia.org/wiki/SONiC/cheatsheet#Doc https://wikitech.wikimedia.org/wiki/Miscweb1003 miscweb1003 is a virtual machine on Ganeti which is hosting several misc. web sites, including: See alsohttps://wikitech.wikimedia.org/wiki/Miscweb1003#See_also https://wikitech.wikimedia.org/wiki/Miscweb2003 miscweb2003 is a virtual machine on Ganeti which is hosting several misc. web sites, including: See alsohttps://wikitech.wikimedia.org/wiki/Miscweb2003#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-14 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-14#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-14#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-14#Search_Update_Pipeline Improve Multilingual Zero-Results Ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-14#Improve_Multilingual_Zero-Results_Rate Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-14#Misc https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-out_of_band_management_access ==Server Out-of-Band Management-Access== Server Out-of-Band Management-Accesshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-out_of_band_management_access#Server_Out-of-Band_Management-Access Connecting by SSHhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-out_of_band_management_access#Connecting_by_SSH Dell DRAC Useful Commands/Operationshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-out_of_band_management_access#Dell_DRAC_Useful_Commands/Operations https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-procurement_and_install ==Server Procurement and Install== Server Procurement and Installhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-procurement_and_install#Server_Procurement_and_Install Server Procurementhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-procurement_and_install#Server_Procurement Datacenter Install and Configurationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-procurement_and_install#Datacenter_Install_and_Configuration Software Install and Configurationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-procurement_and_install#Software_Install_and_Configuration Service Setuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-procurement_and_install#Service_Setup https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-standard_software_vulnerability_management ==Operating System and Vendor Software Vulnerability Procedures== Operating System and Vendor Software Vulnerability Procedureshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-standard_software_vulnerability_management#Operating_System_and_Vendor_Software_Vulnerability_Procedures Purposehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-standard_software_vulnerability_management#Purpose Vulnerability Trackinghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-standard_software_vulnerability_management#Vulnerability_Tracking Automated Trackinghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-standard_software_vulnerability_management#Automated_Tracking Vulnerability Managementhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-standard_software_vulnerability_management#Vulnerability_Management https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_kdc_install ==Services: Kerberos KDC Master Setup Procedure== Services: Kerberos KDC Master Setup Procedurehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_kdc_install#Services:_Kerberos_KDC_Master_Setup_Procedure Create a New Kerberos Realmhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_kdc_install#Create_a_New_Kerberos_Realm Add an Administrative User, Configure Realm Policies, Additional Usershttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_kdc_install#Add_an_Administrative_User,_Configure_Realm_Policies,_Additional_Users https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup ==Services: Kerberos New KDC Replica Setup== Services: Kerberos New KDC Replica Setuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#Services:_Kerberos_New_KDC_Replica_Setup First, create a host key for new Kerberos replica hosthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#First,_create_a_host_key_for_new_Kerberos_replica_host The next step is to extract these keys to the keytab file.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#The_next_step_is_to_extract_these_keys_to_the_keytab_file. Next we need to copy the keytab to the new host that is being set up.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#Next_we_need_to_copy_the_keytab_to_the_new_host_that_is_being_set_up. Then we can run the krb5_propagate script to do the regular propagation.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#Then_we_can_run_the_krb5_propagate_script_to_do_the_regular_propagation. Not done yet. For the service to start on the replica, there are a few more files that need to be copied across.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#Not_done_yet._For_the_service_to_start_on_the_replica,_there_are_a_few_more_files_that_need_to_be_copied_across. You should now be able to start the kdc admin processes on the replica.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_new_replica_setup#You_should_now_be_able_to_start_the_kdc_admin_processes_on_the_replica. https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management =Users: Kerberos User Management= Users: Kerberos User Managementhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#Users:_Kerberos_User_Management To create a new userhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#To_create_a_new_user Use kadmin.local as roothttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#Use_kadmin.local_as_root Show existing usershttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#Show_existing_users Add user with username matching (frack) puppet/hieradata/user/users.yamlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#Add_user_with_username_matching_(frack)_puppet/hieradata/user/users.yaml Set the new password to expire after the first usehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#Set_the_new_password_to_expire_after_the_first_use Provide the user with their temporary password and tell them to change it via 'passwd' command on any frack hosthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#Provide_the_user_with_their_temporary_password_and_tell_them_to_change_it_via_'passwd'_command_on_any_frack_host To change a password for an existing userhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-kerberos_user_management#To_change_a_password_for_an_existing_user https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal ==SSL Client Certificate Yearly Renewal Process== SSL Client Certificate Yearly Renewal Processhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#SSL_Client_Certificate_Yearly_Renewal_Process Expiration listhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Expiration_list Notification and ticket scriptinghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Notification_and_ticket_scripting Phab ticket generationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Phab_ticket_generation User notification emailhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#User_notification_email Certificate renewalhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Certificate_renewal Standard renewal with no changeshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Standard_renewal_with_no_changes Renewal with changeshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Renewal_with_changes Password notificationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#Password_notification CRL update and probable git dancehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-ssl_client_certs_yearly_renewal#CRL_update_and_probable_git_dance https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist == Departing User Procedure / Checklist == Departing User Procedure / Checklisthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#Departing_User_Procedure_/_Checklist Prerequisiteshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#Prerequisites [ ] user_verificationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_user_verification User Data and Processeshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#User_Data_and_Processes Data to be retainedhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#Data_to_be_retained Processes running under the user's accounthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#Processes_running_under_the_user's_account Accounts and Serviceshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#Accounts_and_Services [ ] user accounthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_user_account [ ] client_ssl_certhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_client_ssl_cert [ ] yubikeyhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_yubikey [ ] sshhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_ssh [ ] mysqlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_mysql [ ] civicrmhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_civicrm [ ] supersethttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_superset [ ] failmail / email listshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_failmail_/_email_lists [ ] jupyterhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_jupyter [ ] Repository reviewerhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_Repository_reviewer [ ] Payment processor console accountshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-departing_user_offboarding_checklist#[_]_Payment_processor_console_accounts https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist == New User Procedure / Checklist == New User Procedure / Checklisthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#New_User_Procedure_/_Checklist Prerequisiteshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#Prerequisites [ ] user_verificationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_user_verification Accounts and Serviceshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#Accounts_and_Services [ ] client_ssl_certhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_client_ssl_cert [ ] civicrmhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_civicrm [ ] supersethttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_superset [ ] user accounthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_user_account [ ] yubikeyhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_yubikey [ ] sshhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_ssh [ ] mysqlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_mysql [ ] jupyterhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_jupyter [ ] Repository reviewerhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-new_user_checklist#[_]_Repository_reviewer https://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape = Table of Contents = Table of Contentshttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape#Table_of_Contents https://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow ==Equity Landscape Airflow== Equity Landscape Airflowhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#Equity_Landscape_Airflow DAGshttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#DAGs Schedulinghttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#Scheduling DAG executionhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#DAG_execution API DAGhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#API_DAG CSV DAGhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#CSV_DAG HQL DAGhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#HQL_DAG APP DAGhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Airflow#APP_DAG https://wikitech.wikimedia.org/wiki/Fundraising/techops This page is for Fundraising Tech Operations policy and procedure documentation. Help Docshttps://wikitech.wikimedia.org/wiki/Fundraising/techops#Help_Docs Policyhttps://wikitech.wikimedia.org/wiki/Fundraising/techops#Policy Procedureshttps://wikitech.wikimedia.org/wiki/Fundraising/techops#Procedures Server Administrationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops#Server_Administration Service Administrationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops#Service_Administration User Administrationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops#User_Administration https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue This page documents to the 'frqueue' redis service which handles contribution tracking messages and donor preference change messages. This service runs on the 'frqueue' server role in the Fundraising server cluster. Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Overview Origin Swaphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Origin_Swap Confirm that all client services (paymentswiki, civicrm queue consumers, smashpig, etc) are shut down.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Confirm_that_all_client_services_(paymentswiki,_civicrm_queue_consumers,_smashpig,_etc)_are_shut_down. Obtain the redis masterauth passwords from /etc/redis/*.confhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Obtain_the_redis_masterauth_passwords_from_/etc/redis/*.conf If the old redis origin server is dead, verify the new origin server has the latest Contribution ID.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#If_the_old_redis_origin_server_is_dead,_verify_the_new_origin_server_has_the_latest_Contribution_ID. Problemshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Problems Promote new origin server for redis-frqueuehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Promote_new_origin_server_for_redis-frqueue On each replica, change origins (discarding dataset) and resynchronize, check status.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#On_each_replica,_change_origins_(discarding_dataset)_and_resynchronize,_check_status. Adjust redis-related configuration in puppet.https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-redis-frqueue#Adjust_redis-related_configuration_in_puppet. https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates = mysql Trigger uploads for CiviCRM = mysql Trigger uploads for CiviCRMhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#mysql_Trigger_uploads_for_CiviCRM Requirements in place before an uploadhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Requirements_in_place_before_an_upload Prep work for the upload processhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Prep_work_for_the_upload_process Get the trigger scripts +2'd and pushed to productionhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Get_the_trigger_scripts_+2'd_and_pushed_to_production Capture the state of the old triggershttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Capture_the_state_of_the_old_triggers Copy generated trigger scripts from the active civicrm application server to the frdb origin serverhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Copy_generated_trigger_scripts_from_the_active_civicrm_application_server_to_the_frdb_origin_server Running the upload processhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Running_the_upload_process Stop queueshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Stop_queues Stop replication on one frdb replica serverhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Stop_replication_on_one_frdb_replica_server Run the trigger update script on the frdb origin serverhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Run_the_trigger_update_script_on_the_frdb_origin_server Verify the newly installed triggershttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Verify_the_newly_installed_triggers Capture the trigger statehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Capture_the_trigger_state Verify the line counthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Verify_the_line_count diff the triggers (choose one)https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#diff_the_triggers_(choose_one) Confirming the upload processhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Confirming_the_upload_process Post update actionshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_database_trigger_updates#Post_update_actions https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_access_request == Access Request == Access Requesthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_access_request#Access_Request Phabricator taskhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_access_request#Phabricator_task C-Level approvalhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_access_request#C-Level_approval Contact List Entryhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_access_request#Contact_List_Entry https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access To access fundraising machines, you will need an ssh key, a specialized ssh config file, and a yubikey. Access Requesthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access#Access_Request Yubikey Activationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access#Yubikey_Activation SSHhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access#SSH Generating your SSH keyhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access#Generating_your_SSH_key SSH Config filehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access#SSH_Config_file SSH Fingerprintshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/frack_ssh_access#SSH_Fingerprints https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup == Backup and restore steps for mariadb using mariabackup == Backup and restore steps for mariadb using mariabackuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Backup_and_restore_steps_for_mariadb_using_mariabackup Backupshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Backups Backup filehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Backup_file Restoreshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Restores Extracting the backuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Extracting_the_backup Prepare the backuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Prepare_the_backup Copying the backup into placehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Copying_the_backup_into_place Updating permissionshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Updating_permissions Useful Mariabackup Docshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#Useful_Mariabackup_Docs To look at / investigatehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_mariabackup#To_look_at_/_investigate https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-roles To see current information on which hosts are assigned to which roles see (frack) puppet/hieradata/hosts.yaml https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication In WMF Fundraising we protect some internal-use websites (e.g. Requesting A Certificatehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Requesting_A_Certificate Certificate Expiration and Renewalhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Certificate_Expiration_and_Renewal Retrieve Your Certificatehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Retrieve_Your_Certificate Download Via Email + SMShttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Download_Via_Email_+_SMS Download Via Shell Account (for users with shell access)https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Download_Via_Shell_Account_(for_users_with_shell_access) Installing the Certificate on Your Systemhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Installing_the_Certificate_on_Your_System Chrome/Chromium/Safari on OSXhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Chrome/Chromium/Safari_on_OSX Part 1: macOS Keychain Installhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Part_1:_macOS_Keychain_Install Part 2: Browser Setuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Part_2:_Browser_Setup Part 3: Why Doesn't It Work?!https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Part_3:_Why_Doesn't_It_Work?! Firefox on OSX/Linux/Windowshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Firefox_on_OSX/Linux/Windows Google Chromium on Linuxhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Google_Chromium_on_Linux Post-Install Cleanuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Post-Install_Cleanup Help!https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Help! Clear Browser Cachehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Clear_Browser_Cache Reboot Machinehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Reboot_Machine Verify Certificate Loaded with Permissionshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Verify_Certificate_Loaded_with_Permissions Repeated 'macOS X wants to make changes' Prompthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Repeated_'macOS_X_wants_to_make_changes'_Prompt macOS Keeps Asking for the Login Keychain Passwordhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#macOS_Keeps_Asking_for_the_Login_Keychain_Password System Time Is Incorrecthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#System_Time_Is_Incorrect Safari Appears to Stall After Entering https://civicrm.wikimedia.orghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/ssl_client_authentication#Safari_Appears_to_Stall_After_Entering_https://civicrm.wikimedia.org https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_tzinfo During our regular maintenance weeks, we want to update the time zone info stored in mariadb. To do so, we need to run the following command: https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-payments-settings This page describes how we manage settings across the payments cluster. LocalSettings Repohttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-payments-settings#LocalSettings_Repo SmashPighttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-payments-settings#SmashPig https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build == Special notes when building out a host in the build role == Special notes when building out a host in the build rolehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#Special_notes_when_building_out_a_host_in_the_build_role SSHhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#SSH Hierahttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#Hiera Puppethttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#Puppet GPGhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#GPG MariaDBhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#MariaDB Backupshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#Backups Code deployhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-role-build#Code_deploy https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone == MariaDB Cloning Process == MariaDB Cloning Processhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#MariaDB_Cloning_Process Prep the destination host (frdest1001)https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Prep_the_destination_host_(frdest1001) Cloning the data acrosshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Cloning_the_data_across Gather mysql replication information from sourcehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Gather_mysql_replication_information_from_source Prepare frdest1001 to receive the datahttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Prepare_frdest1001_to_receive_the_data Send the data across from frsource1001 to frdest1001https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Send_the_data_across_from_frsource1001_to_frdest1001 Wait for the data to clone acrosshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Wait_for_the_data_to_clone_across After the clone is completehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#After_the_clone_is_complete Restart mariadb/mysql on the source hosthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Restart_mariadb/mysql_on_the_source_host Set destination to not start replication on starthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Set_destination_to_not_start_replication_on_start Re-establish replication with primary databasehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Re-establish_replication_with_primary_database Cleanuphttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_clone#Cleanup https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap This is a procedure that can be used to swap a replica maria DB in as a new primary. In the future, this will hopefully be replaced by an automated procedure. Procedurehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Procedure Move site to downtime/maintenance modehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Move_site_to_downtime/maintenance_mode On current primaryhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#On_current_primary flush tables to get consistency - in mariadb/mysqlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#flush_tables_to_get_consistency_-_in_mariadb/mysql check all replicas to make sure they have the same Relay_Master_Log_File and Exec_Master_Log_Poshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#check_all_replicas_to_make_sure_they_have_the_same_Relay_Master_Log_File_and_Exec_Master_Log_Pos stop the dbhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#stop_the_db ensure the db doesn't start on boothttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#ensure_the_db_doesn't_start_on_boot On new primaryhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#On_new_primary Stop replication - in mariadb/mysqlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Stop_replication_-_in_mariadb/mysql Turn off read onlyhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Turn_off_read_only Reset 'master' - in mariadb/mysqlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Reset_'master'_-_in_mariadb/mysql Get 'master' positionhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Get_'master'_position On all the other replicashttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#On_all_the_other_replicas Stop replication from old primary DBhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Stop_replication_from_old_primary_DB Point replication at new hosthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Point_replication_at_new_host Start replication on new primary DBhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Start_replication_on_new_primary_DB Update DNS handles to point to new primary hosthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Update_DNS_handles_to_point_to_new_primary_host On old primary dbhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#On_old_primary_db Turn on read only as a safety measurehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Turn_on_read_only_as_a_safety_measure Reset 'master'https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Reset_'master' Reset 'slave' knowledgehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-mariadb_primary_swap#Reset_'slave'_knowledge https://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Summary Descriptionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Description Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-07-19_enrich_job_outage#Scorecard https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-21 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-21#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-21#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-21#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-21#Search_Update_Pipeline Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-21#Misc https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard ==Fundraising Server Build Standard== Fundraising Server Build Standardhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Fundraising_Server_Build_Standard Purposehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Purpose Server Lifecyclehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Server_Lifecycle Operating System and Base Softwarehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Operating_System_and_Base_Software Server Role and Functionhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Server_Role_and_Function Server Operating Systemhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Server_Operating_System Server Configuration and Hardeninghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Server_Configuration_and_Hardening Software Updateshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Software_Updates Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Testing Server Imaging and Orchestrationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_build_standard#Server_Imaging_and_Orchestration https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy ==Fundraising Server Policy== Fundraising Server Policyhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Fundraising_Server_Policy Purposehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Purpose Server Role and Functionhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Server_Role_and_Function Server Operating Systemhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Server_Operating_System Additional Softwarehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Additional_Software Software Updateshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Software_Updates Services and Protocolshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Services_and_Protocols Users and Administrative Accesshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Users_and_Administrative_Access Security Serviceshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Security_Services Secure Decommissioninghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-server_policy#Secure_Decommissioning https://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard =Equity Landscape Dashboard= Equity Landscape Dashboardhttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Equity_Landscape_Dashboard Setuphttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Setup Codehttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Code Storeshttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Stores Componentshttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Components Styleshttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Styles Chartshttps://wikitech.wikimedia.org/wiki/GDI/Equity_Landscape/Dashboard#Charts https://wikitech.wikimedia.org/wiki/DDoS Add some information here like attacks not being discussed publicly, the [2019 attack], the use of Cloudflare, etc. Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_cluster_deploy ==Fundraising Cluster Deploy== Fundraising Cluster Deployhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_cluster_deploy#Fundraising_Cluster_Deploy fundraising_code_updatehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_cluster_deploy#fundraising_code_update rsync_blasterhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/docs/fundraising_cluster_deploy#rsync_blaster https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-28 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-28#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-28#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-28#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-28#Improve_multilingual_zero-results_rate Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-07-28#Operations https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68 == 2023-07-31 == 2023-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-31 2023-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-29 2023-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-28 2023-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-27 2023-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-26 2023-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-25 2023-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-24 2023-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-23 2023-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-21 2023-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-20 2023-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-19 2023-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-18 2023-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-17 2023-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-16 2023-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-14 2023-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-13 2023-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-12 2023-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-11 2023-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-10 2023-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-09 2023-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-08 2023-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-07 2023-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-06 2023-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-05 2023-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-04 2023-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-03 2023-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#2023-07-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_68#Other_archives https://wikitech.wikimedia.org/wiki/Fundraising/Cluster/Grafana Put info on stats here https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04#Improve_multilingual_zero-results_rate Create project plan for WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04#Create_project_plan_for_WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-04#Misc https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/HTML_Email_Development Under construction. https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-decommissioning ==Fundraising Server Decommissioning== Fundraising Server Decommissioninghttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-decommissioning#Fundraising_Server_Decommissioning Server Decommissioning Procedurehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/servers-decommissioning#Server_Decommissioning_Procedure https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Performance_Review The Performance Review process is a critical service provided by MediaWiki Engineering to help uphold the integrity of production software and infrastructure at Wikimedia Foundation. Timelinehttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Performance_Review#Timeline Required preparationhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Performance_Review#Required_preparation How to request a performance reviewhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Performance_Review#How_to_request_a_performance_review See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Performance_Review#See_also https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/Calico Chart name: Calico Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/cert-manager Chart name: cert-manager Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/eventrouter Chart name: eventrouter Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/kube-state-metrics Chart name: kube-state-metrics Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-09_mw-on-k8s_outage_due_to_wrong_tls_cert#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks Cloud VPS administrators have to routinely perform some tasks like adding or removing users to a project, adding or removing a node to a cluster, etc. We have created a set of cookbooks to automate those tasks, and make sure they are performed in a way that is consistent, repeatable and traceable. Cookbooks vs Runbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Cookbooks_vs_Runbooks How to run a cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#How_to_run_a_cookbook Running a cookbook from a cloudcumin hosthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Running_a_cookbook_from_a_cloudcumin_host Listing available cookbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Listing_available_cookbooks Showing documentation for a single cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Showing_documentation_for_a_single_cookbook Running a cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Running_a_cookbook Using Screen/tmuxhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Using_Screen/tmux Running a cookbook from your laptophttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Running_a_cookbook_from_your_laptop Local setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Local_setup Common runbook optionshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Common_runbook_options Cuminhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Cumin SRE cookbooks and WMCS cookbookshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#SRE_cookbooks_and_WMCS_cookbooks Roadmaphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Roadmap Additional readinghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cookbooks#Additional_reading https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11#What_we've_accomplished Finalize Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11#Finalize_Search_SLOs Create project plan for WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11#Create_project_plan_for_WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11#Operations Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-11#Misc https://wikitech.wikimedia.org/wiki/Search/Update_Pipeline = Context = Contexthttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Context Linkshttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Links Decision recordshttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Decision_records Remove dependency on WDQS Streaming Updater (2023-10-16)https://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Remove_dependency_on_WDQS_Streaming_Updater_(2023-10-16) Duplicate fileshttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Duplicate_files Decisionhttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Decision Event transporthttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Event_transport Inputshttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Inputs Backing storage for Flink statehttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Backing_storage_for_Flink_state Checkpoints - S3https://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Checkpoints_-_S3 Watermarks - Zookeeperhttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Watermarks_-_Zookeeper Handling of files across local wiki and commonshttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Handling_of_files_across_local_wiki_and_commons Templatehttps://wikitech.wikimedia.org/wiki/Search/Update_Pipeline#Template https://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI Some notes on Debian packaging for WMF with dgit. This is solving a slightly different problem than "Debian packaging for upload to Debian", since we are interested in i) source code in git and ii) binary packages for installation, and do not care about source packages at all - Our preferred form for modification is a git repository instead. Executive Summary / TL;DRhttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Executive_Summary_/_TL;DR Rationale / Further Detailshttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Rationale_/_Further_Details Fetching Source Codehttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Fetching_Source_Code Branch Naminghttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Branch_Naming Making Changeshttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Making_Changes Making a Changelog Entryhttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Making_a_Changelog_Entry Choosing a Version Number, backportinghttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Choosing_a_Version_Number,_backporting Updating the Changeloghttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Updating_the_Changelog Create Repository and set up CI for package buildshttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Create_Repository_and_set_up_CI_for_package_builds Set up CI to track updates to Debianhttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Set_up_CI_to_track_updates_to_Debian Push your code!https://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Push_your_code! Setting Build Optionshttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Setting_Build_Options What the CI doeshttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#What_the_CI_does Updates from Debianhttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Updates_from_Debian Package Buildinghttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Package_Building Tagginghttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Tagging Further Readinghttps://wikitech.wikimedia.org/wiki/Debian_packaging_with_dgit_and_CI#Further_Reading https://wikitech.wikimedia.org/wiki/SRE/Observability/OKR == FY2024/2025 Q1 Hypothesis == FY2024/2025 Q1 Hypothesishttps://wikitech.wikimedia.org/wiki/SRE/Observability/OKR#FY2024/2025_Q1_Hypothesis Contexthttps://wikitech.wikimedia.org/wiki/SRE/Observability/OKR#Context https://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards == Intake Basics == Intake Basicshttps://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#Intake_Basics How We Organize Our Workhttps://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#How_We_Organize_Our_Work Phabricator workflowhttps://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#Phabricator_workflow How We Plan Our Roadmaphttps://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#How_We_Plan_Our_Roadmap Prioritizationhttps://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#Prioritization Project Work (Hypothesis)https://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#Project_Work_(Hypothesis) Maintenance (core work)https://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#Maintenance_(core_work) Work Cadence Summaryhttps://wikitech.wikimedia.org/wiki/SRE/Observability/Intake_Standards#Work_Cadence_Summary https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication This is an outline of Fundraising system authentication and two-factor authentication as of 10/2015. goalshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#goals design decisionshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#design_decisions authentication scheme overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#authentication_scheme_overview modified PAM password backendhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#modified_PAM_password_backend authentication-related configurationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#authentication-related_configuration all hostshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#all_hosts /etc/ssh/sshd_confighttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/ssh/sshd_config /etc/pam.d/sshdhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/pam.d/sshd /etc/pam.d/common-authhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/pam.d/common-auth /etc/pam.d/common-passwdhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/pam.d/common-passwd /usr/local/bin/yubikey_otp_filterhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/usr/local/bin/yubikey_otp_filter /etc/pam_radius_auth.confhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/pam_radius_auth.conf /etc/krb5.confhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/krb5.conf auth servershttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#auth_servers /etc/freeradius/usershttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/freeradius/users /etc/pam/radiusdhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/pam/radiusd /etc/yubikey_mappingshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#/etc/yubikey_mappings administrationhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#administration user experiencehttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#user_experience ssh directly to bastionhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#ssh_directly_to_bastion ssh to internal host, via tunnel through bastionhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-system-authentication#ssh_to_internal_host,_via_tunnel_through_bastion https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-18 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-18#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-18#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-18#Search_Update_Pipeline Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-18#Search_SLOs Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-18#Operations https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/08 ==Week of August 07== Week of August 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/08#Week_of_August_07 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/08#=== Week of August 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/08#Week_of_August_14 Week of August 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/08#Week_of_August_21 Week of August 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/08#Week_of_August_28 https://wikitech.wikimedia.org/wiki/Bast3007 bast3007 is the main bastion for the Esams cluster. It replaced bast3006 per [Services == Serviceshttps://wikitech.wikimedia.org/wiki/Bast3007#Services https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-25 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-25#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-25#What_we've_accomplished Search Update Platformhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-25#Search_Update_Platform Operations / SREhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-25#Operations_/_SRE Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-08-25#Misc https://wikitech.wikimedia.org/wiki/User-agent_client_hints Client Hints are information about your device and browser which is sent on request to websites you visit by browsers such as Google Chrome and Edge. The extension requests and collects this data by default to support the community in reducing vandalism and abuse. Configurationhttps://wikitech.wikimedia.org/wiki/User-agent_client_hints#Configuration Technical detailshttps://wikitech.wikimedia.org/wiki/User-agent_client_hints#Technical_details Resourceshttps://wikitech.wikimedia.org/wiki/User-agent_client_hints#Resources https://wikitech.wikimedia.org/wiki/Cadvisor As of Aug 2023 all production hosts run cadvisor; therefore it is possible to query any systemd unit resource usage (at the very least CPU and Memory usage). See also for more context on this work. https://wikitech.wikimedia.org/wiki/Network_telemetry Work in progress. Example dashboardhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Example_dashboard Infrastructurehttps://wikitech.wikimedia.org/wiki/Network_telemetry#Infrastructure Network devices (exporters)https://wikitech.wikimedia.org/wiki/Network_telemetry#Network_devices_(exporters) netflow VMs (collectors)https://wikitech.wikimedia.org/wiki/Network_telemetry#netflow_VMs_(collectors) Configurationhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Configuration Subscriptionshttps://wikitech.wikimedia.org/wiki/Network_telemetry#Subscriptions Processorshttps://wikitech.wikimedia.org/wiki/Network_telemetry#Processors Targetshttps://wikitech.wikimedia.org/wiki/Network_telemetry#Targets Outputshttps://wikitech.wikimedia.org/wiki/Network_telemetry#Outputs Prometheus Configurationhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Prometheus_Configuration Monitoring the monitoringhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Monitoring_the_monitoring Network devices gNMI endpoint monitoringhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Network_devices_gNMI_endpoint_monitoring gNMIc monitoringhttps://wikitech.wikimedia.org/wiki/Network_telemetry#gNMIc_monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/Network_telemetry#Troubleshooting Get the currently exposed TLS certhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Get_the_currently_exposed_TLS_cert Validate the currently exposed TLS certhttps://wikitech.wikimedia.org/wiki/Network_telemetry#Validate_the_currently_exposed_TLS_cert Get the currently exposed Prometheus metricshttps://wikitech.wikimedia.org/wiki/Network_telemetry#Get_the_currently_exposed_Prometheus_metrics Run gnmic manually (debug mode)https://wikitech.wikimedia.org/wiki/Network_telemetry#Run_gnmic_manually_(debug_mode) Show juniper's gRPC deamon's statushttps://wikitech.wikimedia.org/wiki/Network_telemetry#Show_juniper's_gRPC_deamon's_status Check Juniper "Analytics Agent" is running correctly on a target devicehttps://wikitech.wikimedia.org/wiki/Network_telemetry#Check_Juniper_"Analytics_Agent"_is_running_correctly_on_a_target_device Future improvementshttps://wikitech.wikimedia.org/wiki/Network_telemetry#Future_improvements Historyhttps://wikitech.wikimedia.org/wiki/Network_telemetry#History External linkshttps://wikitech.wikimedia.org/wiki/Network_telemetry#External_links https://wikitech.wikimedia.org/wiki/MCS_decommission == Reasoning == Reasoninghttps://wikitech.wikimedia.org/wiki/MCS_decommission#Reasoning Timelineshttps://wikitech.wikimedia.org/wiki/MCS_decommission#Timelines Alternativeshttps://wikitech.wikimedia.org/wiki/MCS_decommission#Alternatives https://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting == Dealing with problems == Dealing with problemshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Dealing_with_problems Broken SQL/XML dumps overviewhttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Broken_SQL/XML_dumps_overview Details for SQL/XML and other dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Details_for_SQL/XML_and_other_dumps Web server SQL/XML dumps index.html page was updated more than 12 hours earlier than current (UTC) timehttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Web_server_SQL/XML_dumps_index.html_page_was_updated_more_than_12_hours_earlier_than_current_(UTC)_time Email from the dumps exception checker or a systemd jobhttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Email_from_the_dumps_exception_checker_or_a_systemd_job Exceptions we seehttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Exceptions_we_see SQL/XML dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#SQL/XML_dumps "Other" dumpshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#"Other"_dumps Feteches of other datasetshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Feteches_of_other_datasets Space issueshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Space_issues A worker host (snapshot) dieshttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#A_worker_host_(snapshot)_dies Routine maintenancehttps://wikitech.wikimedia.org/wiki/Dumps/Troubleshooting#Routine_maintenance https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Switchover_Dates == Dates == Dateshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Switchover_Dates#Dates Codehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Switchover_Dates#Code https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers Site Reliability Engineering will, starting September 2023, run a data center Switchover every 6 months, in the week of the solar Equinox, namely the work weeks containing March 21st and September 21st. If you are interested in learning more about Switchovers and why we perform them or already know what they are and want to learn more about how this proposal would impact your workflows or the Wikimedia Movement, please read on. Introductionhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Introduction Purpose of this proposalhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Purpose_of_this_proposal Overviewhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Overview Benefitshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Benefits Drawbackshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Drawbacks Backgroundhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Background Past switchovershttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Past_switchovers Current challengeshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Current_challenges Detailshttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Details The datehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#The_date The weekhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#The_week The timehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#The_time The durationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#The_duration Single data center durationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Single_data_center_duration Total data center switchover durationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Total_data_center_switchover_duration Amendments to the planhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Amendments_to_the_plan Implementation planhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Implementation_plan Timeline for implementing the new processhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Timeline_for_implementing_the_new_process Roles and responsibilities of stakeholdershttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Roles_and_responsibilities_of_stakeholders Communication plan for introducing the new process to the movementhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Communication_plan_for_introducing_the_new_process_to_the_movement Evaluationhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Evaluation Metrics to evaluate the success of the new processhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Metrics_to_evaluate_the_success_of_the_new_process Conclusionhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Conclusion FAQhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#FAQ That week is “Daylight Confusion Time/Week”. Will that matter?https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#That_week_is_“Daylight_Confusion_Time/Week”._Will_that_matter? What's the deal with the Solar Equinox?https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#What's_the_deal_with_the_Solar_Equinox? Your dates for the Solar Equinox are wrong!https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Your_dates_for_the_Solar_Equinox_are_wrong! Appendixhttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Appendix Switchover diagram Graphviz codehttps://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Switchover_diagram_Graphviz_code Pre-calculated Switchover dates up to 2050https://wikitech.wikimedia.org/wiki/Switch_Datacenter/Recurring,_Equinox-based,_Data_Center_Switchovers#Pre-calculated_Switchover_dates_up_to_2050 https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown The GaleraDown alert fires when mysqld exporter can't connect to the MariaDB instance on a cloudcontrol node. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled The GaleraNotEnabled alert fires when the wsrep_ready status variable indicates that the MariaDB process on a host is not running in Galera mode. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNotEnabled#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch The GaleraClusterSizeMismatch alert fires when the Galera cluster does not have exactly three members. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterSizeMismatch#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync The GaleraClusterSizeMismatch alert fires when the Galera wsrep_cluster_state_uuid status variable has multiple visible values. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraClusterOutOfSync#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync The GaleraNodeOutOfSync alert fires when the Galera wsrep_cluster_state_uuid status variable does not match wsrep_local_state_uuid on a single node. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNodeOutOfSync#Old_incidents https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError DatasourceError alerts are generated by Grafana in response to the Grafana alerting engine experiencing some error fetching data to evaluate the alert state. See alsohttps://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError#See_also https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69 == 2023-08-15 == 2023-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-15 2023-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-14 2023-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-13 2023-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-12 2023-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-11 2023-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-10 2023-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-09 2023-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-08 2023-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-07 2023-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-05 2023-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-04 2023-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-03 2023-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-02 2023-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#2023-08-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_69#Other_archives https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70 == 2023-08-31 == 2023-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-31 2023-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-30 2023-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-29 2023-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-28 2023-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-27 2023-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-26 2023-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-25 2023-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-24 2023-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-23 2023-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-22 2023-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-21 2023-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-19 2023-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-18 2023-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-17 2023-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#2023-08-16 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_70#Other_archives https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-01 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-01#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-01#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-01#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-01#Search_Update_Pipeline Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-01#Misc https://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision =ZTP Provisioning= ZTP Provisioninghttps://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision#ZTP_Provisioning ZTP Provisioning Stepshttps://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision#ZTP_Provisioning_Steps Noteshttps://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision#Notes Remaining Configurationhttps://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision#Remaining_Configuration Monitoringhttps://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision#Monitoring Software Imagehttps://wikitech.wikimedia.org/wiki/ZTP_Network_Device_Provision#Software_Image https://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-08-30_hadoop-yarn#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05 = Toolforge workgroup meeting notes = Toolforge workgroup meeting noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Toolforge_workgroup_meeting_notes Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Attendees Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Notes Toolforge build service updates:https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Toolforge_build_service_updates: Toolforge overall design discussion: task T342077https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Toolforge_overall_design_discussion:_task_T342077 Toolforge as an open source PAAShttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Toolforge_as_an_open_source_PAAS Feedback about toolforge-deployhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Feedback_about_toolforge-deploy Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-09-05#Action_items https://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo This page summarizes the learnings of https://phabricator.wikimedia. [SPIKE] Should we enable compression on kafka jumbo?https://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo#[SPIKE]_Should_we_enable_compression_on_kafka_jumbo? Evaluationhttps://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo#Evaluation What are key metrics on topics that store large messages (total size, percentile message size, throughput, retention)?https://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo#What_are_key_metrics_on_topics_that_store_large_messages_(total_size,_percentile_message_size,_throughput,_retention)? Should we also enable compression on jumbo?https://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo#Should_we_also_enable_compression_on_jumbo? Should we rather let producers take care of it?https://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo#Should_we_rather_let_producers_take_care_of_it? Follow up workhttps://wikitech.wikimedia.org/wiki/Event_Platform/SPIKE/Should_we_enable_compression_on_kafka_jumbo#Follow_up_work https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08#Improve_multilingual_zero-results_rate Finalize Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08#Finalize_Search_SLOs Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-08#Misc https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/09 ==Week of September 04== Week of September 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/09#Week_of_September_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/09#=== Week of September 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/09#Week_of_September_11 Week of September 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/09#Week_of_September_18 Week of September 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/09#Week_of_September_25 https://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots There are times when we need to reboot our fleet. Here are some notes to help us go through it like Mediawiki Bare Metalhttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Mediawiki_Bare_Metal appservershttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#appservers Datastoreshttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Datastores Memcache clusterhttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Memcache_cluster Redis mischttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Redis_misc Etcdhttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Etcd Kuberneteshttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Kubernetes Productionhttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Production Workershttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Workers Control planehttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Control_plane Staginghttps://wikitech.wikimedia.org/wiki/SRE/Service_Operations/Documentation/Reboots#Staging https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor This page contains information about the Toolforge Harbor deployment. Deployment layouthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Deployment_layout Running componentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Running_components Logshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Logs Credentialshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Credentials Procedureshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Procedures Restart serviceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Restart_services Refresh containers (pull new images)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Refresh_containers_(pull_new_images) Quota managementhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Quota_management Changing the default project quotahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Changing_the_default_project_quota Changing individual project quotashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Changing_individual_project_quotas Linkshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Links Upgrade Harborhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Upgrade_Harbor Toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Toolsbeta Toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Tools Developmenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Development Local setuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#Local_setup See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor#See_also https://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Daily_duties These are daily duties for weekly rotation among team members, as well as individual responsibilities that don't rotate. Individualhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Daily_duties#Individual MediaWiki Platform Teamhttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Daily_duties#MediaWiki_Platform_Team Rotatinghttps://wikitech.wikimedia.org/wiki/MediaWiki_Engineering/Runbook/Daily_duties#Rotating https://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding = Stream Enrichment Processing with PyFlink = Stream Enrichment Processing with PyFlinkhttps://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#Stream_Enrichment_Processing_with_PyFlink Steps required to onboard a new application to Wikimedia internal infrastructurehttps://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#Steps_required_to_onboard_a_new_application_to_Wikimedia_internal_infrastructure Event schemahttps://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#Event_schema Stream configuration.https://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#Stream_configuration. Deployment to k8shttps://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#Deployment_to_k8s Make the stream publichttps://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#Make_the_stream_public General Workflow Overviewhttps://wikitech.wikimedia.org/wiki/Event_Platform/Onboarding#General_Workflow_Overview https://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator https://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/ === Service === Servicehttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Service Teamshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/Event_Platform/SLO/Flink_Kubernetes_Operator/#Reconciliation https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1 = Q1 Overview = Q1 Overviewhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Q1_Overview Q1 OKRshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Q1_OKRs Things we shiphttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Things_we_ship Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Improve_multilingual_zero-results_rate Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Search_SLOs Things we planhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Things_we_plan Split the WDQS Graphhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q1#Split_the_WDQS_Graph https://wikitech.wikimedia.org/wiki/MariaDB/Backups/Long_running You probably reached here because you received an alert saying that 1 or more sections were taking too long to backup. Long running backups for MediaWiki metadata or misc database hostshttps://wikitech.wikimedia.org/wiki/MariaDB/Backups/Long_running#Long_running_backups_for_MediaWiki_metadata_or_misc_database_hosts Long running backups for ES cluster (MediaWiki content) database hostshttps://wikitech.wikimedia.org/wiki/MariaDB/Backups/Long_running#Long_running_backups_for_ES_cluster_(MediaWiki_content)_database_hosts Running the check manuallyhttps://wikitech.wikimedia.org/wiki/MariaDB/Backups/Long_running#Running_the_check_manually See alsohttps://wikitech.wikimedia.org/wiki/MariaDB/Backups/Long_running#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#What_we've_accomplished Search Update Pipeline (SUP)https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#Search_Update_Pipeline_(SUP) Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#Improve_multilingual_zero-results_rate Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#Search_SLOs Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#Operations Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-15#Misc https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Cloud_instance == Synthetic tests on a cloud instance == Synthetic tests on a cloud instancehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Cloud_instance#Synthetic_tests_on_a_cloud_instance Installationhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Cloud_instance#Installation https://wikitech.wikimedia.org/wiki/Catalyst Project Catalyst is a team working on a kubernetes cluster as a service explicitly for CI and and exploratory testing. Our current effort is upgrading Patch Demo, to use kubernetes to provision and host wikis with custom [and skins]. The Need for Catalysthttps://wikitech.wikimedia.org/wiki/Catalyst#The_Need_for_Catalyst Roadmaphttps://wikitech.wikimedia.org/wiki/Catalyst#Roadmap Project Updateshttps://wikitech.wikimedia.org/wiki/Catalyst#Project_Updates Decision Loghttps://wikitech.wikimedia.org/wiki/Catalyst#Decision_Log Get Involvedhttps://wikitech.wikimedia.org/wiki/Catalyst#Get_Involved Documentationhttps://wikitech.wikimedia.org/wiki/Catalyst#Documentation https://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23) Following a request from Russian Wikimedia community members to help better understand the editor community in the country, the [Foundation] has released one year of data quantifying the number of Wikipedia editors editing from Russia. This is a break from standard practice at the Foundation — data releases typically shown on [exclude countries on the country protection list], which includes Russia — but we’ve taken extra privacy precautions (specifically, using [[:en:Differential_privacy|differential privacy) with this data release to protect editor safety and to quantify the risk of releasing this data. Data and initial findingshttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Data_and_initial_findings Datahttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Data Initial findingshttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Initial_findings Differential privacy data release processhttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Differential_privacy_data_release_process Privacy loss and riskhttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Privacy_loss_and_risk Privacy losshttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Privacy_loss Riskhttps://wikitech.wikimedia.org/wiki/Russian_editor_information_(2022-23)#Risk https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions With the upcoming IP Masking feature (see [Editing: Privacy Enhancement and Abuse Mitigation|IP Editing: Privacy Enhancement and Abuse Mitigation] and ), we need to look at what that means for Wikidata. A first investigation was done in [and this summarizes its findings. Resultshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Results Places where Wikibase distinguishes between anonymous and registered usershttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Places_where_Wikibase_distinguishes_between_anonymous_and_registered_users Wikibasehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Wikibase Wikibase Clienthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Wikibase_Client Broken remembering of preferences for temp usershttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Broken_remembering_of_preferences_for_temp_users Probably unaffected/maybe changes for the sake of clarifying the intention onlyhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Probably_unaffected/maybe_changes_for_the_sake_of_clarifying_the_intention_only WikibaseLexemehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#WikibaseLexeme EntitySchemahttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#EntitySchema WikibaseQualityConstraintshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#WikibaseQualityConstraints Behavior of temporary accounts with cross-wiki API actionshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Behavior_of_temporary_accounts_with_cross-wiki_API_actions Observations relevant for non-WMF installationshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Observations_relevant_for_non-WMF_installations Closing noteshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Reports/2023/2023-09-18_Ramifications_of_IP_masking_on_Wikidata_related_extensions#Closing_notes https://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship = Abstract = Abstracthttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Abstract Organisational sponsorhttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Organisational_sponsor Linkshttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Links Goalshttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Goals Scopehttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Scope Out of scopehttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Out_of_scope Who are the stewardshttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Who_are_the_stewards Responsibilities of the stewardshttps://wikitech.wikimedia.org/wiki/JVM_Language_Stewardship#Responsibilities_of_the_stewards https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_mw-page-content-change-enrich#Scorecard https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate_occasionally_fails_to_ingest_specific_schemas This page contains some notes and a post mortem of https://phabricator.wikimedia. Timelinehttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate_occasionally_fails_to_ingest_specific_schemas#Timeline Lessons learnthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate_occasionally_fails_to_ingest_specific_schemas#Lessons_learnt Impacthttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate_occasionally_fails_to_ingest_specific_schemas#Impact Follow uphttps://wikitech.wikimedia.org/wiki/Event_Platform/EventGate_occasionally_fails_to_ingest_specific_schemas#Follow_up https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup = Toolforge Workgroup = Toolforge Workgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup#Toolforge_Workgroup Abouthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup#About Current members (Q1 2024-2025)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup#Current_members_(Q1_2024-2025) Backgroundhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup#Background https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#What_went_poorly? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-20_Elasticsearch_unavailable#Scorecard https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22#Improve_multilingual_zero-results_rate Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22#Operations Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-22#Misc https://wikitech.wikimedia.org/wiki/Fundraising/Service_providers/Fundraise_up = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Service_providers/Fundraise_up#Overview https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview = Toolforge Workgroup = Toolforge Workgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview#Toolforge_Workgroup Project Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview#Project_Overview Project organizationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview#Project_organization Milestoneshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview#Milestones How to read user storieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview#How_to_read_user_stories Future milestoneshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Overview#Future_milestones https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-fr_tech_managed_accounts There are certain accounts and systems that FR Tech manages. For each type there are variations on what the requirements are for access, how authentication (AuthN) and authorization (AuthZ) are handled, and what the user base is. User Verification Requirementshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-fr_tech_managed_accounts#User_Verification_Requirements User Access Controlshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-fr_tech_managed_accounts#User_Access_Controls FR Tech Administered Services with Accountshttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-fr_tech_managed_accounts#FR_Tech_Administered_Services_with_Accounts Ancillary FR Tech managed user items outside of accounthttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-fr_tech_managed_accounts#Ancillary_FR_Tech_managed_user_items_outside_of_account https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-access_roles Access to fundraising systems is controlled by different roles in different systems. This is a cheat sheet as to what these roles allow access to. Civicrmhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-access_roles#Civicrm Supersethttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-access_roles#Superset Grafanahttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-access_roles#Grafana Shell access (SSH)https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-access_roles#Shell_access_(SSH) MariaDB/Mysqlhttps://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/users-access_roles#MariaDB/Mysql https://wikitech.wikimedia.org/wiki/VRT_System/SSL To create SSL keys you can easily follow the steps here (https://wikitech.wikimedia. https://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Summary Current status: resolvedhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Current_status:_resolved Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-27_Kafka-jumbo_mirror-makers#Scorecard https://wikitech.wikimedia.org/wiki/WCQS Soft redirected pageshttps://wikitech.wikimedia.org/wiki/Category:Soft_redirected_pages https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-29 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-29#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-29#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-29#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-29#Improve_multilingual_zero-results_rate Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-09-29#Operations https://wikitech.wikimedia.org/wiki/Incidents/2023-09-29_CloudVPS_vms_losing_network_connectivity == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-29_CloudVPS_vms_losing_network_connectivity#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-29_CloudVPS_vms_losing_network_connectivity#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-29_CloudVPS_vms_losing_network_connectivity#Detection Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-29_CloudVPS_vms_losing_network_connectivity#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-29_CloudVPS_vms_losing_network_connectivity#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71 == 2023-09-30 == 2023-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-30 2023-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-29 2023-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-28 2023-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-27 2023-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-26 2023-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-25 2023-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-24 2023-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-23 2023-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-22 2023-09-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-21 2023-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-20 2023-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-19 2023-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-18 2023-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-16 2023-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-15 2023-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-14 2023-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-13 2023-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-12 2023-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-11 2023-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-10 2023-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-09 2023-09-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-08 2023-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-07 2023-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-06 2023-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-05 2023-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-04 2023-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-02 2023-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#2023-09-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_71#Other_archives https://wikitech.wikimedia.org/wiki/Deployment_prep This is a collation of the best practices steps you should take to prepare your new API or Service for deployment by the SRE team. https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Geolocation We do this a couple of different ways maybe? Maxmind geolocation is set to be put under service providers https://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-09-28_mw-page-content-change-enrich#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide This page provides an overview of how technical documentation for WMCS products and services is structured, and things maintainers should know to help with the work of improving the docs. Structure of WMCS doc collections on Wikitechhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Structure_of_WMCS_doc_collections_on_Wikitech Toolforge documentationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Toolforge_documentation Cloud VPS documentationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Cloud_VPS_documentation Portal pageshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Portal_pages Landing pages and collection navigationhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Landing_pages_and_collection_navigation Content pageshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Content_pages Overviewshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Overviews How-to guideshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#How-to_guides Tutorialshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Tutorials Documentation task trackinghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Documentation_guide#Documentation_task_tracking https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03 == Agenda: == Agenda:https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Agenda: Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Notes Different topics for account creationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Different_topics_for_account_creation Deploy right after merginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Deploy_right_after_merging Toolforge re-design decision requesthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Toolforge_re-design_decision_request Toolforge build service open betahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Toolforge_build_service_open_beta Toolforge lima-kilo statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Toolforge_lima-kilo_status Pre-built Pywikibot imagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Pre-built_Pywikibot_image Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-10-03#Action_items https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06#Improve_multilingual_zero-results_rate WDQS Graph Splithttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06#WDQS_Graph_Split Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-06#Misc https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts __TOC__ Kafka Consumer lag - ORESFetchScoreJobKafkaLag alerthttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#Kafka_Consumer_lag_-_ORESFetchScoreJobKafkaLag_alert Inference Services High Memory Usage - InfServiceHighMemoryUsage alerthttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#Inference_Services_High_Memory_Usage_-_InfServiceHighMemoryUsage_alert LiftWingServiceErrorRatehttps://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10 ==Week of October 02== Week of October 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10#Week_of_October_02 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10#=== Week of October 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10#Week_of_October_09 Week of October 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10#Week_of_October_16 Week of October 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10#Week_of_October_23 Week of October 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/10#Week_of_October_30 https://wikitech.wikimedia.org/wiki/Firewall Wikimedia production servers use local firewall rules which get configured via Puppet. They are managed via the profile::firewall Puppet class. Basic nftables usage instructionshttps://wikitech.wikimedia.org/wiki/Firewall#Basic_nftables_usage_instructions Puppet configuration of firewall ruleshttps://wikitech.wikimedia.org/wiki/Firewall#Puppet_configuration_of_firewall_rules Migrating a ferm::service define to a firewall::servicehttps://wikitech.wikimedia.org/wiki/Firewall#Migrating_a_ferm::service_define_to_a_firewall::service Selecting the firewall providerhttps://wikitech.wikimedia.org/wiki/Firewall#Selecting_the_firewall_provider Basic usage of nftableshttps://wikitech.wikimedia.org/wiki/Firewall#Basic_usage_of_nftables Throttling with nftableshttps://wikitech.wikimedia.org/wiki/Firewall#Throttling_with_nftables Detailed manual commands with explanationhttps://wikitech.wikimedia.org/wiki/Firewall#Detailed_manual_commands_with_explanation https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports = Toolforge Workgroup = Toolforge Workgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#Toolforge_Workgroup Reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#Reports Decision recordshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#Decision_records Ongoinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#Ongoing Decidedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#Decided Progress reportshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#Progress_reports 2024https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#2024 2023https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#2023 2022https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Workgroup/Reports#2022 https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies == referer_daily == referer_dailyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies#referer_daily DPE dependencieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies#DPE_dependencies Superset Datasets Dependencieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies#Superset_Datasets_Dependencies Other teams Dependencieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies#Other_teams_Dependencies unique_devices (4 tables)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies#unique_devices_(4_tables) aqs_hourlyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Iceberg/Migration_Dependencies#aqs_hourly https://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial This is a guide to git-based Debian packaging for WMF; it's about taking an upstream software package which is not currently in Debian and arranging for WMF CI to build Debian binary packages suitable for deployment at WMF. If the package is already available in Debian (or Ubuntu), fetch the Debianised source with dgit clone and follow Debian_packaging_with_dgit_and_CI. Executive Summary / TL;DRhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Executive_Summary_/_TL;DR Minimum requirementshttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Minimum_requirements Getting The Sourcehttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Getting_The_Source Initial Debianisation with dh_makehttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Initial_Debianisation_with_dh_make Debian Source Format - debian/source/formathttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Debian_Source_Format_-_debian/source/format The Control File - debian/controlhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#The_Control_File_-_debian/control Copyright information - debian/copyrighthttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Copyright_information_-_debian/copyright Debian changelog - debian/changeloghttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Debian_changelog_-_debian/changelog Rules for package building - debian/ruleshttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Rules_for_package_building_-_debian/rules Tidying uphttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Tidying_up Source changeshttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Source_changes Buildinghttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Building Building with CIhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Building_with_CI Building Locallyhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Building_Locally Inspecting the Resulthttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Inspecting_the_Result New Upstream Versionhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#New_Upstream_Version Further Readinghttps://wikitech.wikimedia.org/wiki/Debian_packaging/Tutorial#Further_Reading https://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/SLO/Wiki_Replicas#Reconciliation https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps Ceph slow ops will usually block some writes to the Ceph cluster which makes VMs unhappy. Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps#Common_issues Disk issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps#Disk_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps#Old_incidents https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2 = Q2 Overview = Q2 Overviewhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#Q2_Overview Q2 OKRshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#Q2_OKRs Things we shiphttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#Things_we_ship Search Update Pipeline (SUP)https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#Search_Update_Pipeline_(SUP) Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#Improve_multilingual_zero-results_rate Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#Search_SLOs WDQS Split the Graphhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q2#WDQS_Split_the_Graph https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Changelog In this page you will find a list of smaller user-facing updates to toolforge services, new small features and similar news. 2024https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Changelog#2024 2023https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Changelog#2023 https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture Origin task: phab:T346153 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Constraints_and_risks With keeping the current architecturehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#With_keeping_the_current_architecture With moving to a different architecturehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#With_moving_to_a_different_architecture Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Options_considered Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T346153_Toolforge_(re)architecture#Option_3 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13#WDQS_graph_splitting Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13#Improve_multilingual_zero-results_rate Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-13#Operations https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert The Wikidata Change Dispatching mechanism has several alerts associated with it. This runbook describes what to do when one of those alerts fires. Overviewhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#Overview General advice for alertshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#General_advice_for_alerts Number of rows in wb_changes tablehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#Number_of_rows_in_wb_changes_table Possible causes for spikes in this table in the pasthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#Possible_causes_for_spikes_in_this_table_in_the_past Delay injecting Recent Changes, aggregated across client wikishttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#Delay_injecting_Recent_Changes,_aggregated_across_client_wikis No Data Alerthttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#No_Data_Alert genuine "Time exceeds threshold" Alertshttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#genuine_"Time_exceeds_threshold"_Alerts the immediate root cause has already ceasedhttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#the_immediate_root_cause_has_already_ceased the immediate root cause seems to still be activehttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#the_immediate_root_cause_seems_to_still_be_active DispatchChanges normal job backlog time (p50, 15min)https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#DispatchChanges_normal_job_backlog_time_(p50,_15min) NoDatahttps://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks/Change_dispatching/Alert#NoData https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes = Toolforge Kubernetes 1.23 upgrade = Toolforge Kubernetes 1.23 upgradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#Toolforge_Kubernetes_1.23_upgrade prephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#prep control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#control_nodes tools-k8s-control-4https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#tools-k8s-control-4 tools-k8s-control-5https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#tools-k8s-control-5 tools-k8s-control-6https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#tools-k8s-control-6 worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#worker_nodes ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#ingress_nodes cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.22_to_1.23_notes#cleanup https://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits When you specify a Pod you should specify how much of each resource each container needs. The resource requests are used by the kube-scheduler to decide which node to place the Pod on. How Memory requests and limits are appliedhttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#How_Memory_requests_and_limits_are_applied How CPU requests and limits are appliedhttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#How_CPU_requests_and_limits_are_applied Setting requestshttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#Setting_requests Setting limitshttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#Setting_limits Best practicehttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#Best_practice MediaWiki php-fpmhttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#MediaWiki_php-fpm envoyhttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#envoy NodeJS service-runnerhttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#NodeJS_service-runner Knative Servinghttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#Knative_Serving External resourceshttps://wikitech.wikimedia.org/wiki/Kubernetes/Resource_requests_and_limits#External_resources https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-20 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-20#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-20#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-20#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-20#WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-10-20#Operations https://wikitech.wikimedia.org/wiki/Metrics_Platform/Decision_Records/Deprioritize_Custom_Data Status: Accepted https://wikitech.wikimedia.org/wiki/Metrics_Platform/Decision_Records https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/Runbooks Automatic index of runbooks (not all of them are necessarily ready for use yet!): https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState This happens when the primary ToolsDB instance is down, or is up but in read-only mode. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Debugging General cluster overviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#General_cluster_overview Checking the systemd unit statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Checking_the_systemd_unit_status Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Common_issues MariaDB process killed by OOM killerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#MariaDB_process_killed_by_OOM_killer Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsToolsDBWritableState#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull The ToolsNfsAlmostFull alert fires when the Toolforge NFS server is almost out of disk space. This happens surprisingly often as [NFS share has no quotas]. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Debugging Try what was done last timehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Try_what_was_done_last_time Locate disk hogshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Locate_disk_hogs Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull#Old_incidents https://wikitech.wikimedia.org/wiki/Cassandra/Clusters __TOC__ RESTBasehttps://wikitech.wikimedia.org/wiki/Cassandra/Clusters#RESTBase Generated Data Platform (neé AQS)https://wikitech.wikimedia.org/wiki/Cassandra/Clusters#Generated_Data_Platform_(neé_AQS) Sessionstorehttps://wikitech.wikimedia.org/wiki/Cassandra/Clusters#Sessionstore https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar/2024 See also the calendar for 2023. https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019 == 2019-01 == 2019-01https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-01 Scope of Workhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Scope_of_Work Alerts and Incidentshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Alerts_and_Incidents Definition of Donehttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Definition_of_Done How to workhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#How_to_work Timinghttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Timing Decision-makinghttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Decision-making Stakeholdershttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Stakeholders 2019-03-13https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-03-13 What is our output scope?https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#What_is_our_output_scope? Problem Statementhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Problem_Statement Notes on the workhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Notes_on_the_work possible next steps and constraintshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#possible_next_steps_and_constraints Conceptual model of the project workhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Conceptual_model_of_the_project_work How we should work on this projecthttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#How_we_should_work_on_this_project Possible next actionshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Possible_next_actions Next Stepshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Next_Steps 2019-03-22https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-03-22 Scalability Issueshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Scalability_Issues more proposed improvementshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#more_proposed_improvements Possible working group outputshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Possible_working_group_outputs Possible work unitshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Possible_work_units 2019-03-27https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-03-27 Agendahttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Agenda Incident History Reviewhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Incident_History_Review Next Actionhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Next_Action Definitions of alert/page/incidenthttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Definitions_of_alert/page/incident Next actionhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Next_action deploy a DNS change without Gerrithttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#deploy_a_DNS_change_without_Gerrit Icinga Dasboard researchhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Icinga_Dasboard_research Overall Next Stepshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Overall_Next_Steps 2019-04-04https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-04-04 Proposal for better incident report SOPhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Proposal_for_better_incident_report_SOP Continuity Runbookshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Continuity_Runbooks 2019-04-10https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-04-10 Actionableshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Actionables Topicshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Topics Icinga Dasboardhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Icinga_Dasboard 2019-04-17https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-04-17 gridhttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#grid proposal dochttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#proposal_doc specific itemshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#specific_items 2019-04-24https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-04-24 Review the Proposal 0th drafthttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Review_the_Proposal_0th_draft Next stepshttps://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#Next_steps 2019-05-08https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-05-08 2019-05-22https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-05-22 2019-05-29https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings/2019#2019-05-29 https://wikitech.wikimedia.org/wiki/Incident_response/Process_improvement/Meetings /}} https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72 == 2023-10-31 == 2023-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-31 2023-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-30 2023-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-28 2023-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-27 2023-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-26 2023-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-25 2023-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-24 2023-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-23 2023-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-21 2023-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-20 2023-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-19 2023-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-18 2023-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-17 2023-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-16 2023-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-15 2023-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-14 2023-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-13 2023-10-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-12 2023-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-11 2023-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-10 2023-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-09 2023-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-08 2023-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-07 2023-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-06 2023-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-05 2023-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-04 2023-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-03 2023-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-02 2023-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#2023-10-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_72#Other_archives https://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host Derived from MariaDB/Provisioning a host Good to know before startinghttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Good_to_know_before_starting Host preparationhttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Host_preparation Downtime the hostshttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Downtime_the_hosts Move the host in the right groups with the right rolehttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Move_the_host_in_the_right_groups_with_the_right_role Add the host to dbctl config (example)https://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Add_the_host_to_dbctl_config_(example) Fetch informations on the host and its clusterhttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Fetch_informations_on_the_host_and_its_cluster On Zarcillohttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#On_Zarcillo On Netboxhttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#On_Netbox On the MySQL clusterhttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#On_the_MySQL_cluster Cloninghttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Cloning After cloninghttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#After_cloning Add it to zarcillo DBhttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#Add_it_to_zarcillo_DB After a few days of uptimehttps://wikitech.wikimedia.org/wiki/MariaDB/Clone_a_host#After_a_few_days_of_uptime https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03#WDQS_graph_splitting Search SLOhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03#Search_SLO Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-03#Misc https://wikitech.wikimedia.org/wiki/Puppet/Cleanups Our Puppet tree is continuously evolving. As such, it's normal that some enhancement doesn't immediately trickle into the wider Puppet tree. Redundant file ownerships for roothttps://wikitech.wikimedia.org/wiki/Puppet/Cleanups#Redundant_file_ownerships_for_root Installation of packages using ensure_packageshttps://wikitech.wikimedia.org/wiki/Puppet/Cleanups#Installation_of_packages_using_ensure_packages https://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2024_Call_for_Participation FOSDEM 2024 Call for Participation: Web Performance Web Performance devroomhttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2024_Call_for_Participation#Web_Performance_devroom Submission processhttps://wikitech.wikimedia.org/wiki/Performance/FOSDEM_2024_Call_for_Participation#Submission_process https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#Operations Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-10#Misc https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/11 ==Week of November 06== Week of November 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/11#Week_of_November_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/11#=== Week of November 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/11#Week_of_November_13 Week of November 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/11#Week_of_November_20 Week of November 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/11#Week_of_November_27 https://wikitech.wikimedia.org/wiki/Draft:AQS The Analytics Query Service, or AQS, is a mapping of REST-style endpoints to data stores. The system is used to deliver data to consumers like Toolforge tools, custom dashboards like Wikistats, [Pages], and more. Creating a new Endpointhttps://wikitech.wikimedia.org/wiki/Draft:AQS#Creating_a_new_Endpoint Step 1: Make a repositoryhttps://wikitech.wikimedia.org/wiki/Draft:AQS#Step_1:_Make_a_repository Step 2: Unit Test and Implementhttps://wikitech.wikimedia.org/wiki/Draft:AQS#Step_2:_Unit_Test_and_Implement Step 3: Integration Testshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Step_3:_Integration_Tests Step 4: Documenthttps://wikitech.wikimedia.org/wiki/Draft:AQS#Step_4:_Document Step 5: Deployhttps://wikitech.wikimedia.org/wiki/Draft:AQS#Step_5:_Deploy Existing Endpointshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Existing_Endpoints Device Analyticshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Device_Analytics Geo Analyticshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Geo_Analytics Media Analyticshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Media_Analytics Page Analyticshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Page_Analytics Edit Analyticshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Edit_Analytics Editor Analyticshttps://wikitech.wikimedia.org/wiki/Draft:AQS#Editor_Analytics https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Intake_Standards =Intake Standards= Intake Standardshttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Intake_Standards#Intake_Standards https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-civicrm_staging_db_refresh Every quarter or so, we will want to refresh the staging databases. To do so we use the following steps: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image This page documents the custom Pywikibot build service image. Updating the imagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image#Updating_the_image Doing a testhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image#Doing_a_test See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17#Search_Update_Pipeline Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-11-17#Misc https://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11 Change-Propagation was originally developed by the MediaWiki Services team starting in 2015. In the past 2 or 3 years, the team has been disbanded and none of the original developers or maintainers work at the Wikimedia Foundation. Overviewhttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#Overview Featureshttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#Features Deployments at WMFhttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#Deployments_at_WMF changeprophttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#changeprop changeprop handles (as of 2023-11)https://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#changeprop_handles_(as_of_2023-11) changeprop-jobqueuehttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#changeprop-jobqueue changeprop-jobqueue handles (as of 2023-11)https://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#changeprop-jobqueue_handles_(as_of_2023-11) Otto’s Noteshttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#Otto’s_Notes Otto's Raw Noteshttps://wikitech.wikimedia.org/wiki/Changeprop/Memorandum_2023-11#Otto's_Raw_Notes https://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries This page documents how to deploy a new version of a Metrics Platform client library. Javahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#Java Versioninghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#Versioning JavaScripthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#JavaScript Update the EventLogging/modules/lib/foreign-resources.yaml filehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#Update_the_EventLogging/modules/lib/foreign-resources.yaml_file Fetch and verify the client libraryhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#Fetch_and_verify_the_client_library Submitting a patch for reviewhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#Submitting_a_patch_for_review PHPhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#PHP Swifthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Deploy_client_libraries#Swift https://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas In the Metrics Platform, schemas are used to validate event data. This page documents how to create a custom schema to use with the Metrics Platform. When to create a custom schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#When_to_create_a_custom_schema Custom schemas for specific product areashttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Custom_schemas_for_specific_product_areas Ownershiphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Ownership Components of a custom schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Components_of_a_custom_schema Common fragmenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Common_fragment Platform fragmentshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Platform_fragments Creating a custom schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Creating_a_custom_schema 1. Design a new fragmenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#1._Design_a_new_fragment 2. Create a schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#2._Create_a_schema 3. Configure an event streamhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#3._Configure_an_event_stream 4. Write instrument codehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#4._Write_instrument_code Top-level propertieshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Top-level_properties Formatting requirementshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Formatting_requirements Namespacinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#Namespacing Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_schemas#References https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contribute This page documents the process for contributing to Metrics Platform tools. The Metrics Platform libraries are open-source and hosted on GitLab at [Metrics Platform is owned by the Data Products team]. Volunteer contributions welcome!https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contribute#Volunteer_contributions_welcome! Making good merge requestshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contribute#Making_good_merge_requests Open bugs and feature requestshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contribute#Open_bugs_and_feature_requests https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/Migration_Notes == External traffic ramp-up == External traffic ramp-uphttps://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes/Migration_Notes#External_traffic_ramp-up https://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events During active development, it is important to be able to test that events can be validated by EventGate against a specified JSONSchema. Each of the client libraries contain unit and integration tests for ensuring that events are properly formatted and serialized for submission. Javascripthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Javascript PHPhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#PHP Javahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Java Validate using local EventGatehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Validate_using_local_EventGate Troubleshootinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Troubleshooting Validate using EventStreams Beta APIhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Validate_using_EventStreams_Beta_API Install a local MP Java library versionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Install_a_local_MP_Java_library_version Rebuild the client code app with the local MP versionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Rebuild_the_client_code_app_with_the_local_MP_version Set up the Android emulator or hardware device for debugginghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Set_up_the_Android_emulator_or_hardware_device_for_debugging Trigger eventshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Trigger_events Observe eventshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Validate_events#Observe_events https://wikitech.wikimedia.org/wiki/Analytics/Archive This is a list of all of the pages that have been archived below Analytics. https://wikitech.wikimedia.org/wiki/SLO/Search Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/Search#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/Search#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/Search#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/Search#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Search#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Search#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/Search#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/Search#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/Search#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/Search#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/Search#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/Search#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/Search#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/Search#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/Search#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/Search#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Search#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/SLO/Search#Reconciliation https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73 == 2023-11-30 == 2023-11-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-30 2023-11-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-29 2023-11-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-28 2023-11-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-27 2023-11-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-24 2023-11-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-23 2023-11-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-22 2023-11-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-21 2023-11-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-20 2023-11-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-19 2023-11-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-18 2023-11-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-17 2023-11-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-16 2023-11-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-15 2023-11-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-14 2023-11-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-13 2023-11-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-12 2023-11-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-11 2023-11-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-10 2023-11-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-09 2023-11-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-08 2023-11-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-07 2023-11-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-06 2023-11-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-03 2023-11-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-02 2023-11-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#2023-11-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_73#Other_archives https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#Search_Update_Pipeline Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#Search_SLOs Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#Misc Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-01#Operations https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites The GaleraNoRecentWrites alert fires when the Galera wsrep_last_committed status variable has not increased in the last hour. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Common_issues Single node behind others, all nodes stuckhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Single_node_behind_others,_all_nodes_stuck Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/GaleraNoRecentWrites#Old_incidents https://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2023-11-15_esams_unreachable#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity The ToolforgeKubernetesCapacity alert fires when the Toolforge Kubernetes cluster is close to running out of a certain resource (CPU or memory). In general, this is caused either by: Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Debugging Dashboardhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Dashboard Locating new workloadshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Locating_new_workloads Fixinghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Fixing Provisioning new nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Provisioning_new_nodes Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesCapacity#Old_incidents https://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/Matching_gifts = Overview = Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Internal_Endpoints/Matching_gifts#Overview https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering __NOTOC__ About the Data Platform Engineering docshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering#About_the_Data_Platform_Engineering_docs Content structurehttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering#Content_structure Page categorieshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering#Page_categories FAQs and guidelines for maintaining these docshttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering#FAQs_and_guidelines_for_maintaining_these_docs https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08#WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-08#Misc https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation/unreached_tools_list ==== List of tools ==== List of toolshttps://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation/unreached_tools_list#List_of_tools https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/12 ==Week of December 04== Week of December 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/12#Week_of_December_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/12#=== Week of December 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/12#Week_of_December_11 Week of December 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/12#Week_of_December_18 Week of December 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2023/12#Week_of_December_25 https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Summary Descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Description Estimate of losshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Estimate_of_loss Fixhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Fix Recommendationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Recommendations Root Causehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Root_Cause Affected Datasetshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#Affected_Datasets List of possibly affected streams as of 2023-12https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2023-11_eventgate-analytics-external_Data_Loss#List_of_possibly_affected_streams_as_of_2023-12 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesNodeNotReady The ToolforgeKubernetesCapacity alert fires when a Toolforge Kubernetes node is marked as not ready. A paging alert also fires when at least 5 nodes are marked as not ready. Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesNodeNotReady#Debugging Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesNodeNotReady#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesNodeNotReady#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesNodeNotReady#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/MetricsinfraAlertmanagerDown The MetricsinfraAlertmanagerDown alert fires when the production Prometheus AlertManager dashboard can't communicate with the alerting setup in the metricsinfra project. This is either an issue with the metricsinfrar setup, or a sign of a more general network outage in Cloud VPS. Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/MetricsinfraAlertmanagerDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/MetricsinfraAlertmanagerDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/MetricsinfraAlertmanagerDown#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/MetricsinfraAlertmanagerDown#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/MetricsinfraAlertmanagerDown#Old_incidents https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Provision_cookbook_troubleshooting https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Re-image_cookbook_troubleshooting https://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script The Netbox ProvisionServerNetwork script is used by DC-Ops to add required elements to Netbox to represent a servers network connection and setup. Versions of Scripthttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#Versions_of_Script Host Profileshttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#Host_Profiles Examplehttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#Example Attributeshttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#Attributes VLAN Templateshttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#VLAN_Templates VLAN Domainshttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#VLAN_Domains CSV Formathttps://wikitech.wikimedia.org/wiki/Netbox/ProvisionServerNetwork_Script#CSV_Format https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#Operations Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-15#Misc https://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist == Scenario 1: New market or new payment option in a market == Scenario 1: New market or new payment option in a markethttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Scenario_1:_New_market_or_new_payment_option_in_a_market Internal testhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Internal_test Prep for 1 hour technical functionality testhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Prep_for_1_hour_technical_functionality_test Prep for Campaign readyhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Prep_for_Campaign_ready Scenario 2: Switch of PSPhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Scenario_2:_Switch_of_PSP Prep for campaign readyhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Prep_for_campaign_ready Scenario 3:  Repeat Campaignhttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Scenario_3:_Repeat_Campaign Yearly Major Campaigns and Code Restrictionshttps://wikitech.wikimedia.org/wiki/Fundraising/Team_processes/Campaign_Readiness_Checklist#Yearly_Major_Campaigns_and_Code_Restrictions https://wikitech.wikimedia.org/wiki/Developer_account https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07 == Agenda == Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07#Notes Abandoned tool policyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07#Abandoned_tool_policy Timeline for turning off the gridhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07#Timeline_for_turning_off_the_grid Default quotashttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07#Default_quotas Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-11-07#Action_items https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19 == Attendees == Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Attendees Previous meeting action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Previous_meeting_action_items Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Notes Go through the tool adoption backloghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Go_through_the_tool_adoption_backlog Have a non-bouncing email for every tool be a requirement for running on WMCS platformshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Have_a_non-bouncing_email_for_every_tool_be_a_requirement_for_running_on_WMCS_platforms Grid Engine updatehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Grid_Engine_update Recruit more people to the Standards Committeehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Recruit_more_people_to_the_Standards_Committee Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2023-12-19#Action_items https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History The Spark History server retains historical Spark job data, thus allowing us to perform performance analysis and investigation after the jobs are finished. Service Detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Service_Details Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Deployment spark-history-analytics-test-hadoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#spark-history-analytics-test-hadoop spark-history-analytics-hadoophttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#spark-history-analytics-hadoop Accessing the spark-history-hadoop-test-analytics web UIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Accessing_the_spark-history-hadoop-test-analytics_web_UI Configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Configuration Changing the log levelhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Changing_the_log_level Alertinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Alerting The app isn't runninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#The_app_isn't_running Mischttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Misc JDK versionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#JDK_version Rebuilding the spark-history server docker imageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Cluster/Spark_History#Rebuilding_the_spark-history_server_docker_images https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-22 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-22#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-22#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-22#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-12-22#WDQS_graph_splitting https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74 == 2023-12-30 == 2023-12-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-30 2023-12-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-29 2023-12-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-28 2023-12-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-27 2023-12-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-23 2023-12-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-22 2023-12-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-21 2023-12-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-20 2023-12-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-19 2023-12-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-18 2023-12-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-17 2023-12-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-16 2023-12-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-15 2023-12-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-14 2023-12-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-13 2023-12-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-12 2023-12-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-11 2023-12-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-09 2023-12-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-08 2023-12-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-07 2023-12-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-06 2023-12-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-05 2023-12-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-04 2023-12-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-02 2023-12-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#2023-12-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_74#Other_archives https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9 == 2023-12-23 == 2023-12-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-23 2023-12-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-22 2023-12-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-21 2023-12-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-20 2023-12-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-17 2023-12-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-15 2023-12-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-14 2023-12-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-13 2023-12-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-11 2023-12-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-07 2023-12-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-12-05 2023-11-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-30 2023-11-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-29 2023-11-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-27 2023-11-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-22 2023-11-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-21 2023-11-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-20 2023-11-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-19 2023-11-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-17 2023-11-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-16 2023-11-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-15 2023-11-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-13 2023-11-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-09 2023-11-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-08 2023-11-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-07 2023-11-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-06 2023-11-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-11-01 2023-10-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-30 2023-10-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-27 2023-10-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-26 2023-10-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-25 2023-10-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-24 2023-10-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-23 2023-10-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-20 2023-10-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-18 2023-10-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-17 2023-10-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-16 2023-10-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-14 2023-10-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-13 2023-10-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-12 2023-10-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-11 2023-10-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-09 2023-10-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-06 2023-10-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-05 2023-10-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-04 2023-10-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-03 2023-10-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-10-02 2023-09-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-29 2023-09-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-28 2023-09-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-26 2023-09-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-25 2023-09-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-22 2023-09-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-21 2023-09-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-20 2023-09-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-15 2023-09-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-13 2023-09-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-12 2023-09-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-11 2023-09-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-08 2023-09-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-07 2023-09-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-06 2023-09-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-05 2023-09-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-04 2023-09-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-09-01 2023-08-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-31 2023-08-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-30 2023-08-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-29 2023-08-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-25 2023-08-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-24 2023-08-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-23 2023-08-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-21 2023-08-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-16 2023-08-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-15 2023-08-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-12 2023-08-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-11 2023-08-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-08 2023-08-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-08-07 2023-07-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-31 2023-07-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-28 2023-07-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-27 2023-07-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-26 2023-07-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-25 2023-07-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-24 2023-07-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-20 2023-07-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-19 2023-07-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-18 2023-07-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-17 2023-07-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-14 2023-07-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-13 2023-07-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-12 2023-07-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-11 2023-07-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-10 2023-07-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-08 2023-07-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-07 2023-07-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-06 2023-07-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-05 2023-07-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-04 2023-07-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-03 2023-07-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-07-01 2023-06-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-30 2023-06-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-29 2023-06-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-28 2023-06-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-27 2023-06-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-26 2023-06-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-23 2023-06-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-22 2023-06-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-21 2023-06-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-20 2023-06-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-18 2023-06-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-16 2023-06-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-15 2023-06-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-14 2023-06-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-13 2023-06-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-09 2023-06-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-08 2023-06-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-07 2023-06-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-06 2023-06-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-05 2023-06-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-02 2023-06-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-06-01 2023-05-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-26 2023-05-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-25 2023-05-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-24 2023-05-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-23 2023-05-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-21 2023-05-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-17 2023-05-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-16 2023-05-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-12 2023-05-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-11 2023-05-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-10 2023-05-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-09 2023-05-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-05 2023-05-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-04 2023-05-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-03 2023-05-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-02 2023-05-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-05-01 2023-04-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-28 2023-04-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-27 2023-04-26https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-26 2023-04-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-25 2023-04-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-24 2023-04-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-23 2023-04-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-22 2023-04-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-21 2023-04-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-20 2023-04-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-19 2023-04-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-18 2023-04-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-17 2023-04-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-12 2023-04-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-10 2023-04-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-09 2023-04-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-06 2023-04-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-05 2023-04-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-04 2023-04-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-04-03 2023-03-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-31 2023-03-29https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-29 2023-03-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-23 2023-03-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-22 2023-03-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-20 2023-03-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-19 2023-03-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-17 2023-03-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-16 2023-03-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-15 2023-03-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-14 2023-03-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-13 2023-03-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-12 2023-03-11https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-11 2023-03-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-10 2023-03-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-09 2023-03-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-08 2023-03-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-07 2023-03-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-06 2023-03-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-05 2023-03-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-03 2023-03-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-02 2023-03-01https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-03-01 2023-02-28https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-28 2023-02-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-27 2023-02-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-25 2023-02-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-24 2023-02-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-23 2023-02-22https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-22 2023-02-21https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-21 2023-02-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-20 2023-02-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-16 2023-02-15https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-15 2023-02-14https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-14 2023-02-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-13 2023-02-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-10 2023-02-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-08 2023-02-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-07 2023-02-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-06 2023-02-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-03 2023-02-02https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-02-02 2023-01-31https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-31 2023-01-30https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-30 2023-01-27https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-27 2023-01-25https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-25 2023-01-24https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-24 2023-01-23https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-23 2023-01-20https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-20 2023-01-19https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-19 2023-01-18https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-18 2023-01-17https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-17 2023-01-16https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-16 2023-01-13https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-13 2023-01-12https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-12 2023-01-10https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-10 2023-01-09https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-09 2023-01-08https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-08 2023-01-07https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-07 2023-01-06https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-06 2023-01-05https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-05 2023-01-04https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-04 2023-01-03https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL/Archive_9#2023-01-03 https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks The designate-sink service listens on rabbitmq for creation or deletion of servers; when servers are created it attempts to create corresponding dns records; when a server is deleted it attempts to delete those records. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks#Debugging Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks#Old_incidents https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01 ==Week of January 01== Week of January 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01#Week_of_January_01 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01#=== Week of January 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01#Week_of_January_08 Week of January 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01#Week_of_January_15 Week of January 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01#Week_of_January_22 Week of January 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/01#Week_of_January_29 https://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Requirements == Requirements for the mobile device lab == Requirements for the mobile device labhttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Requirements#Requirements_for_the_mobile_device_lab Phoneshttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Requirements#Phones Servershttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Requirements#Servers Networkhttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Requirements#Network Example setup and workflowhttps://wikitech.wikimedia.org/wiki/Performance/Mobile_Device_Lab/Requirements#Example_setup_and_workflow https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudlb The cloudlb hosts provide load balancing for hardware providing cloud-realm services (see Cross-Realm traffic guidelines#Case 4: cloud-dedicated hardware). Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudlb#Overview Failoverhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloudlb#Failover https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown This happens when one of the Harbor components is down or not reporting being up. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown#Common_issues Issue 1https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown#Issue_1 Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/HarborComponentDown#Old_incidents https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3 = Q3 Overview = Q3 Overviewhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#Q3_Overview Q3 OKRshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#Q3_OKRs Things we shiphttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#Things_we_ship Search Update Pipeline (SUP)https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#Search_Update_Pipeline_(SUP) WDQS Split the Graphhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#WDQS_Split_the_Graph Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#Improve_multilingual_zero-results_rate Search SLOshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2023-2024_Q3#Search_SLOs https://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements This page collects the requirements and best practices for the Wikimedia SRE team for the usage of GitLab. Most requirements result from the current CI Gerrit and the established workflows. Securityhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Security 2FAhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#2FA LDAP group managementhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#LDAP_group_management SSH Key policyhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#SSH_Key_policy Code contribution workflowshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Code_contribution_workflows Depending code changeshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Depending_code_changes gerritlabhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#gerritlab Depends-Onhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Depends-On Code review workflowshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Code_review_workflows Assigneehttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Assignee Reviewerhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Reviewer Maintainerhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Maintainer Approving or disapproving a merge requesthttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Approving_or_disapproving_a_merge_request CI workflowshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#CI_workflows Trusted Runnershttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Trusted_Runners Standardization for Docker image buildshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Standardization_for_Docker_image_builds Standardization for service image builds (blubber)https://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Standardization_for_service_image_builds_(blubber) Standardization for Debian package Image buildshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Standardization_for_Debian_package_Image_builds Best practiceshttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Best_practices Link a Phabricator taskhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Link_a_Phabricator_task Using notifications and the ToDo-Listhttps://wikitech.wikimedia.org/wiki/GitLab/GitLab_SRE_Requirements#Using_notifications_and_the_ToDo-List https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-12 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-12#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-12#What_we've_accomplished WDQS Graph Splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-12#WDQS_Graph_Splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-12#Search_Update_Pipeline https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Deploy_wiki_replicas_view_change This runbook details how to change the Wiki Replicas views. Review processhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Deploy_wiki_replicas_view_change#Review_process Deployinghttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Deploy_wiki_replicas_view_change#Deploying Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Deploy_wiki_replicas_view_change#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Deploy_wiki_replicas_view_change#Related_information https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-01-16 Attendees: David Caro Seyram Komla Sapaty Taavi Väänänen Francesco Negri Raymond Olisaemeka https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-backups https://wikitech.wikimedia.org/wiki/Fundraising/techops/procedures/services-datacenter_cutover_procedure Note there is a related task to improve this: T266810 https://wikitech.wikimedia.org/wiki/Debian_packaging/Package_your_software_as_deb == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Package_your_software_as_deb#Introduction How to enable automatic build of debian packageshttps://wikitech.wikimedia.org/wiki/Debian_packaging/Package_your_software_as_deb#How_to_enable_automatic_build_of_debian_packages A typical workflowhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Package_your_software_as_deb#A_typical_workflow Bookwormhttps://wikitech.wikimedia.org/wiki/Debian_packaging/Package_your_software_as_deb#Bookworm Bullseyehttps://wikitech.wikimedia.org/wiki/Debian_packaging/Package_your_software_as_deb#Bullseye https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-19 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-19#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-19#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-19#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-19#WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-19#Operations https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality This document documents the design and implementation of Data Quality (DQ) instrumentation stack for Wikimedia datasets. Scopehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Scope Use Caseshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Use_Cases Things you should knowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Things_you_should_know Architecture & APIshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Architecture_&_APIs Data Quality: Lifecyclehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Data_Quality:_Lifecycle Data checks as sidecar jobshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Data_checks_as_sidecar_jobs Data checks as steps in primary pipelineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Data_checks_as_steps_in_primary_pipelines Summary of the approacheshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Summary_of_the_approaches Data Quality: Implementationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Data_Quality:_Implementation Implementation: Data Modelhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Implementation:_Data_Model Implementation: Deequ Metrics repositoryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Implementation:_Deequ_Metrics_repository Known limitationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Known_limitations Implementation: alertinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#Implementation:_alerting Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Data_Quality#References https://wikitech.wikimedia.org/wiki/Event_Platform/Beta_Deployments Event Platform services are deployed to k8s via Deployment pipeline. All services are available in staging, and that's where we usually test. https://wikitech.wikimedia.org/wiki/Fundraising/Development_tools/Logdog logdog! https://wikitech.wikimedia.org/wiki/SLO/MariaDB Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/MariaDB#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/SLO/MariaDB#Reconciliation https://wikitech.wikimedia.org/wiki/SRE/Working_Groups This page lists all currently active SRE working groups, with their name and description, membership and expectations around time commitments. ONFIREhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups#ONFIRE Cache Busting working grouphttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups#Cache_Busting_working_group Compositionhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups#Composition Training working grouphttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups#Training_working_group Mentorship working group (completed/ended)https://wikitech.wikimedia.org/wiki/SRE/Working_Groups#Mentorship_working_group_(completed/ended) https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship = Mentorship Working Group Charter = Mentorship Working Group Charterhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Mentorship_Working_Group_Charter Creating Incentives for Mentorship: Introductionhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Creating_Incentives_for_Mentorship:_Introduction Purpose and Goals of the Working Grouphttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Purpose_and_Goals_of_the_Working_Group Brief Description of the Need for Mentorship Incentives in the SRE Teamhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Brief_Description_of_the_Need_for_Mentorship_Incentives_in_the_SRE_Team Scope of Workhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Scope_of_Work Developing Mentorship Incentiveshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Developing_Mentorship_Incentives Defining Mentorship within SREhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Defining_Mentorship_within_SRE Evaluating and Measuring Impacthttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Evaluating_and_Measuring_Impact Ensuring Sustainability and Engagementhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Ensuring_Sustainability_and_Engagement Membership and Roleshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Membership_and_Roles Membershiphttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Membership Time Commitmenthttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Time_Commitment Operationshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Operations Meeting Schedulehttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Meeting_Schedule Preparation and Participationhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Preparation_and_Participation Task Managementhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Task_Management Communicationhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Communication Deliverables and Outcomeshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Deliverables_and_Outcomes Timeline for Deliverableshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Timeline_for_Deliverables Documentation and Reportinghttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Documentation_and_Reporting Evaluation and Impact Measurementhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Evaluation_and_Impact_Measurement Post-Implementation Surveyhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Post-Implementation_Survey Participation Rateshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Participation_Rates Feedbackhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Feedback Adjustments Based on Feedbackhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Adjustments_Based_on_Feedback Transparent Reportinghttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Transparent_Reporting Celebrating Successeshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/Mentorship#Celebrating_Successes https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE = ONFIRE Working Group Charter = ONFIRE Working Group Charterhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#ONFIRE_Working_Group_Charter Overviewhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Overview Objectivehttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Objective PPT Framework Applicationhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#PPT_Framework_Application Roles and Responsibilitieshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Roles_and_Responsibilities Meeting Structure and Frequencyhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Meeting_Structure_and_Frequency Decision-Making Processhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Decision-Making_Process Deliverables and Timelineshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Deliverables_and_Timelines Dependencies and Assumptionshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Dependencies_and_Assumptions Review and Revision Processeshttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Review_and_Revision_Processes Time Commitmenthttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Time_Commitment Accountabilityhttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Accountability Membershiphttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Membership Current (2023/2024)https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Current_(2023/2024) Past Membershttps://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#Past_Members 2022/2023https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#2022/2023 2021/2022https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#2021/2022 2020/2021https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#2020/2021 2019/2020https://wikitech.wikimedia.org/wiki/SRE/Working_Groups/ONFIRE#2019/2020 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26#Search_Update_Pipeline https://wikitech.wikimedia.org/wiki/Ncmonitor ncmonitor keeps consistency between our registered non-canonical domains and services such as acme-chief and ncredir. Over the years the appropriate manual toil has been neglected, causing drift between it all. Configurationhttps://wikitech.wikimedia.org/wiki/Ncmonitor#Configuration Reviewing patcheshttps://wikitech.wikimedia.org/wiki/Ncmonitor#Reviewing_patches Runninghttps://wikitech.wikimedia.org/wiki/Ncmonitor#Running Implementation detailshttps://wikitech.wikimedia.org/wiki/Ncmonitor#Implementation_details MarkMonitor domain legitimacyhttps://wikitech.wikimedia.org/wiki/Ncmonitor#MarkMonitor_domain_legitimacy ncredirhttps://wikitech.wikimedia.org/wiki/Ncmonitor#ncredir acme-chiefhttps://wikitech.wikimedia.org/wiki/Ncmonitor#acme-chief See alsohttps://wikitech.wikimedia.org/wiki/Ncmonitor#See_also https://wikitech.wikimedia.org/wiki/GitLab/Webhooks gitlab-webhooks listens for GitLab system-level webhook events and performs actions such as posting comments on Phabricator tickets or adding mentions on GitLab merge requests. How it workshttps://wikitech.wikimedia.org/wiki/GitLab/Webhooks#How_it_works Phabricatorhttps://wikitech.wikimedia.org/wiki/GitLab/Webhooks#Phabricator Gitlab Mentionshttps://wikitech.wikimedia.org/wiki/GitLab/Webhooks#Gitlab_Mentions Server-Sent Eventshttps://wikitech.wikimedia.org/wiki/GitLab/Webhooks#Server-Sent_Events Administrationhttps://wikitech.wikimedia.org/wiki/GitLab/Webhooks#Administration Maintainerhttps://wikitech.wikimedia.org/wiki/GitLab/Webhooks#Maintainer https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation Origin task: phab:T348749 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Rationale Voting resultshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Voting_results Backgroundhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Background Risks & Constraintshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Risks_&_Constraints Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Option_4 Pros & Conshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#Pros_&_Cons 1. Merge Existing Python CLIshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#1._Merge_Existing_Python_CLIs 2. Rewrite CLI from Scratch in Gohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#2._Rewrite_CLI_from_Scratch_in_Go 3. Create a Unified Open API Definition, Autogenerate a Go Clienthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation#3._Create_a_Unified_Open_API_Definition,_Autogenerate_a_Go_Client https://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction This page provides an introduction to working with Metrics Platform for maintainers. Componentshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Components MediaWikihttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#MediaWiki Event Platformhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Event_Platform MediaWiki Extensionshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#MediaWiki_Extensions EventLogginghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#EventLogging EventBushttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#EventBus EventStreamConfighttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#EventStreamConfig WikimediaEventshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#WikimediaEvents Wikilambdahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Wikilambda Metrics Platform Client Librarieshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Metrics_Platform_Client_Libraries Schemas and data contracthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Schemas_and_data_contract Stream Configurationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Stream_Configuration Setuphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Setup Requirementshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Requirements Mediawiki Docker Environment for Metrics Platformhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Mediawiki_Docker_Environment_for_Metrics_Platform Specific environments per languagehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Specific_environments_per_language Javascripthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Javascript PHPhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#PHP Javahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Java Swifthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Swift Recommended IDEs per languagehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Recommended_IDEs_per_language Testinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Testing Unit testshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#Unit_tests End-to-end testing against a local EventGatehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Maintainer_introduction#End-to-end_testing_against_a_local_EventGate https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75 == 2024-01-31 == 2024-01-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-31 2024-01-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-30 2024-01-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-29 2024-01-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-28 2024-01-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-26 2024-01-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-25 2024-01-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-24 2024-01-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-23 2024-01-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-22 2024-01-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-21 2024-01-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-20 2024-01-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-19 2024-01-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-18 2024-01-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-17 2024-01-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-16 2024-01-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-15 2024-01-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-14 2024-01-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-12 2024-01-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-11 2024-01-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-10 2024-01-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-09 2024-01-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-08 2024-01-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-06 2024-01-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-05 2024-01-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-04 2024-01-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-03 2024-01-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-02 2024-01-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#2024-01-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_75#Other_archives https://wikitech.wikimedia.org/wiki/Kubernetes/Kubernetes_OCI_Image_Versioning_Policy https://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria = Intro = Introhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Intro Scopehttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Scope Audiencehttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Audience Glossaryhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Glossary Problem statementhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Problem_statement Solutionhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Solution Selection criteriahttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Selection_criteria Essentialhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Essential Candidateshttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Candidates Evaluation matrixhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE/criteria#Evaluation_matrix https://wikitech.wikimedia.org/wiki/Kubernetes/CRE == Intro == Introhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE#Intro Docker deprecationhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE#Docker_deprecation Moving away from Dockerhttps://wikitech.wikimedia.org/wiki/Kubernetes/CRE#Moving_away_from_Docker https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02#Search_Update_Pipeline Misc / Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-02#Misc_/_Operations https://wikitech.wikimedia.org/wiki/Alert_review The Alert Review Process is a methodology designed for the systematic evaluation of alert data, aimed at identifying patterns, recurring issues, and opportunities for improvement. Analysis Frameworkhttps://wikitech.wikimedia.org/wiki/Alert_review#Analysis_Framework Doing an Alert Reviewhttps://wikitech.wikimedia.org/wiki/Alert_review#Doing_an_Alert_Review Data Collection and Analysishttps://wikitech.wikimedia.org/wiki/Alert_review#Data_Collection_and_Analysis Logstash and OpenSearch Dashboards Visualizationhttps://wikitech.wikimedia.org/wiki/Alert_review#Logstash_and_OpenSearch_Dashboards_Visualization Focused Analysis with Google Apps Scripthttps://wikitech.wikimedia.org/wiki/Alert_review#Focused_Analysis_with_Google_Apps_Script Presentationhttps://wikitech.wikimedia.org/wiki/Alert_review#Presentation Developing Apps Scripthttps://wikitech.wikimedia.org/wiki/Alert_review#Developing_Apps_Script Key Data Sourceshttps://wikitech.wikimedia.org/wiki/Alert_review#Key_Data_Sources https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Graph_split_IGUANA_performance Soft redirected pageshttps://wikitech.wikimedia.org/wiki/Category:Soft_redirected_pages https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis The scope of this analysis is to assess the impact (on existing SPARQL queries) of [the Wikidata graph into two subgraphs]: scientific articles (also referred to as scholarly articles) on one side and the rest (called Wikidata main) on the other. We will refer to the existing graph served by WDQS as the full graph. Datasethttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Dataset Basic sample statisticshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Basic_sample_statistics Collecting SPARQL query resultshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Collecting_SPARQL_query_results Methodologyhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Methodology Resultshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Results Annexhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Annex Query execution error statisticshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Query_execution_error_statistics Detecting a reference to a scientific articlehttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Detecting_a_reference_to_a_scientific_article Non deterministic SPARQL featureshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Non_deterministic_SPARQL_features wikibase:mwapi service EntitySearchhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#wikibase:mwapi_service_EntitySearch GROUP_CONCAThttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#GROUP_CONCAT Label service AltLabel (lbl_srv_alt_label)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Label_service_AltLabel_(lbl_srv_alt_label) SAMPLEhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#SAMPLE Blazegraph bd:slice service slice.offsethttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Blazegraph_bd:slice_service_slice.offset Using a top level limit on a large result set (top_level_limit)https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Using_a_top_level_limit_on_a_large_result_set_(top_level_limit) Distribution in the sampleshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Distribution_in_the_samples Combining 4 criteria of a SPARQL queryhttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Combining_4_criteria_of_a_SPARQL_query MixNMatch impacthttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#MixNMatch_impact Noteshttps://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/WDQS_Graph_Split_Impact_Analysis#Notes https://wikitech.wikimedia.org/wiki/Blubber/Reference https://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument This guide helps you create a Metrics Platform instrument from start to finish, including: Create a measurement planhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Create_a_measurement_plan Create an instrumentation specificationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Create_an_instrumentation_specification Specifying event datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Specifying_event_data The action propertyhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#The_action_property Interaction datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Interaction_data Contextual attributeshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Contextual_attributes Choosing a schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Choosing_a_schema Follow the data collection guidelineshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Follow_the_data_collection_guidelines Configure the streamhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Configure_the_stream Code the instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Code_the_instrument Document the instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Document_the_instrument Review your datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Review_your_data Decommission the instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Create_an_instrument#Decommission_the_instrument https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-09 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-09#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-09#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-09#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-09#WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-09#Misc https://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup This guide describes the steps you need to run a local MediaWiki configured to work with Metrics Platform, either to create/modify/test instruments or work on any client library. Using MediaWiki Dockerhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#Using_MediaWiki_Docker Configuring Metrics Platformhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#Configuring_Metrics_Platform submitClickhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#submitClick submitInteractionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#submitInteraction Working with schemas locallyhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#Working_with_schemas_locally submithttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#submit Useful commandshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#Useful_commands Using MediaWiki Vagranthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#Using_MediaWiki_Vagrant Using your local dev environment with eventgate-devserverhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Local_development_setup#Using_your_local_dev_environment_with_eventgate-devserver https://wikitech.wikimedia.org/wiki/Stat1010 The stat1010 server is an Analytics Cluster client node for accessing Analytics MariaDB databases or Hadoop. Successor to stat1005. Usagehttps://wikitech.wikimedia.org/wiki/Stat1010#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1010#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1010#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1010#Notes https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/02 ==Week of February 05== Week of February 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/02#Week_of_February_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/02#=== Week of February 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/02#Week_of_February_12 Week of February 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/02#Week_of_February_19 Week of February 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/02#Week_of_February_26 https://wikitech.wikimedia.org/wiki/Metrics_Platform/Decommission_an_instrument This page documents the process for decommissioning a Metrics Platform instrument. When to decommission an instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Decommission_an_instrument#When_to_decommission_an_instrument Decommissioning an instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Decommission_an_instrument#Decommissioning_an_instrument Schemashttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Decommission_an_instrument#Schemas https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Dumps The clouddumps servers serve dumps to clients running in Cloud VPS and the internet. See also Dumps/Dump_servers. Interfaceshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Dumps#Interfaces Failoverhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Dumps#Failover Web/rsynchttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Dumps#Web/rsync Cloud VPS NFShttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Dumps#Cloud_VPS_NFS https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13 = Toolforge council meeting notes = Toolforge council meeting noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Toolforge_council_meeting_notes Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Attendees Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Notes calendar confusionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#calendar_confusion Preparation for tool shutdown on the 14th Feb (tomorrow)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Preparation_for_tool_shutdown_on_the_14th_Feb_(tomorrow) Re-visit last time's backlog grooming experimenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Re-visit_last_time's_backlog_grooming_experiment Stabler image names for toolforge-jobs? https://phabricator.wikimedia.org/T357388https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Stabler_image_names_for_toolforge-jobs?_https://phabricator.wikimedia.org/T357388 Re-visit toolforge next stepshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Re-visit_toolforge_next_steps Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-02-13#Action_items https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire This happens when a Puppet certificate is about to expire. It might be either a normal host certificate or a CA certificate. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#Common_issues Host certificate about to expirehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#Host_certificate_about_to_expire CA certificate about to expirehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#CA_certificate_about_to_expire Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire#Old_incidents https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-16 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-16#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-16#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-16#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-16#Search_Update_Pipeline https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024 == By month == By monthhttps://wikitech.wikimedia.org/wiki/Deployments/Archive/2024#By_month https://wikitech.wikimedia.org/wiki/Stat1011 The stat1011 server is an Analytics Cluster client node for accessing Analytics MariaDB databases or Hadoop. Usagehttps://wikitech.wikimedia.org/wiki/Stat1011#Usage Serviceshttps://wikitech.wikimedia.org/wiki/Stat1011#Services See alsohttps://wikitech.wikimedia.org/wiki/Stat1011#See_also Noteshttps://wikitech.wikimedia.org/wiki/Stat1011#Notes https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-23 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-23#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-23#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-23#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-23#WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-02-23#Operations https://wikitech.wikimedia.org/wiki/SLO/ipoid Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Service_dependencies Hard dependencieshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Hard_dependencies Soft dependencieshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Soft_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/ipoid#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Service_Level_Objectives Realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Realistic_targets Ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Ideal_targets Reconciliationhttps://wikitech.wikimedia.org/wiki/SLO/ipoid#Reconciliation https://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-02-28_etcd-mirror#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76 == 2024-02-29 == 2024-02-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-29 2024-02-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-28 2024-02-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-27 2024-02-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-26 2024-02-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-25 2024-02-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-24 2024-02-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-23 2024-02-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-22 2024-02-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-21 2024-02-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-20 2024-02-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-19 2024-02-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-18 2024-02-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-17 2024-02-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-16 2024-02-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-15 2024-02-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-14 2024-02-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-13 2024-02-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-12 2024-02-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-11 2024-02-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-10 2024-02-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-09 2024-02-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-08 2024-02-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-07 2024-02-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-06 2024-02-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-05 2024-02-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-04 2024-02-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-03 2024-02-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-02 2024-02-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#2024-02-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_76#Other_archives https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-01 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-01#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-01#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-01#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-01#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-01#Improve_multilingual_zero-results_rate https://wikitech.wikimedia.org/wiki/Gerrit/Users == User storage == User storagehttps://wikitech.wikimedia.org/wiki/Gerrit/Users#User_storage Finding user recordshttps://wikitech.wikimedia.org/wiki/Gerrit/Users#Finding_user_records User preferenceshttps://wikitech.wikimedia.org/wiki/Gerrit/Users#User_preferences Renaming usershttps://wikitech.wikimedia.org/wiki/Gerrit/Users#Renaming_users https://wikitech.wikimedia.org/wiki/SRE/Mentorship Mentorship in the SRE team is a structured, personalized partnership focused on the professional and personal development of the mentee. This partnership is characterized by one-on-one engagement, where knowledge, skills, and experiences are shared within SRE practices to foster technical excellence, reliability principles, and career growth. Mentorship core elementshttps://wikitech.wikimedia.org/wiki/SRE/Mentorship#Mentorship_core_elements Methodologies for successhttps://wikitech.wikimedia.org/wiki/SRE/Mentorship#Methodologies_for_success Incentivizing mentorshiphttps://wikitech.wikimedia.org/wiki/SRE/Mentorship#Incentivizing_mentorship Resourceshttps://wikitech.wikimedia.org/wiki/SRE/Mentorship#Resources https://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Service_Level_Indicators_(SLIs) Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/AQS/Geo_Analytics#Service_Level_Objectives https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-08 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-08#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-08#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-08#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-08#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-08#WDQS_graph_splitting https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/03 ==Week of March 04== Week of March 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/03#Week_of_March_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/03#=== Week of March 11https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/03#Week_of_March_11 Week of March 18https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/03#Week_of_March_18 Week of March 25https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/03#Week_of_March_25 https://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem This page tries to rephrase some of what is stated in Shared Data Platform into a more focused problem and use cases, rather than the broad theory (Data as a Product) and platform (Common Data Infrastructure) language used there. Using MediaWiki data outside of MediaWikihttps://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#Using_MediaWiki_data_outside_of_MediaWiki Summaryhttps://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#Summary Contexthttps://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#Context Use cases requiring externalized MediaWiki datahttps://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#Use_cases_requiring_externalized_MediaWiki_data Product Featureshttps://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#Product_Features Analytics, Research, Machine Learning, etc.https://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#Analytics,_Research,_Machine_Learning,_etc. See alsohttps://wikitech.wikimedia.org/wiki/MediaWiki_Externalized_Data_Problem#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-03-12 == Notes == Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-03-12#Notes phab:T306039 - Decision request - Toolforge external infrastructure domain usagehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-03-12#phab:T306039_-_Decision_request_-_Toolforge_external_infrastructure_domain_usage phab:T314664 Two days to grid engine shut downhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-03-12#phab:T314664_Two_days_to_grid_engine_shut_down Jobs api refactorhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-03-12#Jobs_api_refactor Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-03-12#Action_items https://wikitech.wikimedia.org/wiki/Pixel Pixel is a tool that the Wikimedia Foundation uses to detect UI regressions. It is currently hosted on https://pixel. Maintainershttps://wikitech.wikimedia.org/wiki/Pixel#Maintainers Current setuphttps://wikitech.wikimedia.org/wiki/Pixel#Current_setup How it workshttps://wikitech.wikimedia.org/wiki/Pixel#How_it_works High level overviewhttps://wikitech.wikimedia.org/wiki/Pixel#High_level_overview Codehttps://wikitech.wikimedia.org/wiki/Pixel#Code ~/.bashrchttps://wikitech.wikimedia.org/wiki/Pixel#~/.bashrc /home/pixel/pixelhttps://wikitech.wikimedia.org/wiki/Pixel#/home/pixel/pixel /home/pixel/pixel.shhttps://wikitech.wikimedia.org/wiki/Pixel#/home/pixel/pixel.sh su crontab -lhttps://wikitech.wikimedia.org/wiki/Pixel#su_crontab_-l Dashboardhttps://wikitech.wikimedia.org/wiki/Pixel#Dashboard Setuphttps://wikitech.wikimedia.org/wiki/Pixel#Setup Userhttps://wikitech.wikimedia.org/wiki/Pixel#User Update to a new pixelhttps://wikitech.wikimedia.org/wiki/Pixel#Update_to_a_new_pixel Volumeshttps://wikitech.wikimedia.org/wiki/Pixel#Volumes Logshttps://wikitech.wikimedia.org/wiki/Pixel#Logs Workaroundshttps://wikitech.wikimedia.org/wiki/Pixel#Workarounds https://wikitech.wikimedia.org/wiki/Performance/Dictionary This is a living document trying to explain web performance words. https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. What we need from youhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#What_we_need_from_you What happens when a project is not marked as activehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#What_happens_when_a_project_is_not_marked_as_active Further clueshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#Further_clues Projects and Instanceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#Projects_and_Instances account-creation-assistancehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#account-creation-assistance adiutorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#adiutor admin-monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#admin-monitoring analyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#analytics appservershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#appservers auditlogginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#auditlogging automation-frameworkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#automation-framework baglama2https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#baglama2 bastionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#bastion canasta2_testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#canasta2_test capacity-exchangehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#capacity-exchange catalysthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#catalyst catalyst-qtehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#catalyst-qte centralnotice-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#centralnotice-staging checkuser-beta-wikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#checkuser-beta-wiki citefixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#citefix civicrm-prototypehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#civicrm-prototype clouddb-serviceshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#clouddb-services cloudinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#cloudinfra cloudinfra-nfshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#cloudinfra-nfs cloudvirt-canaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#cloudvirt-canary codereviewhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#codereview codesearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#codesearch collection-alt-rendererhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#collection-alt-renderer commons-corruption-checkerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#commons-corruption-checker commtechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#commtech copypatrolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#copypatrol cvnhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#cvn cyberbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#cyberbot dashikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#dashiki deployment-prephttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#deployment-prep devel-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#devel-stats devportalhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#devportal devtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#devtools discordbotshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#discordbots discoursehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#discourse downloadhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#download ducthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#duct dump-references-processorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#dump-references-processor dumpshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#dumps dwlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#dwl entity-detectionhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#entity-detection etytreehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#etytree eventmetricshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#eventmetrics extdisthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#extdist fa-wphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#fa-wp fastccihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#fastcci foundationmemoryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#foundationmemory fr-tech-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#fr-tech-dev gitlab-runnershttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#gitlab-runners gitlab-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#gitlab-test glamshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#glams glamwikidashboardhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#glamwikidashboard globaleducationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#globaleducation google-api-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#google-api-proxy gratitudehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#gratitude hashtagshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#hashtags hoiscripthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#hoiscript hugglehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#huggle huwiki-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#huwiki-dev idm-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#idm-dev iiabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#iiab image-suggestion-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#image-suggestion-api imagebulkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#imagebulk impactvisualizerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#impactvisualizer incubatorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#incubator in use integrationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#in_use_integration ipoidopensearchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#ipoidopensearch isahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#isa k8splayhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#k8splay languagehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#language ldap-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#ldap-dev library-upgraderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#library-upgrader linkwatcherhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#linkwatcher logginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#logging lta-trackerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#lta-tracker lutzhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#lutz machine-learninghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#machine-learning mailmanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mailman mapshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#maps maps-experimentshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#maps-experiments mariadbtesthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mariadbtest maszhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#masz mathhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#math matrixhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#matrix mdwikiofflinehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mdwikioffline media-streaminghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#media-streaming mediawiki-vagranthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mediawiki-vagrant metricsinfrahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#metricsinfra mix-n-matchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mix-n-match monitoringhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#monitoring mwclihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mwcli mwofflinerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mwoffliner mwstakehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mwstake mwv-apthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#mwv-apt netops-clabhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#netops-clab observerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#observer ocrtoyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#ocrtoy onfirehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#onfire openvashttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#openvas osmithttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#osmit owidmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#owidm packaginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#packaging pawshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#paws petscanhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#petscan pixelhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#pixel pkihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#pki pluggableauthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#pluggableauth policy-test-projecthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#policy-test-project procbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#procbot project-proxyhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#project-proxy puppet-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#puppet-dev puppet-diffshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#puppet-diffs qrankhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#qrank quarryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#quarry rcmhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#rcm reading-web-staginghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#reading-web-staging recommendation-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#recommendation-api redirectshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#redirects research-collaborations-apihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#research-collaborations-api rook-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#rook-test schematreerecommenderhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#schematreerecommender searchhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#search security-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#security-tools servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#service shiny-rhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#shiny-r signwritinghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#signwriting soweegohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#soweego spacemediahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#spacemedia spi-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#spi-tools sre-sandboxhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#sre-sandbox ssohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#sso statanalyserhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#statanalyser strikerhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#striker suggestbothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#suggestbot supersethttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#superset swifthttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#swift t353829test8https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#t353829test8 t353829test9https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#t353829test9 terraformhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#terraform testlabshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#testlabs text-to-speechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#text-to-speech teyorahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#teyora tf-infra-testhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#tf-infra-test tofuhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#tofu toolhubhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#toolhub toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#tools toolsbetahttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#toolsbeta traffichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#traffic twlhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#twl utrshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#utrs videohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#video videocuttoolhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#videocuttool videowikihttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#videowiki visualeditorhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#visualeditor vuessrhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#vuessr wcdohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wcdo webperfhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#webperf wikiapiaryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikiapiary wikibase-registryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikibase-registry wikicitehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikicite wikicommunityhealthhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikicommunityhealth wikidata-devhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikidata-dev wikidata-history-query-servicehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikidata-history-query-service wikidata-queryhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikidata-query wikidata-reconciliationhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikidata-reconciliation wikidocumentarieshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikidocumentaries wikidumpparsehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikidumpparse wikifunctionshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikifunctions wikilabelshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikilabels wikilinkhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikilink wikimania-mautichttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikimania-mautic wikipathwayshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikipathways wikisourcehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikisource wikisphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikisp wikispeechhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikispeech wikisporehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikispore wikistatshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikistats wikitextexphttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikitextexp wikiwhohttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wikiwho wildcathttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wildcat wlm-it-visualhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wlm-it-visual wm-bothttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wm-bot wmcs-uptimehttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmcs-uptime wmcz-statshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmcz-stats wmde-dashboardshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmde-dashboards wmdeanalyticshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmdeanalytics wmf-dumps-playgroundhttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmf-dumps-playground wmf-research-toolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmf-research-tools wmflabsdotorghttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#wmflabsdotorg xtoolshttps://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge#xtools https://wikitech.wikimedia.org/wiki/News/Buster_deprecation Support for Debian Buster ends on June 30th, 2024. This page tracks our efforts to stop using Buster on cloud-vps. Tell me exactly what I need to dohttps://wikitech.wikimedia.org/wiki/News/Buster_deprecation#Tell_me_exactly_what_I_need_to_do Cloud VPS project maintainershttps://wikitech.wikimedia.org/wiki/News/Buster_deprecation#Cloud_VPS_project_maintainers Toolforge tool maintainershttps://wikitech.wikimedia.org/wiki/News/Buster_deprecation#Toolforge_tool_maintainers Why are we doing this?https://wikitech.wikimedia.org/wiki/News/Buster_deprecation#Why_are_we_doing_this? See alsohttps://wikitech.wikimedia.org/wiki/News/Buster_deprecation#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-22 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-22#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-22#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-22#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-03-22#WDQS_graph_splitting https://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN =Introduction= Introductionhttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Introduction Stepshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Steps Configure new EVPN switcheshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Configure_new_EVPN_switches Connect spine switches to CRs and legacy ASWshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Connect_spine_switches_to_CRs_and_legacy_ASWs Migrate IP Gatewayshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Migrate_IP_Gateways IPv6 Gatewayhttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#IPv6_Gateway IPv4 Gatewayhttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#IPv4_Gateway More Specific Always Winshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#More_Specific_Always_Wins Migrate Hostshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Migrate_Hosts Remove IRB ints from Spineshttps://wikitech.wikimedia.org/wiki/Migrate_from_VC_switch_stack_to_EVPN#Remove_IRB_ints_from_Spines https://wikitech.wikimedia.org/wiki/Network_equipment_lifecycle == Procurement == Procurementhttps://wikitech.wikimedia.org/wiki/Network_equipment_lifecycle#Procurement Provisioninghttps://wikitech.wikimedia.org/wiki/Network_equipment_lifecycle#Provisioning Upgradehttps://wikitech.wikimedia.org/wiki/Network_equipment_lifecycle#Upgrade Migrationhttps://wikitech.wikimedia.org/wiki/Network_equipment_lifecycle#Migration Decommissioninghttps://wikitech.wikimedia.org/wiki/Network_equipment_lifecycle#Decommissioning https://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-03-27_Elasticsearch_Omega_Cluster_Failure#Scorecard https://wikitech.wikimedia.org/wiki/Pixel/Setup_server == Install a fresh pixel server == Install a fresh pixel serverhttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Install_a_fresh_pixel_server Install Dockerhttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Install_Docker Create a user for all pixel related workhttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Create_a_user_for_all_pixel_related_work Setup two volumes to separate the datahttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Setup_two_volumes_to_separate_the_data Configure Docker to use the new volumehttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Configure_Docker_to_use_the_new_volume Install NodeJShttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Install_NodeJS Install crontabhttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Install_crontab Setup apache2https://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Setup_apache2 Setup up logshttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Setup_up_logs Setup collectdhttps://wikitech.wikimedia.org/wiki/Pixel/Setup_server#Setup_collectd https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77 == 2024-03-31 == 2024-03-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-31 2024-03-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-30 2024-03-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-29 2024-03-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-28 2024-03-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-27 2024-03-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-26 2024-03-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-25 2024-03-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-24 2024-03-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-23 2024-03-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-22 2024-03-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-21 2024-03-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-20 2024-03-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-19 2024-03-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-18 2024-03-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-17 2024-03-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-16 2024-03-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-15 2024-03-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-14 2024-03-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-13 2024-03-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-12 2024-03-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-11 2024-03-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-10 2024-03-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-09 2024-03-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-08 2024-03-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-07 2024-03-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-06 2024-03-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-05 2024-03-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-04 2024-03-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-03 2024-03-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-02 2024-03-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#2024-03-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_77#Other_archives https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy The web proxy (aka dynamicproxy aka novaproxy aka Yuviproxy) mechanism powers the Cloud VPS web proxy service. It's powered by Nginx, OpenResty, a Redis backend and a Python API to manage it. How tohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy#How_to Enable per-project subdomain delegationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy#Enable_per-project_subdomain_delegation Enable support for a custom domainhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy#Enable_support_for_a_custom_domain Expose real visitor IPs to a proxied servicehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy#Expose_real_visitor_IPs_to_a_proxied_service See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration This page contains information on the PSP migration we conducted in 2024. See also: [PSP vs PSA feature comparison === PSP vs PSA feature comparisonhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#PSP_vs_PSA_feature_comparison Custom admission controllershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#Custom_admission_controllers Planshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#Plans Questions and answershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#Questions_and_answers Kyverno POChttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#Kyverno_POC OpenPolicyAgent gatekeeper POChttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#OpenPolicyAgent_gatekeeper_POC See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/RBAC_and_Pod_security/PSP_migration#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05#WDQS_graph_splitting Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05#Search_Update_Pipeline Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-05#Misc https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04 ==Week of April 01== Week of April 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04#Week_of_April_01 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04#=== Week of April 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04#Week_of_April_08 Week of April 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04#Week_of_April_15 Week of April 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04#Week_of_April_22 Week of April 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/04#Week_of_April_29 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#Common_issues NFS server went awayhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#NFS_server_went_away NFS stuck processeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#NFS_stuck_processes Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-04-09 == Agenda == Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-04-09#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-04-09#Notes https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12#WDQS_graph_splitting Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12#Improve_multilingual_zero-results_rate Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12#Search_Update_Pipeline Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-12#Misc https://wikitech.wikimedia.org/wiki/Data_Platform/Data_lifecycle_management The data life cycle refers to the sequence of stages that data goes through from its initial creation or capture to its eventual archiving and possible deletion.These stages include: Data platformhttps://wikitech.wikimedia.org/wiki/Category:Data_platform https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Incident_management The process outlined below relates to handling quality issues. If the data incident is a data breach (e. Detecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Incident_management#Detect Alerthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Incident_management#Alert Triagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Incident_management#Triage Resolvehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Incident_management#Resolve Reviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Incident_management#Review https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Summary Status at ~09:20 UTC:https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Status_at_~09:20_UTC: Actions:https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Actions: Commits:https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Commits: Graphs:https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Graphs: Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-17_mw-on-k8s_eqiad_outage#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices Origin task: [of the decision: 2024-04-18 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Constraints_and_risks Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Options Prescriptivenesshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Prescriptiveness Option Ahttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_A Option Bhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_B Specific tools and settings usedhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Specific_tools_and_settings_used Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_4 Option 5https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T361804_Update_python_team_best_practices#Option_5 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19#Improve_multilingual_zero-results_rate WDQS Graph Splithttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19#WDQS_Graph_Split Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19#Search_Update_Pipeline Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-19#Operations https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Pandas_examples This page provides examples of using Python and Pandas to process the Mediawiki history dumps. Pandas v1https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Pandas_examples#Pandas_v1 Requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Pandas_examples#Requirements Pandas v2https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Pandas_examples#Pandas_v2 https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Dask_examples This page provides examples of using Python and Pandas to process the Mediawiki history dumps. Daskhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Dask_examples#Dask Requirementshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/Mediawiki_history_dumps/Python_Dask_examples#Requirements https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process This is a description of what steps to take when responding to a WMCS incident. What is an incident?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#What_is_an_incident? Examples of incidentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#Examples_of_incidents Examples of issues that are NOT incidentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#Examples_of_issues_that_are_NOT_incidents WMCS incidents vs Production incidentshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#WMCS_incidents_vs_Production_incidents If you’ve been pagedhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#If_you’ve_been_paged Declaring an incidenthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#Declaring_an_incident Managing an ongoing incidenthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#Managing_an_ongoing_incident To become the IChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#To_become_the_IC When you are the IChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#When_you_are_the_IC When you are working on an incident but you are not the IChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#When_you_are_working_on_an_incident_but_you_are_not_the_IC To hand over the IC role to another personhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#To_hand_over_the_IC_role_to_another_person To resolve the incident and stop being IChttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#To_resolve_the_incident_and_stop_being_IC Writing an incident reporthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Incident_response_process#Writing_an_incident_report https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Coding We write a lot of code, so it seems like that would be the place to introduce some common practices for the WMCS team. In the interest of clean, readable code across the team, it is common practice by development groups to share formatting and other development practices in order to facilitate collaboration. Allhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Coding#All Shell scriptshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Coding#Shell_scripts Pythonhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Coding#Python Golanghttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Coding#Golang Other guidancehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Coding#Other_guidance https://wikitech.wikimedia.org/wiki/Magru_data_center Magru (pronounced mah-groo) is a caching data center located at Ascenty São Paulo 3 in [Paulo, Brazil]. Historyhttps://wikitech.wikimedia.org/wiki/Magru_data_center#History Noteshttps://wikitech.wikimedia.org/wiki/Magru_data_center#Notes https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model Origin task: phab:T362872 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362872_Toolforge_policy_agent_enforcement_model#Option_3 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-26 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-26#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-26#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-26#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-26#WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-04-26#Misc https://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Detection Diagnosishttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Diagnosis Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Where_did_we_get_lucky? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-26_Search_unavailable_for_some_eqiad_users#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis This runbook explains how to debug and fix common issues with Toolforge Redis. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#Common_issues max number of clients reachedhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#max_number_of_clients_reached Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Redis#Old_incidents https://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests This page documents how to query [page|MediaWiki Action API], [API|MediaWiki REST API], and [REST API|Wikimedia REST API] internally in R and Python, rather than sending requests over the Internet. The code examples here were tested on stat1010. Pythonhttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#Python Fixing SSL certificate verification errorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#Fixing_SSL_certificate_verification_error Using requestshttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#Using_requests Using mwapihttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#Using_mwapi DataFrame from API responsehttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#DataFrame_from_API_response Rhttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#R Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Internal_API_requests#References https://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redis_refusing_connections#Scorecard https://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Overview Goalshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Goals Guidelineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Guidelines Dataset Creation Processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Dataset_Creation_Process General Schema Design Guidelineshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#General_Schema_Design_Guidelines [De]normalizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#[De]normalization Granularityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Granularity Immutabilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Immutability Privacy Considerationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Privacy_Considerations Release Frequencyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Release_Frequency Storage Formathttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Storage_Format Naming and Data Type Conventionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Naming_and_Data_Type_Conventions Table and column nameshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Table_and_column_names Aggregateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Aggregates per vs. byhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#per_vs._by IDshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#IDs Timestampshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Timestamps Dateshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Dates Durationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Durations Year/Month/Day/Hour Partition Columnshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Year/Month/Day/Hour_Partition_Columns Monthshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Months Numeric Valueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Numeric_Values Booleanshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Booleans Integershttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Integers Floats and Doubleshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Floats_and_Doubles Countrieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Countries Languageshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Languages WMF-Specific Conventionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#WMF-Specific_Conventions wiki vs. wiki_id vs. wiki_db vs. projecthttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#wiki_vs._wiki_id_vs._wiki_db_vs._project performer vs. actor vs. userhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#performer_vs._actor_vs._user user_text vs. user_namehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#user_text_vs._user_name page vs. articlehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#page_vs._article Glossaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Glossary Resourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_modeling_guidelines#Resources https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78 == 2024-04-30 == 2024-04-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-30 2024-04-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-29 2024-04-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-28 2024-04-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-27 2024-04-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-26 2024-04-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-25 2024-04-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-24 2024-04-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-23 2024-04-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-22 2024-04-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-21 2024-04-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-20 2024-04-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-19 2024-04-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-18 2024-04-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-17 2024-04-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-16 2024-04-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-15 2024-04-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-14 2024-04-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-13 2024-04-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-12 2024-04-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-11 2024-04-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-10 2024-04-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-09 2024-04-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-08 2024-04-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-06 2024-04-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-05 2024-04-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-04 2024-04-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-03 2024-04-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-02 2024-04-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#2024-04-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_78#Other_archives https://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics The [Impact Metrics] data product is a collection of datasets designed to provide insight on the impact of community contributions to [Page|Wikimedia Commons]. So far, the data is focused on media files uploaded by and categories belonging to GLAM actors (affiliates, projects, individual contributors, etc. Project rationalehttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Project_rationale Properties and caveatshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Properties_and_caveats Category allow-listhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Category_allow-list Allow-list updateshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Allow-list_updates Category renameshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Category_renames No retroactive calculations by defaulthttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#No_retroactive_calculations_by_default Max depthhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Max_depth Aggregated and released monthlyhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Aggregated_and_released_monthly Pageviews vs. Mediarequestshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Pageviews_vs._Mediarequests Monthly drifthttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Monthly_drift How to access the datahttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#How_to_access_the_data Data lakehttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Data_lake Dumpshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Dumps APIhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#API Pipeline architecturehttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Pipeline_architecture Base datasetshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Base_datasets Cassandra loadinghttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#Cassandra_loading AQS servicehttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics#AQS_service https://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model This page describes the data model of the Commons Impact Metrics data product. It includes detailed descriptions of all dimensions and metrics as well as the detailed schemas of the 5 base datasets stored in Hive (Iceberg) and exported as dumps. Field glossaryhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Field_glossary Base datasetshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Base_datasets Snapshot-based datasetshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Snapshot-based_datasets Category metrics snapshothttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Category_metrics_snapshot Media file metrics snapshothttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Media_file_metrics_snapshot Aggregated cubeshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Aggregated_cubes Pageviews per category monthlyhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Pageviews_per_category_monthly Pageviews per media file monthlyhttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Pageviews_per_media_file_monthly Event-based datasetshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Event-based_datasets Editshttps://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Data_Model#Edits https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-03 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-03#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-03#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-03#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-03#WDQS_graph_splitting Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-03#Operations https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent Origin task: [of the decision: 2024-04-30 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Constraints_and_risks Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362233_Toolforge_policy_agent#Option_3 https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/ceph-csi-rbd Chart name: ceph-csi-rbd Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Cassandra/Staging To obtain developer access, follow the usual process for submitting an access request. https://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion == Motivation == Motivationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Motivation Processhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Process Identification and Reviewhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Identification_and_Review Pre-deprecation Preparationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Pre-deprecation_Preparations Feedback Grace Periodhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Feedback_Grace_Period Deprecation Executionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Deprecation_Execution Archiving vs. Deletion Decisionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Archiving_vs._Deletion_Decision Archivinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Archiving Deletionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_archiving_and_deletion#Deletion https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10#WDQS_graph_splitting Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10#Search_Metrics Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10#Search_Update_Pipeline Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-10#Operations https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process Origin task: [of the decision: 2024-05-10 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Decision_taken Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Constraints_and_risks Options consideredhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Options_considered Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Option_2 Option 2.1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Option_2.1 Option 3 (status quo)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348887_Incident_Response_Process#Option_3_(status_quo) https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/05 ==Week of May 06== Week of May 06https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/05#Week_of_May_06 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/05#=== Week of May 13https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/05#Week_of_May_13 Week of May 20https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/05#Week_of_May_20 Week of May 27https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/05#Week_of_May_27 https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_control-planes = Add stacked control-plane = Add stacked control-planehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_control-planes#Add_stacked_control-plane Remove control-plane(s)https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_control-planes#Remove_control-plane(s) Remove etcd node(s)https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/Add_or_remove_control-planes#Remove_etcd_node(s) https://wikitech.wikimedia.org/wiki/Scap/Scap3_keyholder_key Scap requires an SSH key to establish a connection with the target server. Scap looks for the SSH key file located in /etc/keyholder. Configurationhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_keyholder_key#Configuration SSH on targethttps://wikitech.wikimedia.org/wiki/Scap/Scap3_keyholder_key#SSH_on_target Error handlinghttps://wikitech.wikimedia.org/wiki/Scap/Scap3_keyholder_key#Error_handling Testing scenarios for keyholder errorhttps://wikitech.wikimedia.org/wiki/Scap/Scap3_keyholder_key#Testing_scenarios_for_keyholder_error https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17#WDQS_graph_splitting Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17#Search_Metrics Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-17#Misc https://wikitech.wikimedia.org/wiki/Gerrit/Architecture == Gerrit Architecture == Gerrit Architecturehttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Gerrit_Architecture Overviewhttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Overview Current Alerting Mechanismshttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Current_Alerting_Mechanisms Decision to Not Use CDNhttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Decision_to_Not_Use_CDN Historical Contexthttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Historical_Context Re-evaluation of CDN Usagehttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Re-evaluation_of_CDN_Usage Emergency Procedureshttps://wikitech.wikimedia.org/wiki/Gerrit/Architecture#Emergency_Procedures https://wikitech.wikimedia.org/wiki/Pyrra = Pyrra = Pyrrahttps://wikitech.wikimedia.org/wiki/Pyrra#Pyrra Architecturehttps://wikitech.wikimedia.org/wiki/Pyrra#Architecture Componentshttps://wikitech.wikimedia.org/wiki/Pyrra#Components UI/API componenthttps://wikitech.wikimedia.org/wiki/Pyrra#UI/API_component Filesystem operator componenthttps://wikitech.wikimedia.org/wiki/Pyrra#Filesystem_operator_component Site local specificshttps://wikitech.wikimedia.org/wiki/Pyrra#Site_local_specifics Grouping workaroundhttps://wikitech.wikimedia.org/wiki/Pyrra#Grouping_workaround Grafana dashboard for longer range and detail viewshttps://wikitech.wikimedia.org/wiki/Pyrra#Grafana_dashboard_for_longer_range_and_detail_views Onboarding a new SLO with Pyrrahttps://wikitech.wikimedia.org/wiki/Pyrra#Onboarding_a_new_SLO_with_Pyrra https://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_creation == Dataset Creation Pathway == Dataset Creation Pathwayhttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_creation#Dataset_Creation_Pathway Purposehttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_creation#Purpose Linkshttps://wikitech.wikimedia.org/wiki/Data_Platform/Dataset_creation#Links https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14 === Agenda === Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14#Notes David presents ‘Toolforge high view’https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14#David_presents_‘Toolforge_high_view’ Hackathon recaphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14#Hackathon_recap Can we stop requiring manual new toolforge account approval?https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14#Can_we_stop_requiring_manual_new_toolforge_account_approval? Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-05-14#Action_items https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24#WDQS_graph_splitting Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24#Search_Metrics Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-24#Misc https://wikitech.wikimedia.org/wiki/EchoStore Echostore provides application servers with shared access to the [extension's seen-time cache. It utilizes Kask], a RESTful opaque key/value storage abstraction on top of Apache Cassandra, deployed in an active/active configuration in both the [[Eqiad data center|eqiad and codfw data-centers. Production Environmenthttps://wikitech.wikimedia.org/wiki/EchoStore#Production_Environment Service endpointshttps://wikitech.wikimedia.org/wiki/EchoStore#Service_endpoints Discoveryhttps://wikitech.wikimedia.org/wiki/EchoStore#Discovery eqiadhttps://wikitech.wikimedia.org/wiki/EchoStore#eqiad codfwhttps://wikitech.wikimedia.org/wiki/EchoStore#codfw staginghttps://wikitech.wikimedia.org/wiki/EchoStore#staging Prometheus metricshttps://wikitech.wikimedia.org/wiki/EchoStore#Prometheus_metrics Readinesshttps://wikitech.wikimedia.org/wiki/EchoStore#Readiness Cassandrahttps://wikitech.wikimedia.org/wiki/EchoStore#Cassandra Common Taskshttps://wikitech.wikimedia.org/wiki/EchoStore#Common_Tasks Deploymenthttps://wikitech.wikimedia.org/wiki/EchoStore#Deployment k8shttps://wikitech.wikimedia.org/wiki/EchoStore#k8s Deployment-prephttps://wikitech.wikimedia.org/wiki/EchoStore#Deployment-prep Sample Hiera Confighttps://wikitech.wikimedia.org/wiki/EchoStore#Sample_Hiera_Config Pool and Depoolhttps://wikitech.wikimedia.org/wiki/EchoStore#Pool_and_Depool See alsohttps://wikitech.wikimedia.org/wiki/EchoStore#See_also https://wikitech.wikimedia.org/wiki/Data_Platform __NOTOC__ Get startedhttps://wikitech.wikimedia.org/wiki/Data_Platform#Get_started Data platform infrastructurehttps://wikitech.wikimedia.org/wiki/Data_Platform#Data_platform_infrastructure Data pipelineshttps://wikitech.wikimedia.org/wiki/Data_Platform#Data_pipelines Search data and serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform#Search_data_and_services Overview of data platform systemshttps://wikitech.wikimedia.org/wiki/Data_Platform#Overview_of_data_platform_systems Data platform operationshttps://wikitech.wikimedia.org/wiki/Data_Platform#Data_platform_operations https://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data This page provides links to data documentation for private and public Wikimedia data sources. Its primary audience is WMF data analysts, product teams, and researchers who have an official non-disclosure agreement with the Wikimedia Foundation. Traffic datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data#Traffic_data Content datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data#Content_data Contributing and edits datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data#Contributing_and_edits_data Instrumentation and events datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data#Instrumentation_and_events_data How to query private datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data#How_to_query_private_data Report data issueshttps://wikitech.wikimedia.org/wiki/Data_Platform/Discover_data#Report_data_issues https://wikitech.wikimedia.org/wiki/Data_Platform/Analyze_data __NOTOC__ Key termshttps://wikitech.wikimedia.org/wiki/Data_Platform/Analyze_data#Key_terms Get access to internal datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Analyze_data#Get_access_to_internal_data Query and analyze datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Analyze_data#Query_and_analyze_data Use internal versions of public resourceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Analyze_data#Use_internal_versions_of_public_resources Next stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Analyze_data#Next_steps https://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data __NOTOC__ Before you starthttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Before_you_start Plan data lifecylehttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Plan_data_lifecyle Get approval for new data collectionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Get_approval_for_new_data_collection Model and document your datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Model_and_document_your_data Build your table or datasethttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Build_your_table_or_dataset Table formats and storagehttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Table_formats_and_storage Share data and dashboardshttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Share_data_and_dashboards Before you publish any datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Before_you_publish_any_data Share queries and visualizationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Share_queries_and_visualizations Tools and platforms for publishing data externallyhttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Tools_and_platforms_for_publishing_data_externally Manage published datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Manage_published_data Maintainance and monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Maintainance_and_monitoring Retention and deletionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Transform_data#Retention_and_deletion https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/cloudnative-pg Chart name: cloudnative-pg Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31#WDQS_graph_splitting Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31#Search_Metrics Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-05-31#Operations https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration == Datahub Service Details == Datahub Service Detailshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#Datahub_Service_Details Deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#Deployment datahub-nexthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#datahub-next datahubhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#datahub Restore Indiceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#Restore_Indices Alertinghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#Alerting The app isn't runninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/DataHub/Administration#The_app_isn't_running https://wikitech.wikimedia.org/wiki/Security/Production_updates Security updates for Wikimedia production are centrally coordinated by the Infrastructure Foundations SRE team. How to get notified of security issueshttps://wikitech.wikimedia.org/wiki/Security/Production_updates#How_to_get_notified_of_security_issues How to assess whether we're affectedhttps://wikitech.wikimedia.org/wiki/Security/Production_updates#How_to_assess_whether_we're_affected How to determine the impacthttps://wikitech.wikimedia.org/wiki/Security/Production_updates#How_to_determine_the_impact How to get the vulnerability fixedhttps://wikitech.wikimedia.org/wiki/Security/Production_updates#How_to_get_the_vulnerability_fixed How to roll out software updateshttps://wikitech.wikimedia.org/wiki/Security/Production_updates#How_to_roll_out_software_updates How to roll out kernel updateshttps://wikitech.wikimedia.org/wiki/Security/Production_updates#How_to_roll_out_kernel_updates https://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Timeline Following day 2024-05-29.https://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Following_day_2024-05-29. Following day 2024-05-30https://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Following_day_2024-05-30 Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-28_wikikube-api#Scorecard https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79 == 2024-05-15 == 2024-05-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-15 2024-05-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-14 2024-05-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-13 2024-05-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-12 2024-05-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-11 2024-05-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-10 2024-05-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-09 2024-05-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-08 2024-05-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-07 2024-05-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-06 2024-05-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-05 2024-05-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-04 2024-05-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-03 2024-05-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-02 2024-05-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#2024-05-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_79#Other_archives https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80 == 2024-05-31 == 2024-05-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-31 2024-05-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-30 2024-05-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-29 2024-05-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-28 2024-05-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-27 2024-05-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-26 2024-05-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-25 2024-05-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-24 2024-05-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-23 2024-05-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-22 2024-05-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-21 2024-05-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-20 2024-05-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-19 2024-05-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-18 2024-05-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-17 2024-05-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#2024-05-16 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_80#Other_archives https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainKubeusersDown == Source code == Source codehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainKubeusersDown#Source_code Logshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainKubeusersDown#Logs Get a shell inside the podhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainKubeusersDown#Get_a_shell_inside_the_pod See prometheus metrics inside the containerhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainKubeusersDown#See_prometheus_metrics_inside_the_container Dashboardshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainKubeusersDown#Dashboards https://wikitech.wikimedia.org/wiki/Project Project may refer to: Disambiguation pageshttps://wikitech.wikimedia.org/wiki/Category:Disambiguation_pages https://wikitech.wikimedia.org/wiki/Kubernetes/Service_ips This page is intended to list the ClusterIP addresses we allocate statically on the wikikube cluster. We just list the last octet. Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes https://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_Data_Monitor This page documents the process for measuring metrics related to the adoption of Metrics Platform schemas. Quickstarthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_Data_Monitor#Quickstart Backgroundhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_Data_Monitor#Background Linkshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Custom_Data_Monitor#Links https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu We use OpenTofu to manage some cluster-wide OpenStack resources using the code in [Source of truth == Source of truthhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Source_of_truth Usagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Usage Automated workflow via cookbookhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Automated_workflow_via_cookbook Manual workflowhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Manual_workflow Automated workflow via gitlab CIhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Automated_workflow_via_gitlab_CI Setuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Setup cookbook setup noteshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#cookbook_setup_notes Known problemshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Known_problems DNS records of type NS in root zone cannot be updatedhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#DNS_records_of_type_NS_in_root_zone_cannot_be_updated Importing security group ruleshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Importing_security_group_rules Managing the default security grouphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Managing_the_default_security_group Vendored openstack providerhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Vendored_openstack_provider Unsupported resourceshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Unsupported_resources Data migration from openstack to tofuhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#Data_migration_from_openstack_to_tofu security grouphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#security_group See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/OpenTofu#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07#WDQS_graph_splitting Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07#Search_Update_Pipeline Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07#Search_Metrics Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-07#Misc https://wikitech.wikimedia.org/wiki/Ratelimit ratelimit is a service running on wikikube clusters, it consists of the envoy ratelimit service connected to redis misc via nutcracker. Componentshttps://wikitech.wikimedia.org/wiki/Ratelimit#Components Configurationhttps://wikitech.wikimedia.org/wiki/Ratelimit#Configuration Enable/opt in to rate limitinghttps://wikitech.wikimedia.org/wiki/Ratelimit#Enable/opt_in_to_rate_limiting Test changeshttps://wikitech.wikimedia.org/wiki/Ratelimit#Test_changes See alsohttps://wikitech.wikimedia.org/wiki/Ratelimit#See_also https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/06 ==Week of June 03== Week of June 03https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/06#Week_of_June_03 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/06#=== Week of June 10https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/06#Week_of_June_10 Week of June 17https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/06#Week_of_June_17 Week of June 24https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/06#Week_of_June_24 https://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-10_puppet_volatile_data_broken_sync#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup Origin task: [of the decision: 2024-06-06 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Decision_taken Starting workgroup members (alphabetical order)https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Starting_workgroup_members_(alphabetical_order) Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Constraints_and_risks Extra infohttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Extra_info Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T363683_kubernetes_upgrade_workgroup#Option_2 https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup = Toolforge Upgrade Workgroup = Toolforge Upgrade Workgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup#Toolforge_Upgrade_Workgroup Abouthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup#About Backgroundhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup#Background Current membershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup#Current_members https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview = Toolforge Upgrade Workgroup = Toolforge Upgrade Workgrouphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview#Toolforge_Upgrade_Workgroup Upgrades Overviewhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview#Upgrades_Overview Extra infohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview#Extra_info Upgrade tasks and major changeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview#Upgrade_tasks_and_major_changes https://wikitech.wikimedia.org/wiki/AQS_2.0/CommonsImpactAnalytics https://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-11_WMCS_Ceph#Scorecard https://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#What_went_poorly? Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-12_WMCS_toolforge_k8s_control_plane#Scorecard https://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Decision_log The goal of this page is to encourage Data Platform Engineering teams to make use of quick decision logs to document decisions they are making. Data Platform Engineering Decision Loghttps://wikitech.wikimedia.org/wiki/Data_Platform_Engineering/Decision_log#Data_Platform_Engineering_Decision_Log https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14#WDQS_graph_splitting Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14#Search_Metrics Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-14#Misc https://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-05-31_Image_hotlinking#Scorecard https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration = Elasticsearch Administration = Elasticsearch Administrationhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Elasticsearch_Administration This page is only for Search Platform-owned Elasticsearch environments. For higher-level documentation and emergency contacts, see this page .https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#This_page_is_only_for_Search_Platform-owned_Elasticsearch_environments._For_higher-level_documentation_and_emergency_contacts,_see_this_page_. Deploymenthttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Deployment Config managementhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Config_management Clusters (chi, psi, omega)https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Clusters_(chi,_psi,_omega) Deployment Environments (codfw, eqiad, cloudelastic, relforge)https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Deployment_Environments_(codfw,_eqiad,_cloudelastic,_relforge) Alerts/Dashboardshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Alerts/Dashboards Dashboardshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Dashboards Operationshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Operations General Health Checks (and what they mean)https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#General_Health_Checks_(and_what_they_mean) Hardware failureshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Hardware_failures Rolling restartshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Rolling_restarts Replacing master-eligibleshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Replacing_master-eligibles Banning nodes from the clusterhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Banning_nodes_from_the_cluster Recovering from an Elasticsearch outage/interruption in updateshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Recovering_from_an_Elasticsearch_outage/interruption_in_updates Primary shard lost, replica shard considered outdatedhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Primary_shard_lost,_replica_shard_considered_outdated Cluster Quorum Loss Recovery Procedurehttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Cluster_Quorum_Loss_Recovery_Procedure Adding new masters/removing old mastershttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Adding_new_masters/removing_old_masters Adding new nodeshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Adding_new_nodes Decommissioning Nodes (Non-masters)https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Decommissioning_Nodes_(Non-masters) Deploying Debian Packageshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Deploying_Debian_Packages Deploying pluginshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Deploying_plugins Backup and Restorehttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Backup_and_Restore Via Elastic S3 Snapshot Repository Pluginhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Via_Elastic_S3_Snapshot_Repository_Plugin Inspecting logshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Inspecting_logs Elasticsearch logshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Elasticsearch_logs Using jstack or jmap or other similar tools to view logshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Using_jstack_or_jmap_or_other_similar_tools_to_view_logs Multi-DC / Multi-Cluster Operationshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Multi-DC_/_Multi-Cluster_Operations Read Operationshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Read_Operations Write Operationshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Write_Operations DC Switchhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#DC_Switch Removing Duplicate Indiceshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Removing_Duplicate_Indices Rebalancing shards to even out disk space usehttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Rebalancing_shards_to_even_out_disk_space_use Why?https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Why? Keep an eye on the number of indices on a few nodeshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Keep_an_eye_on_the_number_of_indices_on_a_few_nodes Elasticsearch Curatorhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Elasticsearch_Curator Explain unallocated shardshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Explain_unallocated_shards Anti-affinity (shards limit) prevents shards from assignmenthttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Anti-affinity_(shards_limit)_prevents_shards_from_assignment Shards stuck in recoveryhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Shards_stuck_in_recovery No updateshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#No_updates Stuck in old GC hellhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Stuck_in_old_GC_hell CirrusSearch full_text eqiad 95th percentilehttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#CirrusSearch_full_text_eqiad_95th_percentile Pool Counter rejections (search is currently too busy)https://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Pool_Counter_rejections_(search_is_currently_too_busy) Indexing hung and not making progresshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Indexing_hung_and_not_making_progress Possible cause: Nodes hunghttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Possible_cause:_Nodes_hung Another possible cause: Node bannedhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Another_possible_cause:_Node_banned Deploying Elasticsearch config (.yml/jvm) changeshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Deploying_Elasticsearch_config_(.yml/jvm)_changes CirrusSearch titlesuggest index is too oldhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#CirrusSearch_titlesuggest_index_is_too_old Other elasticsearch clientshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Other_elasticsearch_clients Constraints on elasticsearch clientshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Constraints_on_elasticsearch_clients Pathological Queries and the Tasks APIhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Pathological_Queries_and_the_Tasks_API Performance, Stability, and Fault Tolerance at the Elastic layerhttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Performance,_Stability,_and_Fault_Tolerance_at_the_Elastic_layer Tuning shard countshttps://wikitech.wikimedia.org/wiki/Search/Elasticsearch_Administration#Tuning_shard_counts https://wikitech.wikimedia.org/wiki/Search/CirrusSearch = CirrusSearch = CirrusSearchhttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#CirrusSearch Configurationhttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Configuration Local Buildhttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Local_Build Logginghttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Logging Via Logstashhttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Via_Logstash Via Logging Hostshttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Via_Logging_Hosts CirrusSearch Indexinghttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#CirrusSearch_Indexing Adding new wikishttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Adding_new_wikis Create the indexhttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Create_the_index Populate the search indexhttps://wikitech.wikimedia.org/wiki/Search/CirrusSearch#Populate_the_search_index https://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater = Cirrus Streaming Updater = Cirrus Streaming Updaterhttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Cirrus_Streaming_Updater Backfillinghttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Backfilling San(e)itizinghttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#San(e)itizing Troubleshooting the Streaming Updaterhttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Troubleshooting_the_Streaming_Updater Warning: Obsolete Documentationhttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Warning:_Obsolete_Documentation Realtime updateshttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Realtime_updates Batch updates from the databasehttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Batch_updates_from_the_database Scheduled batch updates from analytics networkhttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Scheduled_batch_updates_from_analytics_network Saneitizer (background repair process)https://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Saneitizer_(background_repair_process) Autocomplete indiceshttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Autocomplete_indices Job queuehttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Job_queue Primary update jobshttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Primary_update_jobs Secondary update jobshttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Secondary_update_jobs Backend write jobshttps://wikitech.wikimedia.org/wiki/Search/CirrusStreamingUpdater#Backend_write_jobs https://wikitech.wikimedia.org/wiki/Data_Platform/AQS Analytics Query Service (AQS) is a set of services that provide public-facing APIs that serve analytics data about Wikimedia projects, such as page views, unique devices, and editor counts. AQS APIs provide the data behind Wikistats (stats. User documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS#User_documentation Maintainer documentationhttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS#Maintainer_documentation Studies and data analyseshttps://wikitech.wikimedia.org/wiki/Data_Platform/AQS#Studies_and_data_analyses https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-21 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-21#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-21#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-21#WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-21#Misc https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyServerDown This happens when one of the haproxy servers is down from that haproxy instance (one of the hosts haproxy redirects too, not to be confused with the haproxy server itself). Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyServerDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyServerDown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyServerDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyServerDown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyServerDown#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyUnknown This happens when prometheus has no data from haproy on the server status (server_up). Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyUnknown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyUnknown#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyUnknown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyUnknown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesHAproxyUnknown#Old_incidents https://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Debian-installer This page collects various relevant information around our use of the Debian installer. Updating the netboot imagehttps://wikitech.wikimedia.org/wiki/SRE/Infrastructure_Foundations/Debian-installer#Updating_the_netboot_image https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide The purpose of this guide is to help you write an OpenAPI specification for services and endpoints in a way that's consistent with existing specs. Service titlehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Service_title Service descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Service_description Service - other fieldshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Service_-_other_fields Endpoint summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Endpoint_summary Endpoint descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Endpoint_description Endpoint - request parametershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Endpoint_-_request_parameters Response propertieshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/AQS/OpenAPI_spec_style_guide#Response_properties https://wikitech.wikimedia.org/wiki/MariaDB/PII = Sanitize the Wiki Data = Sanitize the Wiki Datahttps://wikitech.wikimedia.org/wiki/MariaDB/PII#Sanitize_the_Wiki_Data Run the Private Data Check Scripthttps://wikitech.wikimedia.org/wiki/MariaDB/PII#Run_the_Private_Data_Check_Script Verify Changes on Each clouddb Replicahttps://wikitech.wikimedia.org/wiki/MariaDB/PII#Verify_Changes_on_Each_clouddb_Replica Grant Permissions for SQL Viewshttps://wikitech.wikimedia.org/wiki/MariaDB/PII#Grant_Permissions_for_SQL_Views Create the View Databasehttps://wikitech.wikimedia.org/wiki/MariaDB/PII#Create_the_View_Database Notify Relevant Teamshttps://wikitech.wikimedia.org/wiki/MariaDB/PII#Notify_Relevant_Teams https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting === On demand performance testing === On demand performance testinghttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting#On_demand_performance_testing Servershttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting#Servers The queuehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting#The_queue The Databasehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting#The_Database The GUIhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting#The_GUI The test runnerhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting#The_test_runner https://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL A process has begun to migrate wikitech.wikimedia. What you need to dohttps://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#What_you_need_to_do What is changinghttps://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#What_is_changing Account migration detailshttps://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#Account_migration_details FAQhttps://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#FAQ Will my Wikitech user name change?https://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#Will_my_Wikitech_user_name_change? Will my Developer account user name or shell account name change?https://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#Will_my_Developer_account_user_name_or_shell_account_name_change? Will my logins to Cloud VPS, Toolforge, Horizon, Gerrit, GitLab, Phabricator change?https://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#Will_my_logins_to_Cloud_VPS,_Toolforge,_Horizon,_Gerrit,_GitLab,_Phabricator_change? How will I manage the password, email address, ssh keys, etc of my Developer account after the SUL migration?https://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#How_will_I_manage_the_password,_email_address,_ssh_keys,_etc_of_my_Developer_account_after_the_SUL_migration? When will the SUL migration happen?https://wikitech.wikimedia.org/wiki/News/Migrating_Wikitech_Account_to_SUL#When_will_the_SUL_migration_happen? https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-28 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-28#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-28#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-28#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-28#WDQS_graph_splitting Other workhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-06-28#Other_work https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81 == 2024-06-15 == 2024-06-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-15 2024-06-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-14 2024-06-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-13 2024-06-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-12 2024-06-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-11 2024-06-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-10 2024-06-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-09 2024-06-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-08 2024-06-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-07 2024-06-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-06 2024-06-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-05 2024-06-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-04 2024-06-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-03 2024-06-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-02 2024-06-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#2024-06-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_81#Other_archives https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82 == 2024-06-30 == 2024-06-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-30 2024-06-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-29 2024-06-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-28 2024-06-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-27 2024-06-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-26 2024-06-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-25 2024-06-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-24 2024-06-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-23 2024-06-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-22 2024-06-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-21 2024-06-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-20 2024-06-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-19 2024-06-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-18 2024-06-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-17 2024-06-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#2024-06-16 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_82#Other_archives https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/SearchKit = Accidentally deleting a SearchKit = Accidentally deleting a SearchKithttps://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/SearchKit#Accidentally_deleting_a_SearchKit add things!https://wikitech.wikimedia.org/wiki/Fundraising/Internal-facing/CiviCRM/SearchKit#add_things! https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno This page contains runbooks for dealing with Kyverno problems. What happens if Kyverno is down or if no Kyverno policies are present or they are not READYhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#What_happens_if_Kyverno_is_down_or_if_no_Kyverno_policies_are_present_or_they_are_not_READY How to fix ithttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#How_to_fix_it How to remove Kyverno from the hot path (don't do this unless extreme emergency)https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#How_to_remove_Kyverno_from_the_hot_path_(don't_do_this_unless_extreme_emergency) Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Error_/_Incident Toolforge Kyverno unknown statehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Toolforge_Kyverno_unknown_state Toolforge Kyverno low policy resourceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Toolforge_Kyverno_low_policy_resources Toolforge Kyverno no policy resourceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Toolforge_Kyverno_no_policy_resources Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Debugging How to see state of Kyverno podshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#How_to_see_state_of_Kyverno_pods How to see the state of maintain-kubeusershttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#How_to_see_the_state_of_maintain-kubeusers How to see the policy resourceshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#How_to_see_the_policy_resources Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno#Old_incidents https://wikitech.wikimedia.org/wiki/Portal:Toolforge/ |hideredirects=1|stripprefix=1}} https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes = Toolforge Kubernetes 1.25 upgrade = Toolforge Kubernetes 1.25 upgradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#Toolforge_Kubernetes_1.25_upgrade prephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#prep control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#control_nodes tools-k8s-control-7https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#tools-k8s-control-7 tools-k8s-control-8https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#tools-k8s-control-8 tools-k8s-control-9https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#tools-k8s-control-9 worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#worker_nodes ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#ingress_nodes cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.24_to_1.25_notes#cleanup https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-06-25 == Attendees == Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-06-25#Attendees Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-06-25#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-06-25#Notes Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-06-25#Action_items https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-05 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-05#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-05#What_we've_accomplished Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-05#Search_Update_Pipeline Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-05#Improve_multilingual_zero-results_rate Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-05#Misc https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Toolforge_Kyverno_unknown_state See Portal:Toolforge/Admin/Runbooks/Kyverno https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Toolforge_Kyverno_low_policy_resources See Portal:Toolforge/Admin/Runbooks/Kyverno https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Toolforge_Kyverno_no_policy_resources See Portal:Toolforge/Admin/Runbooks/Kyverno https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07 ==Week of July 01== Week of July 01https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07#Week_of_July_01 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07#=== Week of July 08https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07#Week_of_July_08 Week of July 15https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07#Week_of_July_15 Week of July 22https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07#Week_of_July_22 Week of July 29https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/07#Week_of_July_29 https://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/PSP_replacement So your Kubernetes cluster needs to be migrated off of Pod Security Policies (PSP) to Pod Security Standards (PSS)? Verify the current cluster statehttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/PSP_replacement#Verify_the_current_cluster_state Disable mutating parts of the restricted PSPhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/PSP_replacement#Disable_mutating_parts_of_the_restricted_PSP Enforce the restricted PSShttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/PSP_replacement#Enforce_the_restricted_PSS Disable PSPs in your clusterhttps://wikitech.wikimedia.org/wiki/Kubernetes/Clusters/PSP_replacement#Disable_PSPs_in_your_cluster https://wikitech.wikimedia.org/wiki/Thorium Used for some analytics tooling in the past. Seems to have been replaced by an-web1001 (T285355). Archivehttps://wikitech.wikimedia.org/wiki/Category:Archive https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gravy == Overview == Overviewhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gravy#Overview More content herehttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gravy#More_content_here move the image downhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gravy#move_the_image_down Testinghttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/PSP_integrations/Gravy#Testing https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-12 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-12#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-12#What_we've_accomplished Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-12#Improve_multilingual_zero-results_rate WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-12#WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-12#Misc https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-07-09 === Attendees: === Attendees:https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-07-09#Attendees: Agenda:https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-07-09#Agenda: Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-07-09#Notes https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution Origin task: [of the decision: 2024-07-11 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Decision_taken Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Option_4 Option Nhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T362224_What_to_use_for_toolforge_components_api_task_execution#Option_N https://wikitech.wikimedia.org/wiki/Postfix = Troubleshooting = Troubleshootinghttps://wikitech.wikimedia.org/wiki/Postfix#Troubleshooting Metricshttps://wikitech.wikimedia.org/wiki/Postfix#Metrics Logshttps://wikitech.wikimedia.org/wiki/Postfix#Logs Queueshttps://wikitech.wikimedia.org/wiki/Postfix#Queues Show queueshttps://wikitech.wikimedia.org/wiki/Postfix#Show_queues Flush the mail queuehttps://wikitech.wikimedia.org/wiki/Postfix#Flush_the_mail_queue Deliver just one specific email from the queuehttps://wikitech.wikimedia.org/wiki/Postfix#Deliver_just_one_specific_email_from_the_queue Search for a specific email from a senderhttps://wikitech.wikimedia.org/wiki/Postfix#Search_for_a_specific_email_from_a_sender Search for a specific email to a recipienthttps://wikitech.wikimedia.org/wiki/Postfix#Search_for_a_specific_email_to_a_recipient Count number of emails to a specific recipienthttps://wikitech.wikimedia.org/wiki/Postfix#Count_number_of_emails_to_a_specific_recipient Remove emails to a specific recipienthttps://wikitech.wikimedia.org/wiki/Postfix#Remove_emails_to_a_specific_recipient View a message in the queuehttps://wikitech.wikimedia.org/wiki/Postfix#View_a_message_in_the_queue Configurationhttps://wikitech.wikimedia.org/wiki/Postfix#Configuration https://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-06-21_-_2024-06-24_Outage_Incidents_-_Dumps_Generation_Issues#Scorecard https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Organizational === What is the service? === What is the service?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Organizational#What_is_the_service? Who are the responsible teams?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Organizational#Who_are_the_responsible_teams? https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Architectural === What are the service's dependencies? === What are the service's dependencies?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Architectural#What_are_the_service's_dependencies? Hard and soft dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Architectural#Hard_and_soft_dependencies Direct dependencies and proxieshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Architectural#Direct_dependencies_and_proxies Indirect dependencieshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Architectural#Indirect_dependencies https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Client-facing === Who are the service's clients? === Who are the service's clients?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Client-facing#Who_are_the_service's_clients? What are the request classes?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Client-facing#What_are_the_request_classes? https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Service_level_indicators Service level indicators (SLIs) are the metrics you'll use to evaluate your service's performance. An example of an SLI is "Percentage of requests that receive a non-5xx response. https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Operational Every service experiences an outage sometimes, so the SLO should reflect its expected time to recovery. If the expected duration of a single outage exceeds the error budget, then the SLO reduces to "we promise not to make any mistakes. How is the service monitored?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Operational#How_is_the_service_monitored? How complex is the service to troubleshoot?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Operational#How_complex_is_the_service_to_troubleshoot? How is the service deployed?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Operational#How_is_the_service_deployed? https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Service_level_objectives The reporting period is the time interval over which you assess your service's performance against its SLO, and determine whether or not you met your objective. Although you'll continuously monitor your SLO, the binary success/failure result for the reporting period can be an input to your decisions about work prioritization: if you're already at risk of missing your SLO, you might delay risky deployments and focus on reliability improvements for the remainder of the period. Calculate the realistic targetshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Service_level_objectives#Calculate_the_realistic_targets Calculate the ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Service_level_objectives#Calculate_the_ideal_targets Sidebar: Why isn't the ideal target 100%?https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Service_level_objectives#Sidebar:_Why_isn't_the_ideal_target_100%? Reconcile the realistic vs. ideal targetshttps://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Service_level_objectives#Reconcile_the_realistic_vs._ideal_targets https://wikitech.wikimedia.org/wiki/SLO/Template_instructions/Finalizing Read over the whole document one more time. By now, all of the text highlighted in yellow should be gone; if any is left, you can clean it up (after making sure the instructions were followed). https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes = Toolforge Kubernetes 1.26 upgrade = Toolforge Kubernetes 1.26 upgradehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#Toolforge_Kubernetes_1.26_upgrade prephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#prep control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#control_nodes tools-k8s-control-7https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#tools-k8s-control-7 tools-k8s-control-8https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#tools-k8s-control-8 tools-k8s-control-9https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#tools-k8s-control-9 worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#worker_nodes ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#ingress_nodes cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.25_to_1.26_notes#cleanup https://wikitech.wikimedia.org/wiki/Mw-mcrouter This is the daemonset proxying all mediawiki memcached requests, to our memcached cluster. It is running the almighty mcrouter mcrouter image and exporterhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#mcrouter_image_and_exporter Daemonsethttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Daemonset Servicehttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Service values-eqiad.yamlhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#values-eqiad.yaml Deploymenthttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Deployment Testing changeshttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Testing_changes Switching Mediawiki to in-pod mcrouter containerhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Switching_Mediawiki_to_in-pod_mcrouter_container mw-debug/values-eqiad.yamlhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#mw-debug/values-eqiad.yaml Troubleshootinghttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Troubleshooting Memcached server is downhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Memcached_server_is_down Memcached Gutter Pool server is down, and we need the Gutter Poolhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Memcached_Gutter_Pool_server_is_down,_and_we_need_the_Gutter_Pool Deployment is stalledhttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Deployment_is_stalled Dashboardshttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Dashboards Linkshttps://wikitech.wikimedia.org/wiki/Mw-mcrouter#Links https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration/Evaluate_ESC_and_explore_an_alternative_design This page summarizes the learnings of https://phabricator.wikimedia. Stream Registryhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration/Evaluate_ESC_and_explore_an_alternative_design#Stream_Registry Overviewhttps://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration/Evaluate_ESC_and_explore_an_alternative_design#Overview https://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Algorithm This page describes the algorithm used by the Commons Impact Metrics data product to traverse the [category] graph. These slides are from a [given by [[mediawikiwiki:User:Mforns_(WMF)|Marcel Ruiz Forns] at the [Wikimedia Hackathon]. Because of these computational challenges, we set a couple of boundaries to the calculation.https://wikitech.wikimedia.org/wiki/Commons_Impact_Metrics/Algorithm#Because_of_these_computational_challenges,_we_set_a_couple_of_boundaries_to_the_calculation. https://wikitech.wikimedia.org/wiki/Phabricator/Mail_debugging For end-user management of mail, see [mail|mw:Phabricator/Help/Managing mail]. Command-line toolshttps://wikitech.wikimedia.org/wiki/Phabricator/Mail_debugging#Command-line_tools Database mail infohttps://wikitech.wikimedia.org/wiki/Phabricator/Mail_debugging#Database_mail_info https://wikitech.wikimedia.org/wiki/Search_Platform/Roles_and_Responsibilities Roles are not boundaries, don’t feel restricted by your role. Project Tech Leadhttps://wikitech.wikimedia.org/wiki/Search_Platform/Roles_and_Responsibilities#Project_Tech_Lead Software Engineerhttps://wikitech.wikimedia.org/wiki/Search_Platform/Roles_and_Responsibilities#Software_Engineer Computational Linguisthttps://wikitech.wikimedia.org/wiki/Search_Platform/Roles_and_Responsibilities#Computational_Linguist Engineering Managerhttps://wikitech.wikimedia.org/wiki/Search_Platform/Roles_and_Responsibilities#Engineering_Manager https://wikitech.wikimedia.org/wiki/SLO/EditCheck Status: draft Organizationalhttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Organizational Servicehttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Service Teamshttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Teams Architecturalhttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Architectural Environmental dependencieshttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Environmental_dependencies Service dependencieshttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Service_dependencies Client-facinghttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Client-facing Clientshttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Clients Request Classeshttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Request_Classes Service Level Indicators (SLIs)https://wikitech.wikimedia.org/wiki/SLO/EditCheck#Service_Level_Indicators_(SLIs) Operationalhttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Operational Monitoringhttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Monitoring Troubleshootinghttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Troubleshooting Deploymenthttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Deployment Service Level Objectiveshttps://wikitech.wikimedia.org/wiki/SLO/EditCheck#Service_Level_Objectives Realistic targets (reasonable worst case)https://wikitech.wikimedia.org/wiki/SLO/EditCheck#Realistic_targets_(reasonable_worst_case) Ideal targets (reasonable best case)https://wikitech.wikimedia.org/wiki/SLO/EditCheck#Ideal_targets_(reasonable_best_case) https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19#What_we've_accomplished Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19#Search_Update_Pipeline_/_Private_Wikis Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19#Search_Update_Pipeline WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19#WDQS_graph_splitting Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-19#Misc https://wikitech.wikimedia.org/wiki/Metrics_Platform/Decision_Records/Single_Table_Per_Base_Schema Status: ACCEPTED https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool Services provided via the Wikimedia Cloud Services infrastructure should respect the broad protections for end-user privacy that are provided in the Wikimedia production web environment. At the same time it should be possible to host tools with WMCS which interact with third-party services, especially when those services can be used to enhance or expand the Wikimedia free knowledge projects. Use caseshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Use_cases General constraintshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#General_constraints Workflowshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Workflows Normal requesthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Normal_request Consent redirecthttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Consent_redirect FAQshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#FAQs What can be done about the typical "POST loophole" for redirecting?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#What_can_be_done_about_the_typical_"POST_loophole"_for_redirecting? Can we audit who has granted consent?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Can_we_audit_who_has_granted_consent? Can folks see all tools that are requesting consent?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Can_folks_see_all_tools_that_are_requesting_consent? How can I see all tools that I have granted consent to?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#How_can_I_see_all_tools_that_I_have_granted_consent_to? How does a user revoke consent for a tool?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#How_does_a_user_revoke_consent_for_a_tool? Opt-in for robots?https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Third-party_interaction_consent_tool#Opt-in_for_robots? https://wikitech.wikimedia.org/wiki/Centrallog1001 centrallog1001.eqiad. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Logginghttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Logging Servershttps://wikitech.wikimedia.org/wiki/Category:Servers Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Centrallog1002 centrallog1002.eqiad. Eqiad data centerhttps://wikitech.wikimedia.org/wiki/Category:Eqiad_data_center Server status:Decommissionedhttps://wikitech.wikimedia.org/wiki/Category:Server_status:Decommissioned Server usage:Logginghttps://wikitech.wikimedia.org/wiki/Category:Server_usage:Logging Servershttps://wikitech.wikimedia.org/wiki/Category:Servers Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Distributed_tracing Distributed tracing starts with a single incoming request from a user, and tracks and records all the sub-queries issued between different microservices to handle that request. Enabling tracing for a servicehttps://wikitech.wikimedia.org/wiki/Distributed_tracing#Enabling_tracing_for_a_service More user-facing documentationhttps://wikitech.wikimedia.org/wiki/Distributed_tracing#More_user-facing_documentation Tutorial sub-page: how to read a tracehttps://wikitech.wikimedia.org/wiki/Distributed_tracing#Tutorial_sub-page:_how_to_read_a_trace External linkhttps://wikitech.wikimedia.org/wiki/Distributed_tracing#External_link https://wikitech.wikimedia.org/wiki/Otelcol prod Distributed tracinghttps://wikitech.wikimedia.org/wiki/Category:Distributed_tracing Stubshttps://wikitech.wikimedia.org/wiki/Category:Stubs https://wikitech.wikimedia.org/wiki/Jaeger prod External linkhttps://wikitech.wikimedia.org/wiki/Jaeger#External_link https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-26 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-26#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-26#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-26#WDQS_graph_splitting Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-26#Search_backend_replacement Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-07-26#Misc https://wikitech.wikimedia.org/wiki/Incidents/2024-07-21_s4_and_x1_write_overload == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-07-21_s4_and_x1_write_overload#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-07-21_s4_and_x1_write_overload#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-07-21_s4_and_x1_write_overload#Detection Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-07-21_s4_and_x1_write_overload#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-07-21_s4_and_x1_write_overload#Scorecard https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown The ToolsNFSDown alert fires when the nfs-service service is not running or not being found in the stats. Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#Debugging Check the service statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#Check_the_service_status If there's no statshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#If_there's_no_stats Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#Related_information Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNFSDown#Old_incidents https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83 == 2024-07-31 == 2024-07-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-31 2024-07-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-30 2024-07-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-29 2024-07-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-28 2024-07-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-27 2024-07-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-26 2024-07-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-25 2024-07-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-24 2024-07-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-23 2024-07-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-22 2024-07-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-21 2024-07-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-20 2024-07-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-19 2024-07-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-18 2024-07-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-17 2024-07-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-16 2024-07-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-15 2024-07-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-14 2024-07-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-13 2024-07-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-12 2024-07-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-11 2024-07-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-10 2024-07-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-09 2024-07-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-08 2024-07-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-07 2024-07-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-06 2024-07-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-05 2024-07-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-04 2024-07-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-03 2024-07-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-02 2024-07-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#2024-07-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_83#Other_archives https://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Database_schemas = Contributions civicrm_contributions = Contributions civicrm_contributionshttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Database_schemas#Contributions_civicrm_contributions Recurring Contribution civicrm_contribution_recurhttps://wikitech.wikimedia.org/wiki/Fundraising/Data_and_flow/Database_schemas#Recurring_Contribution_civicrm_contribution_recur https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG ==== What it is ==== What it ishttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG#What_it_is How we build ithttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG#How_we_build_it Where we run ithttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG#Where_we_run_it How we deploy ithttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG#How_we_deploy_it Clustershttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG#Clusters https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#WDQS_graph_splitting Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#Search_Update_Pipeline_/_Private_Wikis Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#Improve_multilingual_zero-results_rate Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#Search_backend_replacement FY 24-25 WE.3.1: Browsing & learning experienceshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#FY_24-25_WE.3.1:_Browsing_&_learning_experiences Vector based searchhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#Vector_based_search Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-02#Misc https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-07-19 * Progress made towards achieving the metric: https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-07-26 * Status: On Track https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-02 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-02#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-02#Update https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters Using the CloudnativePG operator, it becomes quite easy to deploy PostgreSQL clusters in Kubernetes. Observabilityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Observability Dashboardhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Dashboard Monitoringhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Monitoring Logshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Logs Operationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Operations Finding what instance is the current PG masterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Finding_what_instance_is_the_current_PG_master Performing a manual backuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Performing_a_manual_backup Restoring a backup by replaying all WAL fileshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Restoring_a_backup_by_replaying_all_WAL_files Performing a Point In Time Recovery (PITR)https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Performing_a_Point_In_Time_Recovery_(PITR) Increasing the storage size of a clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Increasing_the_storage_size_of_a_cluster Increasing the WAL storage size of a clusterhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Increasing_the_WAL_storage_size_of_a_cluster Increasing the max number of connections on PostgreSQLhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Increasing_the_max_number_of_connections_on_PostgreSQL Increasing the max number of client connections on PGBouncerhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Increasing_the_max_number_of_client_connections_on_PGBouncer Import data from an external databasehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Import_data_from_an_external_database Checking the status of the out-of-band backups of backupshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Checking_the_status_of_the_out-of-band_backups_of_backups Investigate why WALs are not being archivedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#Investigate_why_WALs_are_not_being_archived Referenceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/CloudnativePG/Clusters#References https://wikitech.wikimedia.org/wiki/Jaeger/Administration == Notes on our deployment == Notes on our deploymenthttps://wikitech.wikimedia.org/wiki/Jaeger/Administration#Notes_on_our_deployment Alert runbookhttps://wikitech.wikimedia.org/wiki/Jaeger/Administration#Alert_runbook Probe downhttps://wikitech.wikimedia.org/wiki/Jaeger/Administration#Probe_down https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08 == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#WDQS_graph_splitting Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#Search_Update_Pipeline_/_Private_Wikis Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#Improve_multilingual_zero-results_rate Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#Search_backend_replacement Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-08#Misc https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-08 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-08#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-08#Update https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/08 ==Week of August 05== Week of August 05https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/08#Week_of_August_05 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/08#=== Week of August 12https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/08#Week_of_August_12 Week of August 19https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/08#Week_of_August_19 Week of August 26https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/08#Week_of_August_26 https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test There are two ways to run performance test using QTE hardware: Monitor the performance over timehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Monitor_the_performance_over_time Add a page/URL to testhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Add_a_page/URL_to_test Add a user journeyhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Add_a_user_journey Run one off testshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Run_one_off_tests Using WebPageReplayhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Using_WebPageReplay Using Mann Whitney Uhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Using_Mann_Whitney_U Add a label to your testhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Add_a_label_to_your_test Finding testshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Run_a_test#Finding_tests https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Normalize_a_DAG This will serve as a guide to take an existing DAG and update it with the latest Best Practices of our Airflow Platform. Setting up Developer Environmenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Normalize_a_DAG#Setting_up_Developer_Environment Create your branchhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Normalize_a_DAG#Create_your_branch Testing the DAGhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Normalize_a_DAG#Testing_the_DAG PYTESThttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Normalize_a_DAG#PYTEST Check Datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Normalize_a_DAG#Check_Data https://wikitech.wikimedia.org/wiki/Catalyst/Decision_log https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Start Distributed tracing starts with a single incoming request from a user, and tracks and records all the sub-queries issued between different microservices to handle that higher-level request. Introductionhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Start#Introduction Reading a first example tracehttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Start#Reading_a_first_example_trace Next uphttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Start#Next_up Footnoteshttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Start#Footnotes https://wikitech.wikimedia.org/wiki/Distributed_tracing/Propagating_tracing_context = How to make distributed tracing work for your service = How to make distributed tracing work for your servicehttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Propagating_tracing_context#How_to_make_distributed_tracing_work_for_your_service General applicabilityhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Propagating_tracing_context#General_applicability Context propagation requirementshttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Propagating_tracing_context#Context_propagation_requirements Easy ways to implementhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Propagating_tracing_context#Easy_ways_to_implement References & footnoteshttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Propagating_tracing_context#References_&_footnotes https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1 = Things we ship = Things we shiphttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Things_we_ship WDQS Split the Graphhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#WDQS_Split_the_Graph Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Improve_multilingual_zero-results_rate Reduce Wikidata search lag on editshttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Reduce_Wikidata_search_lag_on_edits Migrate Private wikis to the new Search Update Pipelinehttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Migrate_Private_wikis_to_the_new_Search_Update_Pipeline Support WE3.1https://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Support_WE3.1 Convert Graphite metrics to Prometheushttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Convert_Graphite_metrics_to_Prometheus Things we planhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Things_we_plan OpenSearch Migrationhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#OpenSearch_Migration Define use cases for vector based searchhttps://wikitech.wikimedia.org/wiki/Search_Platform/Goals/OKR_2024-2025_Q1#Define_use_cases_for_vector_based_search https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor maintain-harbor is a toolforge tool used to perform house-keeping tasks on our Harbor installation. Currently, these house-keeping tasks include: Key conceptshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Key_concepts Harbor Tool projectshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Harbor_Tool_projects Harbor image retention policieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Harbor_image_retention_policies Harbor Image Immutability policieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Harbor_Image_Immutability_policies Delete harbor tool projects with no repositorieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Delete_harbor_tool_projects_with_no_repositories Create or update Harbor tool project's image retention policyhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Create_or_update_Harbor_tool_project's_image_retention_policy Stale harbor image cleanup for core Toolforge repositorieshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Stale_harbor_image_cleanup_for_core_Toolforge_repositories How it's setuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#How_it's_setup Common taskshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Common_tasks Deploy maintain-harborhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Deploy_maintain-harbor Checking maintain-harbor statushttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Checking_maintain-harbor_status Stopping and starting the maintain-harbor jobshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Stopping_and_starting_the_maintain-harbor_jobs Checking the logshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Checking_the_logs Manual executionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Harbor/maintain-harbor#Manual_execution https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInUnknown We are not getting metrics from the ceph cluster, it might or might not be running. Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInUnknown#Debugging Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInUnknown#Support_contacts Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInUnknown#Related_information Example taskshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInUnknown#Example_tasks https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-15 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-15#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-15#Update https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-16 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-16#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-16#What_we've_accomplished Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-16#Search_Update_Pipeline_/_Private_Wikis Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-16#Misc https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap == Context == Contexthttps://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Context Project Roadmaphttps://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Project_Roadmap Globalhttps://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Global Goalshttps://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Goals Success Metrics:https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Success_Metrics: Q1-FY2024/2025https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Q1-FY2024/2025 Success Metric Targetshttps://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Success_Metric_Targets Q2-FY2024/2025https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Q2-FY2024/2025 Q3-FY2024/2025https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Q3-FY2024/2025 Q4-FY2024/2025https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Q4-FY2024/2025 Relevant linkshttps://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap#Relevant_links https://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list This page lists active Metrics Platform instruments and related documentation.Search for metrics_platform_client on [For information about how to use this page, see the [[Metrics_Platform/How_to/Create_First_Metrics_Platform_Instrument#Document_the_instrument|guide to creating an instrument]. <Instrument name>https://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list# Android link previewhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Android_link_preview Android table of contentshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Android_table_of_contents Android toolbarhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Android_toolbar Android find in pagehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Android_find_in_page Click-tracking for Vector and Minervahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Click-tracking_for_Vector_and_Minerva Scroll-tracking for Vectorhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Scroll-tracking_for_Vector Wikibase clienthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Wikibase_client Wikifunctions UI actionshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Wikifunctions_UI_actions WikiLambda APIhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#WikiLambda_API MinT for readershttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#MinT_for_readers Community updateshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#Community_updates Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Instrument_list#References https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-22 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-22#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-22#Update https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#WDQS_graph_splitting Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#Search_Update_Pipeline_/_Private_Wikis Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#Improve_multilingual_zero-results_rate Vector based searchhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#Vector_based_search Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-23#Misc https://wikitech.wikimedia.org/wiki/Chart_renderer == Beta == Betahttps://wikitech.wikimedia.org/wiki/Chart_renderer#Beta Instance detailshttps://wikitech.wikimedia.org/wiki/Chart_renderer#Instance_details Accesshttps://wikitech.wikimedia.org/wiki/Chart_renderer#Access Service healthhttps://wikitech.wikimedia.org/wiki/Chart_renderer#Service_health Troubleshootinghttps://wikitech.wikimedia.org/wiki/Chart_renderer#Troubleshooting Linkshttps://wikitech.wikimedia.org/wiki/Chart_renderer#Links https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Incident https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-29 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-29#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-08-29#Update https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#WDQS_graph_splitting Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#Search_Update_Pipeline_/_Private_Wikis Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#Improve_multilingual_zero-results_rate Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#Search_Metrics Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-08-30#Misc https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84 == 2024-08-31 == 2024-08-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-31 2024-08-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-30 2024-08-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-29 2024-08-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-28 2024-08-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-27 2024-08-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-26 2024-08-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-25 2024-08-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-24 2024-08-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-23 2024-08-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-22 2024-08-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-21 2024-08-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-20 2024-08-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-19 2024-08-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-18 2024-08-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-17 2024-08-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-16 2024-08-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-15 2024-08-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-14 2024-08-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-13 2024-08-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-12 2024-08-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-11 2024-08-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-10 2024-08-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-09 2024-08-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-08 2024-08-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-07 2024-08-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-06 2024-08-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-05 2024-08-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-04 2024-08-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-03 2024-08-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-02 2024-08-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#2024-08-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_84#Other_archives https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas This page contained a detailed explanation of how data flows from the production databases to Wiki Replicas and how data redaction is performed. Step 0: databases in productionhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_0:_databases_in_production Step 1: sanitizationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_1:_sanitization Step 2: evaluationhttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_2:_evaluation Step 3: filling up wiki-replicashttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_3:_filling_up_wiki-replicas Step 4: setting up GRANTshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_4:_setting_up_GRANTs Step 5: setting indexeshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_5:_setting_indexes Step 6: setting viewshttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_6:_setting_views Step 7: setting up metadatahttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_7:_setting_up_metadata Step 8: setting up DNShttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_8:_setting_up_DNS Step 9: all is donehttps://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/From_production_to_Wiki_Replicas#Step_9:_all_is_done https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes Working etherpad: Prepare packageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#Prepare_packages Toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#Toolsbeta prephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#prep control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#control_nodes toolsbeta-test-k8s-control-10https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#toolsbeta-test-k8s-control-10 toolsbeta-test-k8s-control-11https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#toolsbeta-test-k8s-control-11 toolsbeta-test-k8s-control-12https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#toolsbeta-test-k8s-control-12 worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#worker_nodes ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#ingress_nodes cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#cleanup Toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#Tools tools-k8s-control-7https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#tools-k8s-control-7 tools-k8s-control-8https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#tools-k8s-control-8 tools-k8s-control-9https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.26_to_1.27_notes#tools-k8s-control-9 https://wikitech.wikimedia.org/wiki/Requestctl/Overview This page explains the basic concepts behind how the requestctl tool manages configuration to control access and routing of web requests. Overview of http request control configurationhttps://wikitech.wikimedia.org/wiki/Requestctl/Overview#Overview_of_http_request_control_configuration How requestctl modifies configurationhttps://wikitech.wikimedia.org/wiki/Requestctl/Overview#How_requestctl_modifies_configuration Related documentationhttps://wikitech.wikimedia.org/wiki/Requestctl/Overview#Related_documentation https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#What_we've_accomplished WDQS Graph Splithttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#WDQS_Graph_Split Search Update Pipeline / Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#Search_Update_Pipeline_/_Private_Wikis Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#Improve_multilingual_zero-results_rate Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#Search_backend_replacement Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-06#Misc https://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC Metrics Platform Instrument Configuration (MPIC) is an instrument and experiment management system. The application enables product teams to set up, manage, and configure various instruments for data collection and experimentation. Base stream configurationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC#Base_stream_configuration Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC#References https://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC/Administration Metrics Platform Instrument Configuration (MPIC) is an instrument and experiment management system. The application enables product teams to set up, manage, and configure various instruments for data collection and experimentation. Service detailshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC/Administration#Service_details Deploymenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC/Administration#Deployment Troubleshootinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC/Administration#Troubleshooting Check podshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC/Administration#Check_pods See logshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/MPIC/Administration#See_logs https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Backy2 We are using Backy2 to back up Ceph volumes: VM images, Cinder volumes, and Glance images. Backy2 is designed for fast, incremental backups of rbd volumes and uses deduplication to minimize disk space. Cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Backy2#Cleanup Restoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Backy2#Restoring Handy commandshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Backy2#Handy_commands Future concernshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Backy2#Future_concerns https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinder_backups Most cinder and glance volumes hosted are backed up every day or two, with backups preserved for a few days. Architecturehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinder_backups#Architecture What is backed uphttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinder_backups#What_is_backed_up Restoringhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinder_backups#Restoring Restoring after 'openstack server delete'https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinder_backups#Restoring_after_'openstack_server_delete' Restoring a lost Glance imagehttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinder_backups#Restoring_a_lost_Glance_image https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-06 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-06#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-06#Update https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09 ==Week of September 02== Week of September 02https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09#Week_of_September_02 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09#=== Week of September 09https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09#Week_of_September_09 Week of September 16https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09#Week_of_September_16 Week of September 23https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09#Week_of_September_23 Week of September 30https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/09#Week_of_September_30 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-13 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-13#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-13#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-13#WDQS_graph_splitting Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-13#Search_backend_replacement Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-13#Misc https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/IPv6/initial_deploy This page tracks project information for the initial IPv6 deployment in Cloud VPS. Implementation detailshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/IPv6/initial_deploy#Implementation_details Loghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/IPv6/initial_deploy#Log See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/IPv6/initial_deploy#See_also https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-13 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-13#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-13#Update https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration Wikitech's authentication backend will be switched from LDAP to Wikimedia Unified Login (SUL); decoupling your Wikimedia Developer Account (LDAP) from Wikitech. Why?https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#Why? How?https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#How? Phase 1https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#Phase_1 Phase 2https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#Phase_2 Phase 3https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#Phase_3 What You Should Dohttps://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#What_You_Should_Do My Wikimedia Developer Account username matches my Wikimedia Unified Login (SUL) username!https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#My_Wikimedia_Developer_Account_username_matches_my_Wikimedia_Unified_Login_(SUL)_username! My Wikimedia Developer Account username is different from my Wikimedia Unified Login (SUL) one.https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#My_Wikimedia_Developer_Account_username_is_different_from_my_Wikimedia_Unified_Login_(SUL)_one. I have followed the instructions, but I am still having issues.https://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#I_have_followed_the_instructions,_but_I_am_still_having_issues. Noteshttps://wikitech.wikimedia.org/wiki/Wikitech/SUL-migration#Notes https://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-16_logstash_unavailability#Scorecard https://wikitech.wikimedia.org/wiki/Phabricator/T373952 {| class="wikitable" https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes This page relates specifically to our Airflow instances deployed to Kubernetes, and their specificity. We assume that the airflow instance is deployed alongside a dedicated CloudnativePG cluster, running in the same namespace. Architecturehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Architecture Componentshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Components Executorhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Executor DAGs deploymenthttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#DAGs_deployment Logginghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Logging Securityhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Security Webserver authentication and authorizationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Webserver_authentication_and_authorization API accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#API_access Kerberoshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Kerberos Kubernetes RBAChttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Kubernetes_RBAC UNIX user impersonationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#UNIX_user_impersonation Database accesshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Database_access Connections and variableshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Connections_and_variables Management DAGshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Management_DAGs Operationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Operations Creating a new instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Creating_a_new_instance Migrating an existing instancehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Migrating_an_existing_instance Migrating the webserver to Kuberneteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Migrating_the_webserver_to_Kubernetes Prep workhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Prep_work Defining a secret key shared between the scheduler and the webserverhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Defining_a_secret_key_shared_between_the_scheduler_and_the_webserver Defining the webserver configurationhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Defining_the_webserver_configuration Setup the ATS directionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Setup_the_ATS_direction Stop the webserver systemd servicehttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Stop_the_webserver_systemd_service Migrate the scheduler and kerberos components to Kuberneteshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Migrate_the_scheduler_and_kerberos_components_to_Kubernetes Deploy a CloudnativePG cluster in the name Kubernetes namespace than Airlow and import the datahttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Deploy_a_CloudnativePG_cluster_in_the_name_Kubernetes_namespace_than_Airlow_and_import_the_data Cleanuphttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Cleanup Configuring out-of-band backupshttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Configuring_out-of-band_backups Upgrading Airflowhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Upgrading_Airflow I'm getting pagedhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#I'm_getting_paged Pods are not runninghttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Pods_are_not_running How tohttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#How_to Use the airflow CLIhttps://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Kubernetes#Use_the_airflow_CLI https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes === Attributes === Attributeshttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Attributes Exploring Attributes in the Jaeger UIhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Exploring_Attributes_in_the_Jaeger_UI Accessing the Attributes Panelhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Accessing_the_Attributes_Panel Operation and Timinghttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Operation_and_Timing Attributes Overviewhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Attributes_Overview HTTP Attributeshttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#HTTP_Attributes Visual Demo - Expanding Attributes (click to play)https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Visual_Demo_-_Expanding_Attributes_(click_to_play) Filtering and Searching Attributeshttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Filtering_and_Searching_Attributes Next uphttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Exploring_attributes#Next_up https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Reading_complex_traces === Traces as documentation === Traces as documentationhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Reading_complex_traces#Traces_as_documentation Serial vs parallelhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Reading_complex_traces#Serial_vs_parallel Multiple hops in the service meshhttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Reading_complex_traces#Multiple_hops_in_the_service_mesh Next uphttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Reading_complex_traces#Next_up https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Searching === Next up === Next uphttps://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Searching#Next_up https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial Distributed tracing tutorial https://wikitech.wikimedia.org/wiki/Distributed_tracing/Tutorial/Instrumenting_your_own_application 5 Distributed tracing tutorialhttps://wikitech.wikimedia.org/wiki/Category:Distributed_tracing_tutorial https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins The term Cloud root is used to describe someone with root permissions on WMCS servers. The term Cloud admin is used to describe someone with admin permissions on Cloud VPS. Root access to bare metal Cloud VPS hostshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Root_access_to_bare_metal_Cloud_VPS_hosts Root access from cloudcumin hostshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Root_access_from_cloudcumin_hosts Root access to Cloud VPS vmshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Root_access_to_Cloud_VPS_vms Puppetless vmshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Puppetless_vms virsh console accesshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#virsh_console_access OpenStack administrator privilegeshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#OpenStack_administrator_privileges Wikireplicas roothttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Wikireplicas_root Wikireplicas adminshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Wikireplicas_admins Cloud-admin mailing listhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#Cloud-admin_mailing_list #wmcs-cloud-admin IRC channelhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins##wmcs-cloud-admin_IRC_channel See alsohttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cloud_roots_and_Cloud_admins#See_also https://wikitech.wikimedia.org/wiki/IDM/Account_Blocking Trusted administrators (select stewards and SREs) are allowed to block user account via the Bitu IDM. Command linehttps://wikitech.wikimedia.org/wiki/IDM/Account_Blocking#Command_line Web UIhttps://wikitech.wikimedia.org/wiki/IDM/Account_Blocking#Web_UI https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20#What_we've_accomplished WDQS graph splittinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20#WDQS_graph_splitting Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20#Improve_multilingual_zero-results_rate Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20#Search_Metrics Misc / Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-20#Misc_/_Operations https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-20 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-20#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-20#Update https://wikitech.wikimedia.org/wiki/GitLab/Abuse_and_rate_limiting This page summarizes the available tools against abuse and rate limiting bots/scraping. Account approvals and blockinghttps://wikitech.wikimedia.org/wiki/GitLab/Abuse_and_rate_limiting#Account_approvals_and_blocking Malicious traffic pattern ("scraping")https://wikitech.wikimedia.org/wiki/GitLab/Abuse_and_rate_limiting#Malicious_traffic_pattern_("scraping") Throttling using nftableshttps://wikitech.wikimedia.org/wiki/GitLab/Abuse_and_rate_limiting#Throttling_using_nftables Blocked netshttps://wikitech.wikimedia.org/wiki/GitLab/Abuse_and_rate_limiting#Blocked_nets Blocking using apache confighttps://wikitech.wikimedia.org/wiki/GitLab/Abuse_and_rate_limiting#Blocking_using_apache_config https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03 == Attendees == Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03#Attendees Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03#Notes login-buster bastionhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03#login-buster_bastion k8s upgrade workgroup progresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03#k8s_upgrade_workgroup_progress Action itemshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-09-03#Action_items https://wikitech.wikimedia.org/wiki/Ceph/Cephadm Cephadm is Ceph's new approach to cluster deployment and management, where all the Ceph daemons are deployed in containers. This page documents how Cephadm is used at WMF. Interacting with the clusterhttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Interacting_with_the_cluster S3 / Ceph Object Gatewayhttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#S3_/_Ceph_Object_Gateway Disk Failurehttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Disk_Failure Cephadm Configurationhttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Cephadm_Configuration Cluster info in hierahttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Cluster_info_in_hiera Image Buildinghttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Image_Building Bootstrapping a Clusterhttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Bootstrapping_a_Cluster Set Up Master Zonehttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Set_Up_Master_Zone Set Up Secondary Zonehttps://wikitech.wikimedia.org/wiki/Ceph/Cephadm#Set_Up_Secondary_Zone https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-27 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-27#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-27#What_we've_accomplished WDQS Graph Splithttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-27#WDQS_Graph_Split Mischttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-09-27#Misc https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-27 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-27#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-09-27#Update https://wikitech.wikimedia.org/wiki/Ircstream ircstream.wikimedia. Servicehttps://wikitech.wikimedia.org/wiki/Ircstream#Service Administrationhttps://wikitech.wikimedia.org/wiki/Ircstream#Administration Adding/removing hostshttps://wikitech.wikimedia.org/wiki/Ircstream#Adding/removing_hosts Updating the Debian packagehttps://wikitech.wikimedia.org/wiki/Ircstream#Updating_the_Debian_package Usehttps://wikitech.wikimedia.org/wiki/Ircstream#Use Bots still using the legacy setuphttps://wikitech.wikimedia.org/wiki/Ircstream#Bots_still_using_the_legacy_setup See alsohttps://wikitech.wikimedia.org/wiki/Ircstream#See_also https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes Working etherpad: Prepare packageshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#Prepare_packages Toolsbetahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#Toolsbeta prephttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#prep control nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#control_nodes toolsbeta-test-k8s-control-10https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#toolsbeta-test-k8s-control-10 toolsbeta-test-k8s-control-11https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#toolsbeta-test-k8s-control-11 toolsbeta-test-k8s-control-12https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#toolsbeta-test-k8s-control-12 worker nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#worker_nodes ingress nodeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#ingress_nodes cleanuphttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#cleanup Toolshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#Tools tools-k8s-control-7https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#tools-k8s-control-7 tools-k8s-control-8https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#tools-k8s-control-8 tools-k8s-control-9https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes/1.27_to_1.28_notes#tools-k8s-control-9 https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85 == 2024-09-30 == 2024-09-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-30 2024-09-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-29 2024-09-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-28 2024-09-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-27 2024-09-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-26 2024-09-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-25 2024-09-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-24 2024-09-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-23 2024-09-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-22 2024-09-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-20 2024-09-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-19 2024-09-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-18 2024-09-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-17 2024-09-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-16 2024-09-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-15 2024-09-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-14 2024-09-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-13 2024-09-12https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-12 2024-09-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-11 2024-09-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-10 2024-09-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-09 2024-09-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-07 2024-09-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-06 2024-09-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-05 2024-09-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-04 2024-09-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-03 2024-09-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-02 2024-09-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#2024-09-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_85#Other_archives https://wikitech.wikimedia.org/wiki/Conftool2git Conftool2git is a service that listens for HTTP POST requests of conftool audit log events, and combines them with querying the etcd backend to create changes to a git repository that is, to all effects, recording all history of what was changed by whom in conftool. Conftool will only send such audit log events if the conftool2git_address configuration key is set. Some detailshttps://wikitech.wikimedia.org/wiki/Conftool2git#Some_details What to do if it breakshttps://wikitech.wikimedia.org/wiki/Conftool2git#What_to_do_if_it_breaks https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01 == Attendees == Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01#Attendees Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01#Notes k8s upgrade workgroup progresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01#k8s_upgrade_workgroup_progress KR/hypothesis progresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01#KR/hypothesis_progress Potential for tracking tools/toolsbeta Cloud VPS resources via opentofuhttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-10-01#Potential_for_tracking_tools/toolsbeta_Cloud_VPS_resources_via_opentofu https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes/JavaScript This page documents the contextual attributes supported by the Metrics Platform JavaScript client. For property descriptions and types, see the web base schema definition. https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes/PHP This page documents the contextual attributes supported by the Metrics Platform PHP client. For property descriptions and types, see the web base schema definition. https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes/Java This page documents the contextual attributes supported by the Metrics Platform Java client. For property descriptions and types, see the app base schema definition. https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes/Swift This page documents the contextual attributes supported by the Metrics Platform Swift client. For property descriptions and types, see the app base schema definition. https://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes Contextual attributes are fields in the event data that provide information about the performer who triggered the event and the wiki where the event occurred. The values of contextual attributes are populated automatically by Metrics Platform when the event is generated. JavaScripthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes#JavaScript PHPhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes#PHP Javahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes#Java Swifthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes#Swift Enabling optional attributeshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes#Enabling_optional_attributes Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Contextual_attributes#References https://wikitech.wikimedia.org/wiki/Metrics_Platform/Core_properties This page documents the core properties of the Metrics Platform base schemas. For property descriptions and types, see the base schema definitions. https://wikitech.wikimedia.org/wiki/Metrics_Platform/Interaction_data This page documents the interaction data supported by the Metrics Platform base schemas. For property descriptions and types, see the base schema definitions. Managed datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Interaction_data#Managed_data https://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema This page documents Metrics Platform's base schema for web. The schema includes three types of properties: Example eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema#Example_event Core propertieshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema#Core_properties Instrument and experiment managementhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema#Instrument_and_experiment_management Interaction datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema#Interaction_data Contextual attributeshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema#Contextual_attributes Code referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Web_schema#Code_references https://wikitech.wikimedia.org/wiki/Metrics_Platform/App_schema This page documents Metrics Platform's base schema for mobile apps. The schema includes three types of properties: Example eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/App_schema#Example_event Core propertieshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/App_schema#Core_properties Interaction datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/App_schema#Interaction_data Contextual attributeshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/App_schema#Contextual_attributes Code referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/App_schema#Code_references https://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-18_replication#Scorecard https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not Origin task: [of the decision: 2024-09-26 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Rationale Semantic Versioning Principle Summaryhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Semantic_Versioning_Principle_Summary Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Problem Decision Request Goalhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Decision_Request_Goal Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Constraints_and_risks Decision recordhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Decision_record Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Option_1 Pros:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Pros: Cons:https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Cons: Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Option_3 Option 4https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T373072_to_strictly_enforce_semantic_versioning_rules_for_toolforge_services_APIs_or_not#Option_4 https://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Timeline Graphshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Graphs SALhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#SAL Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Scorecard Follow-up ticketshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-28_cr2-eqsin_down#Follow-up_tickets https://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Conclusions Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-09-23_pc1013_hardware_issue#Scorecard https://wikitech.wikimedia.org/wiki/Metrics_Platform/Schemas Schemas in Metrics Platform may refer to: Base schemashttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Schemas#Base_schemas Custom schemas for specific product areashttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Schemas#Custom_schemas_for_specific_product_areas New custom schemashttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Schemas#New_custom_schemas https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04#What_we've_accomplished Search Update Pipeline - Private Wikishttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04#Search_Update_Pipeline_-_Private_Wikis Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04#Improve_multilingual_zero-results_rate WDQS Expose RDF stream publiclyhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04#WDQS_Expose_RDF_stream_publicly Misc / Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-04#Misc_/_Operations https://wikitech.wikimedia.org/wiki/UEFI_Boot This is WIP work to transition from legacy bios to UEFI on baremetal servers, and perhaps VMs in the future. Workflowhttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Workflow Apply the correct partman recipe to support UEFIhttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Apply_the_correct_partman_recipe_to_support_UEFI Depool the server and downtime ithttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Depool_the_server_and_downtime_it Reconfigure the server to boot via UEFIhttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Reconfigure_the_server_to_boot_via_UEFI Re-image the serverhttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Re-image_the_server Under the hoodhttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Under_the_hood Known limitations, future work and noteshttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Known_limitations,_future_work_and_notes Future workhttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Future_work Known limitationshttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Known_limitations Noteshttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Notes Resourceshttps://wikitech.wikimedia.org/wiki/UEFI_Boot#Resources https://wikitech.wikimedia.org/wiki/Catalyst/Scaling Project Catalyst will need to scale as it takes on more workloads. The original layout topology was 1 VM with 4 cores and 8 GB of memory. How to add more nodeshttps://wikitech.wikimedia.org/wiki/Catalyst/Scaling#How_to_add_more_nodes Unknownshttps://wikitech.wikimedia.org/wiki/Catalyst/Scaling#Unknowns https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-04 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-04#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-04#Update https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Supermicro_Documentation power cycle: reset /system1/pwrmgtsvc1 https://wikitech.wikimedia.org/wiki/Helm/Upstream_Charts/ceph-csi-cephfs Chart name: ceph-csi-cephfs Evaluated Upstream Helm Chartshttps://wikitech.wikimedia.org/wiki/Category:Evaluated_Upstream_Helm_Charts https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/10 ==Week of October 07== Week of October 07https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/10#Week_of_October_07 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/10#=== Week of October 14https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/10#Week_of_October_14 Week of October 21https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/10#Week_of_October_21 Week of October 28https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/10#Week_of_October_28 https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic == Error / Incident == Error / Incidenthttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic#Error_/_Incident Debugginghttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic#Debugging Common issueshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic#Common_issues Related informationhttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic#Related_information Support contactshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic#Support_contacts Old incidentshttps://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic#Old_incidents https://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API This page provides a guide to using the Metrics Platform JavaScript API for instrument and experiment creators. Setuphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Setup Create an instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Create_an_instrument Submit a click eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Submit_a_click_event Submit an interaction eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Submit_an_interaction_event Implementationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Implementation Referencehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Reference mw.eventLog.newInstrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#mw.eventLog.newInstrument Instrument#submitClickhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Instrument#submitClick Instrument#submitInteractionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/JavaScript_API#Instrument#submitInteraction https://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API This page provides a guide to using the Metrics Platform PHP API for instrument and experiment creators. Quickstarthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#Quickstart Setuphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#Setup Submit a click eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#Submit_a_click_event Submit an interaction eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#Submit_an_interaction_event Implementationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#Implementation Referencehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#Reference submitClickhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#submitClick submitInteractionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/PHP_API#submitInteraction https://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API This page provides a guide to using the Metrics Platform Java API for instrument and experiment creators. Setuphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#Setup Submit a click eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#Submit_a_click_event Submit an interaction eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#Submit_an_interaction_event Implementationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#Implementation Referencehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#Reference submitClickhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#submitClick submitInteractionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Java_API#submitInteraction https://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API This page provides a guide to using the Metrics Platform Swift API for instrument and experiment creators. Setuphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API#Setup Submit a click eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API#Submit_a_click_event Submit an interaction eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API#Submit_an_interaction_event Implementationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API#Implementation Referencehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API#Reference EventPlatformClient.submit (Swift)https://wikitech.wikimedia.org/wiki/Metrics_Platform/Swift_API#EventPlatformClient.submit_(Swift) https://wikitech.wikimedia.org/wiki/Metrics_Platform/API API in Metrics Platform may refer to: Metrics Platform client APIhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/API#Metrics_Platform_client_API See alsohttps://wikitech.wikimedia.org/wiki/Metrics_Platform/API#See_also https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-11 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-11#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-11#What_we've_accomplished WDQS Expose RDF stream publiclyhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-11#WDQS_Expose_RDF_stream_publicly Improve multilingual zero-results ratehttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-11#Improve_multilingual_zero-results_rate Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-11#Search_backend_replacement https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge_roots_and_Toolforge_admins The terms Toolforge root and Toolforge admin are used somewhat interchangeably to describe users who do administrative work in Toolforge. "tools" project in Cloud VPShttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge_roots_and_Toolforge_admins#"tools"_project_in_Cloud_VPS sudo policy "roots"https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge_roots_and_Toolforge_admins#sudo_policy_"roots" Gerrit group "toollabs-trusted"https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge_roots_and_Toolforge_admins#Gerrit_group_"toollabs-trusted" GitLab group repos/cloud/toolforgehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge_roots_and_Toolforge_admins#GitLab_group_repos/cloud/toolforge See alsohttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolforge_roots_and_Toolforge_admins#See_also https://wikitech.wikimedia.org/wiki/Vlan_migration = Migration to per rack vlans = Migration to per rack vlanshttps://wikitech.wikimedia.org/wiki/Vlan_migration#Migration_to_per_rack_vlans Why ?https://wikitech.wikimedia.org/wiki/Vlan_migration#Why_? Where ?https://wikitech.wikimedia.org/wiki/Vlan_migration#Where_? How ?https://wikitech.wikimedia.org/wiki/Vlan_migration#How_? What's next ?https://wikitech.wikimedia.org/wiki/Vlan_migration#What's_next_? https://wikitech.wikimedia.org/wiki/Mercurius Mercurius is bespoke software designed to run asynchronous tasks in a distributed system with a central workload orchestrator like Kubernetes. https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-18 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-18#Summary What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-18#What_we've_accomplished Flink updateshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-18#Flink_updates Weighted tagshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-18#Weighted_tags Search backend replacementhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-18#Search_backend_replacement https://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-09_calico-codfw#Scorecard https://wikitech.wikimedia.org/wiki/Traffic/Cookbooks == CDN == CDNhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#CDN roll-restart-varnish.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart-varnish.py Purposehttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#Purpose How to Usehttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#How_to_Use Flagshttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#Flags transfer-purged-positions.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#transfer-purged-positions.py roll-upgrade-ats.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-upgrade-ats.py roll-restart-reboot-ncredir.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart-reboot-ncredir.py run-puppet-restart-varnish.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#run-puppet-restart-varnish.py roll-reboot.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-reboot.py roll-upgrade-haproxy.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-upgrade-haproxy.py upgrade-varnish.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#upgrade-varnish.py DNShttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#DNS roll-restart-reboot-wikimedia-dns.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart-reboot-wikimedia-dns.py roll-restart-haproxy.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart-haproxy.py roll-restart-reboot-durum.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart-reboot-durum.py roll-restart-ntp.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart-ntp.py admin.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#admin.py roll-restart.pyhttps://wikitech.wikimedia.org/wiki/Traffic/Cookbooks#roll-restart.py https://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling This page documents the options for data collection sampling supported by the Metrics Platform. Analytics sampling specifies how events are determined to be in-sample (sent) or out-of-sample (thrown away). Locationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Location Sample ratehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Sample_rate Sample unithttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Sample_unit Pageviewhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Pageview Sessionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Session Session expiryhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Session_expiry Session scopehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Session_scope Devicehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Analytics_sampling#Device https://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment An experiment is a test of a hypothesis designed to provide trustworthy and generalizable data. It imposes an intervention on subjects with the intention of observing what outcome that intervention leads to. Planhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Plan Experimentation scorecardhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Experimentation_scorecard Measurement planhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Measurement_plan Instrumentation spechttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Instrumentation_spec Data collection guidelineshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Data_collection_guidelines Codehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Code Experiment enrolment samplinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Experiment_enrolment_sampling Propertieshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Properties Caveatshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Caveats Launchhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Launch Monitorhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Monitor Managehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Manage Decommissioninghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#Decommissioning Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Conduct_an_experiment#References https://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)/Runbook This is the run book for the Graphite instance used by QTE for performance and other related metrics. Metahttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)/Runbook#Meta Debug missing metricshttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)/Runbook#Debug_missing_metrics Update to new versionhttps://wikitech.wikimedia.org/wiki/Performance/Graphite_(synthetic_instance)/Runbook#Update_to_new_version https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook This is the runbook for investigating and fixing problems with the on demand testing. Metahttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook#Meta Debug missing metrics direct testshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook#Debug_missing_metrics_direct_tests Is the queue system working?https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook#Is_the_queue_system_working? Is the database up and running?https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook#Is_the_database_up_and_running? Is the testrunner/API that takes on jobs running?https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook#Is_the_testrunner/API_that_takes_on_jobs_running? Debug ondemand testing GUIhttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/OnDemandTesting/Runbook#Debug_ondemand_testing_GUI https://wikitech.wikimedia.org/wiki/Kubernetes/Administration/containerd_migration Tracking task for the prep work that lead to this: https://phabricator.wikimedia. Kuberneteshttps://wikitech.wikimedia.org/wiki/Category:Kubernetes SRE Service Operationshttps://wikitech.wikimedia.org/wiki/Category:SRE_Service_Operations https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-22 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-22#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-22#Update https://wikitech.wikimedia.org/wiki/Pixel/Runbook This is the runbook for deploying and debugging Pixel problems. Metahttps://wikitech.wikimedia.org/wiki/Pixel/Runbook#Meta Update to new version of Pixelhttps://wikitech.wikimedia.org/wiki/Pixel/Runbook#Update_to_new_version_of_Pixel Revert to a old version of Pixelhttps://wikitech.wikimedia.org/wiki/Pixel/Runbook#Revert_to_a_old_version_of_Pixel Prio 1, 2 or 3 job is failinghttps://wikitech.wikimedia.org/wiki/Pixel/Runbook#Prio_1,_2_or_3_job_is_failing https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage == Synthetic test result storage == Synthetic test result storagehttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage#Synthetic_test_result_storage Server setuphttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage#Server_setup https://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage/Runbook This is the runbook for the result storage for synthetic testing. Metahttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage/Runbook#Meta Debughttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage/Runbook#Debug Uploading problemshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage/Runbook#Uploading_problems Serving content problemshttps://wikitech.wikimedia.org/wiki/Performance/Synthetic_testing/Result_storage/Runbook#Serving_content_problems https://wikitech.wikimedia.org/wiki/Requestctl/Tutorials This page contains tutorials for using the requestctl tool. Tutorial: Add a new action in Varnishhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Tutorial:_Add_a_new_action_in_Varnish Get ipblockshttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Get_ipblocks Look for request patternhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Look_for_request_pattern Add a patternhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Add_a_pattern Sync to etcdhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Sync_to_etcd Add another patternhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Add_another_pattern Write the actionhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Write_the_action Check your new actionhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Check_your_new_action Inject to Varnish and commithttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Inject_to_Varnish_and_commit Tutorial: Add a new action in haproxyhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Tutorial:_Add_a_new_action_in_haproxy Add an ipblockhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Add_an_ipblock Add an haproxy actionhttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Add_an_haproxy_action Enable and sync the change to the TLS terminatorshttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Enable_and_sync_the_change_to_the_TLS_terminators Next stepshttps://wikitech.wikimedia.org/wiki/Requestctl/Tutorials#Next_steps https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25 = Summary = Summaryhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25#Summary What's ongoinghttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25#What's_ongoing WDQS: Public RDF Streamhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25#WDQS:_Public_RDF_Stream Language Stuffhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25#Language_Stuff Spark Kafka Writer (Weighted tags/Dumps 2.0)https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25#Spark_Kafka_Writer_(Weighted_tags/Dumps_2.0) What we've completedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-10-25#What_we've_completed https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-25 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-25#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-10-25#Update https://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health Product health metrics are key performance indicators for measuring and monitoring the impact of a product.[This page describes how to measure product health using the Metrics Platform. Planhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Plan Measurement planhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Measurement_plan Instrumentation spechttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Instrumentation_spec Data collection guidelineshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Data_collection_guidelines Codehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Code Launchhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Launch Monitorhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Monitor Managehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#Manage Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Measure_product_health#References https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir == 2024-10-10 Webrequest Data Loss - clobbered hadoop _temporary dir == 2024-10-10 Webrequest Data Loss - clobbered hadoop _temporary dirhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#2024-10-10_Webrequest_Data_Loss_-_clobbered_hadoop_temporary_dir Summaryhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Summary Recommendationshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Recommendations Descriptionhttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Description Root Causehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Root_Cause Affected Datasets and Serviceshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Affected_Datasets_and_Services Hive Tablehttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Hive_Table Graphite metricshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Graphite_metrics Followup Stepshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Followup_Steps Mitigation:https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Mitigation: Long Term Solutionshttps://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Data_Issues/2024-10-10_Webrequest_Data_Loss_-_Clobbered_Hadoop_Temporary_Dir#Long_Term_Solutions https://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary This page documents terms used in the Metrics Platform documentation. Termshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Terms Analytics samplinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Analytics_sampling APIhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#API Base schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Base_schema Baselinehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Baseline Bucketinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Bucketing Contextual attributeshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Contextual_attributes Data contracthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Data_contract Experimenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Experiment Experiment enrolment samplinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Experiment_enrolment_sampling Experiment orchestrationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Experiment_orchestration Experimentation labhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Experimentation_lab Eventhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Event Event streamhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Event_stream Fragmenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Fragment Guardrail metrichttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Guardrail_metric Hivehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Hive Hypothesishttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Hypothesis Instrumenthttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Instrument Instrumentationhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Instrumentation Interaction datahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Interaction_data L3SC reviewhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#L3SC_review Leading indicatorhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Leading_indicator Monotablehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Monotable MPIChttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#MPIC Primary metrichttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Primary_metric Product health metrichttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Product_health_metric Rolling metrichttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Rolling_metric Samplinghttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Sampling Secondary metrichttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Secondary_metric Schemahttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Schema Streamhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Stream Trailing (lagging) indicatorhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#Trailing_(lagging)_indicator Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Glossary#References https://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance This page documents how to maintain the Metrics Platform documentation on Wikitech, including Metrics Platform and subpages.. General principleshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#General_principles Structurehttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Structure Workflowshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Workflows Guideshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Guides System docshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#System_docs Maintainer docshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Maintainer_docs Meta docshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Meta_docs Section transclusionhttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Section_transclusion Documentation pages linked to from MPIChttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Documentation_pages_linked_to_from_MPIC Ownershiphttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#Ownership See alsohttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#See_also Referenceshttps://wikitech.wikimedia.org/wiki/Metrics_Platform/Documentation_maintenance#References https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86 == 2024-10-31 == 2024-10-31https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-31 2024-10-30https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-30 2024-10-29https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-29 2024-10-28https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-28 2024-10-27https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-27 2024-10-26https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-26 2024-10-25https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-25 2024-10-24https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-24 2024-10-23https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-23 2024-10-22https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-22 2024-10-21https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-21 2024-10-20https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-20 2024-10-19https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-19 2024-10-18https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-18 2024-10-17https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-17 2024-10-16https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-16 2024-10-15https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-15 2024-10-14https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-14 2024-10-13https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-13 2024-10-11https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-11 2024-10-10https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-10 2024-10-09https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-09 2024-10-08https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-08 2024-10-07https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-07 2024-10-06https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-06 2024-10-05https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-05 2024-10-04https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-04 2024-10-03https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-03 2024-10-02https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-02 2024-10-01https://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#2024-10-01 Other archiveshttps://wikitech.wikimedia.org/wiki/Server_Admin_Log/Archive_86#Other_archives https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01 = Ongoing work = Ongoing workhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#Ongoing_work WDQS Graph Splithttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#WDQS_Graph_Split Language Stuff: Kuromojihttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#Language_Stuff:_Kuromoji What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#What_we've_accomplished WDQS Expose RDF stream publiclyhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#WDQS_Expose_RDF_stream_publicly Search Update Pipeline / Weighted tagshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#Search_Update_Pipeline_/_Weighted_tags Search Metricshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#Search_Metrics Misc / Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-01#Misc_/_Operations https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-11-01 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-11-01#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-11-01#Update https://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues == Summary == Summaryhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Summary Timelinehttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Timeline Detectionhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Detection Conclusionshttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Conclusions What went well?https://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#What_went_well? What went poorly?https://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#What_went_poorly? Where did we get lucky?https://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Where_did_we_get_lucky? Links to relevant documentationhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Links_to_relevant_documentation Actionableshttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Actionables Scorecardhttps://wikitech.wikimedia.org/wiki/Incidents/2024-10-24_codfw_pc_and_kafka_mirrormaker_issues#Scorecard https://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab This page collects documentation on how to use the ML-team's lab machines (ml-lab1001.eqiad. Machine overviewhttps://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab#Machine_overview Access to the machineshttps://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab#Access_to_the_machines Outside access/downloads/proxieshttps://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab#Outside_access/downloads/proxies PyTorch and ROCmhttps://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab#PyTorch_and_ROCm Huggingface Cachehttps://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab#Huggingface_Cache Jupyter Notebookshttps://wikitech.wikimedia.org/wiki/Machine_Learning/ML-Lab#Jupyter_Notebooks https://wikitech.wikimedia.org/wiki/Zarcillo === A bit of history === A bit of historyhttps://wikitech.wikimedia.org/wiki/Zarcillo#A_bit_of_history Zarcillo use caseshttps://wikitech.wikimedia.org/wiki/Zarcillo#Zarcillo_use_cases https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05 == Attendees == Attendeeshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#Attendees Agendahttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#Agenda Noteshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#Notes k8s upgrade workgroup progresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#k8s_upgrade_workgroup_progress KR/hypothesis progresshttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#KR/hypothesis_progress 6.3.5 components-apihttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#6.3.5_components-api 6.3.7 Sustainability scorehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#6.3.7_Sustainability_score 6.3.6 hypothesishttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#6.3.6_hypothesis Toolforge Standard Committeehttps://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Monthly_meeting/2024-11-05#Toolforge_Standard_Committee https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration Origin task: [of the decision: 2024-11-06 Decision takenhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Decision_taken Rationalehttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Rationale Problemhttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Problem Constraints and riskshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Constraints_and_risks Optionshttps://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Options Option 1https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Option_1 Option 2https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Option_2 Option 3https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T377467_cloud_vps_vxlan_ipv6_migration#Option_3 https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-08 = Ongoing work = Ongoing workhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-08#Ongoing_work Search Update Pipeline / Weighted tagshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-08#Search_Update_Pipeline_/_Weighted_tags Language Stuff: Kuromojihttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-08#Language_Stuff:_Kuromoji What we've accomplishedhttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-08#What_we've_accomplished Misc / Operationshttps://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-11-08#Misc_/_Operations https://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-11-08 == Introduction == Introductionhttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-11-08#Introduction Updatehttps://wikitech.wikimedia.org/wiki/Catalyst/Updates/2024-11-08#Update https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/11 ==Week of November 04== Week of November 04https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/11#Week_of_November_04 ===https://wikitech.wikimedia.org/wiki/Deployments/Archive/2024/11#===