User:Bryan Hilderbrand/Meeting Notes (27JAN): Difference between revisions
Jump to navigation
Jump to search
Bryandamon (talk | contribs) (→) |
Bryandamon (talk | contribs) (→) |
||
(3 intermediate revisions by the same user not shown) | |||
Line 34: | Line 34: | ||
#* {{Agenda presenter|Gokhan}} It's stored on GitHub and we try to keep it as small as possible | #* {{Agenda presenter|Gokhan}} It's stored on GitHub and we try to keep it as small as possible | ||
#* {{Agenda presenter|Gokhan}} We use Continuous Integration testing | #* {{Agenda presenter|Gokhan}} We use Continuous Integration testing | ||
# {{Agenda presenter|Markus}} Showed the [https://github.com/hallowelt Hallo Welt GiHub repo] | |||
#* {{Agenda presenter|Markus}} We have the same Docker environment for [https://github.com/hallowelt/docker-bluespice-free BlueSpice Free] & Pro | |||
#* {{Agenda presenter|Markus}} We have to think about how to make the system flexible | |||
#* {{Agenda presenter|Markus}} The method is platform independent | |||
# {{Agenda presenter|Cindy}} How do you provide containers to people? | |||
#* {{Agenda presenter|Cindy}} Do you give them the Docker image? Any need for orchestration? | |||
# {{Agenda presenter|Gokhan}} We are using [https://goharbor.io/ Harbor] as a private registry. Docker Hub. Building is the same | |||
# {{Agenda presenter|Lex}} My solution is not an alternative to Meza, it's a post process | |||
#* {{Agenda presenter|Lex}} Something should create a MW root structure, my solution acts on this | |||
#* {{Agenda presenter|Yaron}} Your solution seems to have 2 steps: | |||
#*# Set up MW | |||
#*# Package it | |||
#*#* {{Agenda presenter|Lex}} Yes | |||
# {{Agenda presenter|Markus}} It's important to separate the two parts: | |||
## MW Creation | |||
## Packaging MW | |||
#* {{Agenda presenter|Markus}} We also need a method for content | |||
# {{Agenda presenter|Lex}} I'm not planning on copying all the old wiki DB, I'm starting with a clean MW installation | |||
#* {{Agenda presenter|Lex}} | |||
# {{Agenda presenter|Markus}} I've seen many build scripts created by someone, then abandoned | |||
#* {{Agenda presenter|Markus}} We wanted to use something (Docker) that is supported so it will last longer | |||
# {{Agenda presenter|Ad}} When we think about a "package" (i.e. CRM), a lot of it's use/power is the content | |||
#* {{Agenda presenter|Ad}} It seems we will always require scripts | |||
# {{Agenda presenter|Markus}} Ad makes a great point here. | |||
#* {{Agenda presenter|Markus}} There's "functional content" - this crosses the border between Wiki & Lua for example | |||
#* {{Agenda presenter|Markus}} Still this should be a separate thing, e.g. | |||
#*# SMW + Page Forms/Templates/Properties | |||
#*# Should split the two so someone can just get SMW | |||
# {{Agenda presenter|Markus}} Docker is great when nothing changes | |||
#* {{Agenda presenter|Markus}} When we need to admin stuff, change parts, tinker w/networking, Docker makes this difficult | |||
#* {{Agenda presenter|Markus}} It's great for testing & light-weight production | |||
#* {{Agenda presenter|Markus}} Basically, any recipe will not work Out-Of-The-Box with a complex environment | |||
#* {{Agenda presenter|Cindy}} That's consistent with what I've been saying about the need for an orchestration layer on top | |||
#* {{Agenda presenter|Cindy}} Need a future enhancement with different Kubernetes environment profiles for different production needs | |||
#* {{Agenda presenter|Cindy}} There is an effort by WMF to use Kubernetes to deliver MW (not going anywhere fast yet) | |||
# {{Agenda presenter|Markus}} Question for Lex, "What is the connections between the distribution package and the Docker file itself"? | |||
#* {{Agenda presenter|Markus}} Am I assuming correctly that you would execute these scripts or put the files in the correct place using the docker compose? Or are you mounting things outside? | |||
#* {{Agenda presenter|Lex}} Take a look at [https://github.com/dataspects/mediawiki-manager my code] | |||
# {{Agenda presenter|Yaron}} Sounds like we are splitting "Infrastructure" into: | |||
## Creating a wiki structure | |||
## Packaging/Distributing the structure | |||
# {{Agenda presenter|Cindy}} What about Podman vs. Docker? | |||
#* {{Agenda presenter|Cindy}} I believe Kubernetes will stop supporting Docker in place of [https://containerd.io/ containerd] | |||
#* {{Agenda presenter|Lex}} Database infrastructure layer is '''not''' one of our business object layers | |||
#* {{Agenda presenter|Markus}} If Docker goes away, there will be hundreds of people creating migration scripts to the new systems | |||
# {{Agenda presenter|Rich}} Meza has a goal, if the user has CentOS & internet, then 3 minutes later they have a running wiki | |||
#* {{Agenda presenter|Rich}} Meza can: | |||
#*# Create a system to tinker, then destroy | |||
#*# Run your production server | |||
#*# Meza takes all database/image directories for all wikis & "volumes them in" & captures all other things that make that wiki unique | |||
# {{Agenda presenter|Cindy}} Quick note, Meza does not use Docker | |||
#* {{Agenda presenter|James}} Meza did use Docker at one point (for memcached or something), but it's since been removed | |||
# {{Agenda presenter|Lex}} Have you noticed Ansible is brittle? | |||
#* {{Agenda presenter|Lex}} I use Ansible and love it, but you have to pamper it & it breaks often | |||
# {{Agenda presenter|James}} Some info about Meza | |||
#* {{Agenda presenter|James}} Travis runs against every build | |||
#* {{Agenda presenter|James}} An important thing is keeping things running | |||
#* {{Agenda presenter|James}} Meza has a full Dev <span style="font-weight:bold; font-size:1.2em;">→</span> Prod methodology | |||
#* {{Agenda presenter|James}} With Continuous Integration, we can tell when something bad happened | |||
#* {{Agenda presenter|James}} It's not perfect, but it's very stable | |||
#* {{Agenda presenter|James}} This all comes Out-Of-The-Box with Meza | |||
# {{Agenda presenter|Bryan}} Can we have a place that shows all the options with help about how to test/run each? | |||
#* {{Agenda presenter|Yaron}} Yes, please have Hallo Welt!, BlueSpice, Meza, & others put their options on a common page like [[MW:Project Canasta/Infrastructure solution|Project Canasta's Infrastructure solution]] page | |||
# {{Agenda presenter|Markus}} After this discussion, I realized we have different approaches that aren't actually competitors, but tackling different parts of the whole picture | |||
#* {{Agenda presenter|Lex}} Mutually Exclusive, Collectively Exhaustive (MECE) | |||
# {{Agenda presenter|Bryan}} Sounds like in addition to placing different solutions on a [[MW:Project Canasta/Infrastructure solution|common page]], state the goals of the solution, & what it doesn't do | |||
# {{Agenda presenter|Lex}} My goal is to remove all barriers for someone to create a wiki | |||
==Chat transcript== | ==Chat transcript== |
Latest revision as of 22:19, 30 January 2021
Attendees
- Ad Strack van Schijndel
- Bryan Hilderbrand
- Cindy Cicalese
- Gökhan Geyik
- James Montalvo
- Lex Sulzer
- Markus Glaser
- Rich Evans
- Richard Heigl
- Yaron Koren
Meeting notes for MediaWiki "Infrastructure" (Project Canasta) Discussion (Wed Jan 27 16:30-17:30 UTC 2020)
Notes
The meeting voice transcription is available on the talk page.
- Rich Asked Yaron to describe what Canasta is.
- Yaron Pointed to the Project Canasta page on MediaWiki.org and went over the four main components listed.
- Rich Asked Yaron to describe the current needs.
- Yaron We've heard from Lex, Cindy, Wikibase Solutions, and Bluespice, but haven't heard about Meza yet. I'd like to hear from James more about Meza.
- James Provided links to Meza on MediaWiki and GitHub
- James Meza is actively maintained
- James We're currently on MW 1.31, but have a branch for 1.35
- James Working on packages for maintenance
- Markus Hallo Welt!/BlueSpice built a MW distribution based on Docker
- Markus Just need to run Composer install to draw in all extensions, etc.
- Markus We have many composer files for BlueSpice free, BlueSpice Pro, PDF feature, etc.
- Markus We start with one composer file and add more for additional needs (extensions, etc.)
- Gokhan I work on BlueSpice with Markus at Hallo Welt!
- Gokhan Composer is handled by the Dev team
- Gokhan It's stored on GitHub and we try to keep it as small as possible
- Gokhan We use Continuous Integration testing
- Markus Showed the Hallo Welt GiHub repo
- Markus We have the same Docker environment for BlueSpice Free & Pro
- Markus We have to think about how to make the system flexible
- Markus The method is platform independent
- Cindy How do you provide containers to people?
- Cindy Do you give them the Docker image? Any need for orchestration?
- Gokhan We are using Harbor as a private registry. Docker Hub. Building is the same
- Lex My solution is not an alternative to Meza, it's a post process
- Lex Something should create a MW root structure, my solution acts on this
- Yaron Your solution seems to have 2 steps:
- Set up MW
- Package it
- Lex Yes
- Markus It's important to separate the two parts:
- MW Creation
- Packaging MW
- Markus We also need a method for content
- Lex I'm not planning on copying all the old wiki DB, I'm starting with a clean MW installation
- Lex
- Markus I've seen many build scripts created by someone, then abandoned
- Markus We wanted to use something (Docker) that is supported so it will last longer
- Ad When we think about a "package" (i.e. CRM), a lot of it's use/power is the content
- Ad It seems we will always require scripts
- Markus Ad makes a great point here.
- Markus There's "functional content" - this crosses the border between Wiki & Lua for example
- Markus Still this should be a separate thing, e.g.
- SMW + Page Forms/Templates/Properties
- Should split the two so someone can just get SMW
- Markus Docker is great when nothing changes
- Markus When we need to admin stuff, change parts, tinker w/networking, Docker makes this difficult
- Markus It's great for testing & light-weight production
- Markus Basically, any recipe will not work Out-Of-The-Box with a complex environment
- Cindy That's consistent with what I've been saying about the need for an orchestration layer on top
- Cindy Need a future enhancement with different Kubernetes environment profiles for different production needs
- Cindy There is an effort by WMF to use Kubernetes to deliver MW (not going anywhere fast yet)
- Markus Question for Lex, "What is the connections between the distribution package and the Docker file itself"?
- Markus Am I assuming correctly that you would execute these scripts or put the files in the correct place using the docker compose? Or are you mounting things outside?
- Lex Take a look at my code
- Yaron Sounds like we are splitting "Infrastructure" into:
- Creating a wiki structure
- Packaging/Distributing the structure
- Cindy What about Podman vs. Docker?
- Cindy I believe Kubernetes will stop supporting Docker in place of containerd
- Lex Database infrastructure layer is not one of our business object layers
- Markus If Docker goes away, there will be hundreds of people creating migration scripts to the new systems
- Rich Meza has a goal, if the user has CentOS & internet, then 3 minutes later they have a running wiki
- Rich Meza can:
- Create a system to tinker, then destroy
- Run your production server
- Meza takes all database/image directories for all wikis & "volumes them in" & captures all other things that make that wiki unique
- Rich Meza can:
- Cindy Quick note, Meza does not use Docker
- James Meza did use Docker at one point (for memcached or something), but it's since been removed
- Lex Have you noticed Ansible is brittle?
- Lex I use Ansible and love it, but you have to pamper it & it breaks often
- James Some info about Meza
- James Travis runs against every build
- James An important thing is keeping things running
- James Meza has a full Dev → Prod methodology
- James With Continuous Integration, we can tell when something bad happened
- James It's not perfect, but it's very stable
- James This all comes Out-Of-The-Box with Meza
- Bryan Can we have a place that shows all the options with help about how to test/run each?
- Yaron Yes, please have Hallo Welt!, BlueSpice, Meza, & others put their options on a common page like Project Canasta's Infrastructure solution page
- Markus After this discussion, I realized we have different approaches that aren't actually competitors, but tackling different parts of the whole picture
- Lex Mutually Exclusive, Collectively Exhaustive (MECE)
- Bryan Sounds like in addition to placing different solutions on a common page, state the goals of the solution, & what it doesn't do
- Lex My goal is to remove all barriers for someone to create a wiki
Chat transcript
Content pulled from the chat record of the meeting.
- Markus https://www.mediawiki.org/wiki/Project_Canasta/Infrastructure_solution
- Bryan https://www.mediawiki.org/wiki/Project_Canasta/Infrastructure_solution
- Bryan (beat me)
- Markus hehe!
- Lex https://github.com/dataspects/mediawiki-canasta
- Bryan https://www.mediawiki.org/wiki/Project_Canasta
- Bryan Previous meeting notes:
- Bryan https://www.mediawiki.org/wiki/Meza
- Bryan https://github.com/enterprisemediawiki/meza/
- Rich fyi, I can't hear Gokhan well. did anybody else have trouble hearing him?
- Gokhan Oh let me switch to internal microphone.
- Bryan https://github.com/hallowelt/mediawiki
- Bryan Infrastructure is split into two? Is this right?
- Creating a wiki structure
- Packaging/Distributing the structure
- Bryan I think that's right.
- Rich Does anyone have any insights on using "redis" rather than "memcached" for fast caching of "key value" data pairs?
- Cindy Unfortunately, I need to leave for another meeting. Great conversation as always. Looking forward to more in the future.
- Rich Bye Cindy. Thank you!
- Richard Me too. Have also to leave now. :-( CU soon! Thanks for the interesting discussion
- Rich Aye. ty!
- Markus I will have to leave in 5 minutes
- Gokhan Also I have to leave in 5 minutes. Thank you very much for this meeting.
- Markus See you all next time! Thanks for the great discussion
- Gokhan Have a nice day/evening thank you all.