Line 1: |
Line 1: |
| [[Category:ProductOpener]] | | [[Category:ProductOpener]] |
| [[Category:Developer]] | | [[Category:Developer]] |
| + | [[Category:Roadmap]] |
| + | [[Category:Infrastructure]] |
| + | |
| + | Welcome :-) <br> |
| + | This page describes the hardware/software infrastructure for the Open Food Facts, Open Beauty Facts, Open Pet Food Facts and Open Products Facts projects, as well as all the complementary deployments.<br> |
| + | '''It is not updated anymore, as we have moved to GitHub for planning, postmortems…'''<br> |
| + | Please check our coordination repo: https://github.com/openfoodfacts/openfoodfacts-infrastructure<br> |
| + | Note, we also have an #infrastructure channel on Slack, and a monthly video call. We can arrange ad-hoc calls if you'd like to get started faster. |
| | | |
− | This page describes the hardware/software infrastructure for the Open Food Facts + Open Beauty Facts projects.
| |
| | | |
| == Infrastructure planning == | | == Infrastructure planning == |
| | | |
| * Hardware needs: [[Infrastructure Planning]] | | * Hardware needs: [[Infrastructure Planning]] |
| + | |
| + | == 2021 roadmap == |
| + | * Please expand desirable objectives (not hardware needs) |
| + | * |
| + | * … |
| | | |
| == Current infrastructure == | | == Current infrastructure == |
Line 14: |
Line 26: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell 1U R440 server (1 Xeon Silver 4110) | + | * Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t) |
| * RAM: 64GB (DDR4@2666) | | * RAM: 64GB (DDR4@2666) |
| * Disks: | | * Disks: |
Line 29: |
Line 41: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell 1U R440 server (1 Xeon Silver 4110) | + | * Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t) |
| * RAM: 64GB (DDR4@2666) | | * RAM: 64GB (DDR4@2666) |
| * Disks: | | * Disks: |
Line 38: |
Line 50: |
| * 1 apache + mod_perl (not used) | | * 1 apache + mod_perl (not used) |
| * 1 MongoDB (production) | | * 1 MongoDB (production) |
| + | * Robotoff (dockerized) |
| | | |
| === no name yet === | | === no name yet === |
Line 48: |
Line 61: |
| * CPU: Xeon E3-1245v2 (4c/8th) | | * CPU: Xeon E3-1245v2 (4c/8th) |
| '''Running services:''' | | '''Running services:''' |
| + | * wiki |
| * zammad (soon) | | * zammad (soon) |
− | * wiki (soon)
| |
| | | |
| === dev === | | === dev === |
Line 61: |
Line 74: |
| '''Running services:''' | | '''Running services:''' |
| * OS: debian 9.8 | | * OS: debian 9.8 |
− | * 1 robotoff (dockerized)
| |
| * 1 nginx reverse proxy | | * 1 nginx reverse proxy |
| * 1 apache + mod_perl (https://openfoodfacts.dev - auth: off / off) | | * 1 apache + mod_perl (https://openfoodfacts.dev - auth: off / off) |
Line 95: |
Line 107: |
| ** 16GB Intel Optane SSD: write journal (ZIL) | | ** 16GB Intel Optane SSD: write journal (ZIL) |
| * RAM: 128GB | | * RAM: 128GB |
− | * CPU: '''Running services:''' | + | * CPU: |
| + | '''Running services:''' |
| * OS: Proxmox 6 (debian 10 based) | | * OS: Proxmox 6 (debian 10 based) |
| * Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots) | | * Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots) |
| * Proxmox CT/VM replication | | * Proxmox CT/VM replication |
| + | |
| + | === ovh1 === |
| + | VM/CT server for computing usages. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: AMD Epyc 7451 (24c/48t) |
| + | * RAM: 256GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.1) on vRack |
| + | * 2 x 1TB SSD NVMe |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on RAID1 /dev/md2 |
| + | * 512MB swap |
| + | * 920GB ZFS pool on remaining space (mirror) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh2 === |
| + | VM/CT server for computing usages (same as ovh1). |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: AMD Epyc 7451 (24c/48t) |
| + | * RAM: 256GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.2) on vRack |
| + | * 2 x 1TB SSD NVMe |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on RAID1 /dev/md2 |
| + | * 512MB swap |
| + | * 920GB ZFS pool on remaining space (mirror) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh3 === |
| + | Mainly storage server, VM/CT host is needed. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: Intel Xeon-D 1541 (8c/16t) |
| + | * RAM: 32GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.3) |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on SSD |
| + | * 512MB swap |
| + | * 5GB ZFS ZIL (write journal) |
| + | * 472GB ZFS cache (ARC2 read cache) |
| + | |
| + | * ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh4 === |
| + | Mainly storage server, VM/CT host is needed. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: Intel Xeon-D 1541 (8c/16t) |
| + | * RAM: 32GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.4) |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on SSD |
| + | * 512MB swap |
| + | * 5GB ZFS ZIL (write journal) |
| + | * 472GB ZFS cache (ARC2 read cache) |
| + | |
| + | * ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| | | |
| == History == | | == History == |