Line 1: |
Line 1: |
| [[Category:ProductOpener]] | | [[Category:ProductOpener]] |
| [[Category:Developer]] | | [[Category:Developer]] |
| + | [[Category:Roadmap]] |
| + | [[Category:Infrastructure]] |
| + | |
| + | Welcome :-) <br> |
| + | This page describes the hardware/software infrastructure for the Open Food Facts, Open Beauty Facts, Open Pet Food Facts and Open Products Facts projects, as well as all the complementary deployments.<br> |
| + | '''It is not updated anymore, as we have moved to GitHub for planning, postmortems…'''<br> |
| + | Please check our coordination repo: https://github.com/openfoodfacts/openfoodfacts-infrastructure<br> |
| + | Note, we also have an #infrastructure channel on Slack, and a monthly video call. We can arrange ad-hoc calls if you'd like to get started faster. |
| | | |
− | This page describes the hardware/software infrastructure for the Open Food Facts + Open Beauty Facts projects.
| |
| | | |
| == Infrastructure planning == | | == Infrastructure planning == |
| | | |
| * Hardware needs: [[Infrastructure Planning]] | | * Hardware needs: [[Infrastructure Planning]] |
| + | |
| + | == 2021 roadmap == |
| + | * Please expand desirable objectives (not hardware needs) |
| + | * |
| + | * … |
| | | |
| == Current infrastructure == | | == Current infrastructure == |
Line 14: |
Line 26: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell 1U R440 server (1 Xeon Silver 4110) | + | * Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t) |
| * RAM: 64GB (DDR4@2666) | | * RAM: 64GB (DDR4@2666) |
| * Disks: | | * Disks: |
Line 29: |
Line 41: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell 1U R440 server (1 Xeon Silver 4110) | + | * Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t) |
| * RAM: 64GB (DDR4@2666) | | * RAM: 64GB (DDR4@2666) |
| * Disks: | | * Disks: |
Line 38: |
Line 50: |
| * 1 apache + mod_perl (not used) | | * 1 apache + mod_perl (not used) |
| * 1 MongoDB (production) | | * 1 MongoDB (production) |
| + | * Robotoff (dockerized) |
| + | |
| + | === no name yet === |
| + | Dedicated OVH - soyoustart server (rented): |
| + | |
| + | '''Hardware configuration:''' |
| + | * E3-SAT-1-32 |
| + | * Storage: SoftRaid 3x2To SATA |
| + | * RAM: 32GB DDR3 1333 MHz |
| + | * CPU: Xeon E3-1245v2 (4c/8th) |
| + | '''Running services:''' |
| + | * wiki |
| + | * zammad (soon) |
| | | |
| === dev === | | === dev === |
− | Dedicated OVH server (rented): | + | Dedicated OVH - soyoustart server (rented): |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
Line 49: |
Line 74: |
| '''Running services:''' | | '''Running services:''' |
| * OS: debian 9.8 | | * OS: debian 9.8 |
− | * 1 robotoff (dockerized)
| |
| * 1 nginx reverse proxy | | * 1 nginx reverse proxy |
− | * 1 apache + mod_perl (https://world.dev.openfoodfacts.org - auth: off / off) | + | * 1 apache + mod_perl (https://openfoodfacts.dev - auth: off / off) |
| * 1 mongodb | | * 1 mongodb |
| | | |
Line 58: |
Line 82: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell R710 server | + | * Dell R710 server (2U) |
| * Storage (ZFS pool) with: | | * Storage (ZFS pool) with: |
| ** 6 x 2TB HITACHI HUS72402 (SAS) | | ** 6 x 2TB HITACHI HUS72402 (SAS) |
Line 68: |
Line 92: |
| * OS: Proxmox 6 (debian 10 based) | | * OS: Proxmox 6 (debian 10 based) |
| | | |
− | === History === | + | '''Network''': |
| + | * uplink: optic fiber from OVH (1G down/500M up) with dedicated IPv4 and IPv6/72 |
| + | * ethernet 1Gbps (bonded for backup) |
| + | * infiniband 40Gbps (proxmox cluster backbone + access to storage server) |
| + | |
| + | === backup === |
| + | Shared storage server (self-hosted by [[User:Cquest|cquest]]) |
| + | |
| + | '''Hardware configuration:''' |
| + | * Supermicro storage server (4U) |
| + | * Storage (ZFS pool) with: |
| + | ** 36 SAS bays (populated disks evolving with time are needs) |
| + | ** 1TB Samsung 860 SSD: OS and 256GB read cache (L2ARC) |
| + | ** 16GB Intel Optane SSD: write journal (ZIL) |
| + | * RAM: 128GB |
| + | * CPU: |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (debian 10 based) |
| + | * Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots) |
| + | * Proxmox CT/VM replication |
| + | |
| + | === ovh1 === |
| + | VM/CT server for computing usages. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: AMD Epyc 7451 (24c/48t) |
| + | * RAM: 256GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.1) on vRack |
| + | * 2 x 1TB SSD NVMe |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on RAID1 /dev/md2 |
| + | * 512MB swap |
| + | * 920GB ZFS pool on remaining space (mirror) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh2 === |
| + | VM/CT server for computing usages (same as ovh1). |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: AMD Epyc 7451 (24c/48t) |
| + | * RAM: 256GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.2) on vRack |
| + | * 2 x 1TB SSD NVMe |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on RAID1 /dev/md2 |
| + | * 512MB swap |
| + | * 920GB ZFS pool on remaining space (mirror) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh3 === |
| + | Mainly storage server, VM/CT host is needed. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: Intel Xeon-D 1541 (8c/16t) |
| + | * RAM: 32GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.3) |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on SSD |
| + | * 512MB swap |
| + | * 5GB ZFS ZIL (write journal) |
| + | * 472GB ZFS cache (ARC2 read cache) |
| + | |
| + | * ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh4 === |
| + | Mainly storage server, VM/CT host is needed. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: Intel Xeon-D 1541 (8c/16t) |
| + | * RAM: 32GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.4) |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on SSD |
| + | * 512MB swap |
| + | * 5GB ZFS ZIL (write journal) |
| + | * 472GB ZFS cache (ARC2 read cache) |
| + | |
| + | * ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | == History == |
| | | |
| From 2012 to 2016, OFF and OBF have been running on part of an OVH server (also used for other purposes): | | From 2012 to 2016, OFF and OBF have been running on part of an OVH server (also used for other purposes): |