Line 1: |
Line 1: |
| [[Category:ProductOpener]] | | [[Category:ProductOpener]] |
| [[Category:Developer]] | | [[Category:Developer]] |
| + | [[Category:Roadmap]] |
| + | [[Category:Infrastructure]] |
| + | |
| + | Welcome :-) <br> |
| + | This page describes the hardware/software infrastructure for the Open Food Facts, Open Beauty Facts, Open Pet Food Facts and Open Products Facts projects, as well as all the complementary deployments.<br> |
| + | '''It is not updated anymore, as we have moved to GitHub for planning, postmortems…'''<br> |
| + | Please check our coordination repo: https://github.com/openfoodfacts/openfoodfacts-infrastructure<br> |
| + | Note, we also have an #infrastructure channel on Slack, and a monthly video call. We can arrange ad-hoc calls if you'd like to get started faster. |
| | | |
− | This page describes the hardware/software infrastructure for the Open Food Facts + Open Beauty Facts projects.
| |
| | | |
| == Infrastructure planning == | | == Infrastructure planning == |
| | | |
| * Hardware needs: [[Infrastructure Planning]] | | * Hardware needs: [[Infrastructure Planning]] |
| + | |
| + | == 2021 roadmap == |
| + | * Please expand desirable objectives (not hardware needs) |
| + | * |
| + | * … |
| | | |
| == Current infrastructure == | | == Current infrastructure == |
Line 14: |
Line 26: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell 1U R440 server (1 Xeon Silver 4110) | + | * Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t) |
| * RAM: 64GB (DDR4@2666) | | * RAM: 64GB (DDR4@2666) |
| * Disks: | | * Disks: |
Line 29: |
Line 41: |
| | | |
| '''Hardware configuration:''' | | '''Hardware configuration:''' |
− | * Dell 1U R440 server (1 Xeon Silver 4110) | + | * Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t) |
| * RAM: 64GB (DDR4@2666) | | * RAM: 64GB (DDR4@2666) |
| * Disks: | | * Disks: |
Line 39: |
Line 51: |
| * 1 MongoDB (production) | | * 1 MongoDB (production) |
| * Robotoff (dockerized) | | * Robotoff (dockerized) |
− |
| |
− | === robotoff ===
| |
− | Hetzner
| |
− |
| |
− | '''Hardware configuration:'''
| |
− | * Storage: 50GB
| |
− | * RAM: 32GB
| |
− | '''Running services:'''
| |
− | * robotoff
| |
| | | |
| === no name yet === | | === no name yet === |
Line 104: |
Line 107: |
| ** 16GB Intel Optane SSD: write journal (ZIL) | | ** 16GB Intel Optane SSD: write journal (ZIL) |
| * RAM: 128GB | | * RAM: 128GB |
− | * CPU: '''Running services:''' | + | * CPU: |
| + | '''Running services:''' |
| * OS: Proxmox 6 (debian 10 based) | | * OS: Proxmox 6 (debian 10 based) |
| * Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots) | | * Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots) |
| * Proxmox CT/VM replication | | * Proxmox CT/VM replication |
| + | |
| + | === ovh1 === |
| + | VM/CT server for computing usages. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: AMD Epyc 7451 (24c/48t) |
| + | * RAM: 256GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.1) on vRack |
| + | * 2 x 1TB SSD NVMe |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on RAID1 /dev/md2 |
| + | * 512MB swap |
| + | * 920GB ZFS pool on remaining space (mirror) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh2 === |
| + | VM/CT server for computing usages (same as ovh1). |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: AMD Epyc 7451 (24c/48t) |
| + | * RAM: 256GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.2) on vRack |
| + | * 2 x 1TB SSD NVMe |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on RAID1 /dev/md2 |
| + | * 512MB swap |
| + | * 920GB ZFS pool on remaining space (mirror) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh3 === |
| + | Mainly storage server, VM/CT host is needed. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: Intel Xeon-D 1541 (8c/16t) |
| + | * RAM: 32GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.3) |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on SSD |
| + | * 512MB swap |
| + | * 5GB ZFS ZIL (write journal) |
| + | * 472GB ZFS cache (ARC2 read cache) |
| + | |
| + | * ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| + | |
| + | === ovh4 === |
| + | Mainly storage server, VM/CT host is needed. |
| + | |
| + | See [[Infrastructure/VM cluster]]. |
| + | |
| + | '''Hardware configuration:''' |
| + | * CPU: Intel Xeon-D 1541 (8c/16t) |
| + | * RAM: 32GB |
| + | * 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.4) |
| + | |
| + | Partition / storage: |
| + | * Ext4 root partition: 32Gb on SSD |
| + | * 512MB swap |
| + | * 5GB ZFS ZIL (write journal) |
| + | * 472GB ZFS cache (ARC2 read cache) |
| + | |
| + | * ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available) |
| + | |
| + | '''Running services:''' |
| + | * OS: Proxmox 6 (based on debian 10 buster) |
| | | |
| == History == | | == History == |