Line 1:
Line 1:
[[Category:ProductOpener]]
[[Category:ProductOpener]]
[[Category:Developer]]
[[Category:Developer]]
+
[[Category:Roadmap]]
+
[[Category:Infrastructure]]
+
+
Welcome :-) <br>
+
This page describes the hardware/software infrastructure for the Open Food Facts, Open Beauty Facts, Open Pet Food Facts and Open Products Facts projects, as well as all the complementary deployments.<br>
+
'''It is not updated anymore, as we have moved to GitHub for planning, postmortems…'''<br>
+
Please check our coordination repo: https://github.com/openfoodfacts/openfoodfacts-infrastructure<br>
+
Note, we also have an #infrastructure channel on Slack, and a monthly video call. We can arrange ad-hoc calls if you'd like to get started faster.
+
== Get in touch ==
+
{{Box
+
| 1 = Slack channel
+
| 2 = [https://openfoodfacts.slack.com/messages/C1FPYCWM7/ #infrastructure]
+
}}
−
This page describes the hardware/software infrastructure for the Open Food Facts + Open Beauty Facts projects.
== Infrastructure planning ==
== Infrastructure planning ==
Line 14:
Line 26:
'''Hardware configuration:'''
'''Hardware configuration:'''
−
* Dell 1U R440 server (1 Xeon Silver 4110)
+
* Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t)
−
* RAM: 64GB (DDR4@2666)
+
* RAM: 128GB (DDR4@2666)
* Disks:
* Disks:
−
** 2x4 TB SATA HDD (hardware RAID1) : /srv
+
** 1 x 16 GB SSD M.2 Intel Optane 16GB
−
** 2x14 TB SATA HDD (hardware RAID1) : /srv2 (images, imports)
+
** 1 x 1 TB SSD M.2 Samsung SSD 970 EVO Plus
+
** 1 x 2 TB SSD M.2 Western Digital WD_BLACK SN770
+
** 4 x 14 TB SATA HDD Toshiba TOSHIBA_MG07ACA14TEY
'''Running services:'''
'''Running services:'''
−
* OS: debian 9.5
+
* OS: Proxmox
* 1 nginx reverse proxy to serve static files
* 1 nginx reverse proxy to serve static files
* 1 apache + mod_perl to generate dynamic pages + API
* 1 apache + mod_perl to generate dynamic pages + API
Line 29:
Line 43:
'''Hardware configuration:'''
'''Hardware configuration:'''
−
* Dell 1U R440 server (1 Xeon Silver 4110)
+
* Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t)
−
* RAM: 64GB (DDR4@2666)
+
* RAM: 128GB (DDR4@2666)
* Disks:
* Disks:
−
** 2x4 TB SATA HDD (hardware RAID1) : /srv
+
** 1 x 16 GB SSD M.2 Intel Optane 16GB
−
** 2x14 TB SATA HDD (hardware RAID1) : /srv2 (images, imports)
+
** 1 x 1 TB SSD M.2 Samsung SSD 970 EVO Plus
+
** 2 x 2 TB SSD M.2 Western Digital WD_BLACK SN770
+
** 4 x 14 TB SATA HDD
'''Running services:'''
'''Running services:'''
−
* OS: debian 9.5
+
* OS: Proxmox
* 1 apache + mod_perl (not used)
* 1 apache + mod_perl (not used)
* 1 MongoDB (production)
* 1 MongoDB (production)
+
+
=== no name yet ===
+
Dedicated OVH - soyoustart server (rented):
+
+
'''Hardware configuration:'''
+
* E3-SAT-1-32
+
* Storage: SoftRaid 3x2To SATA
+
* RAM: 32GB DDR3 1333 MHz
+
* CPU: Xeon E3-1245v2 (4c/8th)
+
'''Running services:'''
+
* wiki
+
* zammad (soon)
=== dev ===
=== dev ===
−
Dedicated OVH server (rented):
+
Dedicated OVH - soyoustart server (rented):
'''Hardware configuration:'''
'''Hardware configuration:'''
Line 49:
Line 77:
'''Running services:'''
'''Running services:'''
* OS: debian 9.8
* OS: debian 9.8
−
* 1 robotoff (dockerized)
* 1 nginx reverse proxy
* 1 nginx reverse proxy
−
* 1 apache + mod_perl (https://world.dev.openfoodfacts.org - auth: off / off)
+
* 1 apache + mod_perl (https://openfoodfacts.dev - auth: off / off)
* 1 mongodb
* 1 mongodb
Line 83:
Line 110:
** 16GB Intel Optane SSD: write journal (ZIL)
** 16GB Intel Optane SSD: write journal (ZIL)
* RAM: 128GB
* RAM: 128GB
−
* CPU: '''Running services:'''
+
* CPU:
+
'''Running services:'''
* OS: Proxmox 6 (debian 10 based)
* OS: Proxmox 6 (debian 10 based)
* Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots)
* Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots)
* Proxmox CT/VM replication
* Proxmox CT/VM replication
+
+
=== ovh1 ===
+
VM/CT server for computing usages.
+
+
See [[Infrastructure/VM cluster]].
+
+
'''Hardware configuration:'''
+
* CPU: AMD Epyc 7451 (24c/48t)
+
* RAM: 256GB
+
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.1) on vRack
+
* 2 x 1TB SSD NVMe
+
+
Partition / storage:
+
* Ext4 root partition: 32Gb on RAID1 /dev/md2
+
* 512MB swap
+
* 920GB ZFS pool on remaining space (mirror)
+
+
'''Running services:'''
+
* OS: Proxmox 6 (based on debian 10 buster)
+
+
=== ovh2 ===
+
VM/CT server for computing usages (same as ovh1).
+
+
See [[Infrastructure/VM cluster]].
+
+
'''Hardware configuration:'''
+
* CPU: AMD Epyc 7451 (24c/48t)
+
* RAM: 256GB
+
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.2) on vRack
+
* 2 x 1TB SSD NVMe
+
+
Partition / storage:
+
* Ext4 root partition: 32Gb on RAID1 /dev/md2
+
* 512MB swap
+
* 920GB ZFS pool on remaining space (mirror)
+
+
'''Running services:'''
+
* OS: Proxmox 6 (based on debian 10 buster)
+
+
=== ovh3 ===
+
Mainly storage server, VM/CT host is needed.
+
+
See [[Infrastructure/VM cluster]].
+
+
'''Hardware configuration:'''
+
* CPU: Intel Xeon-D 1541 (8c/16t)
+
* RAM: 32GB
+
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.3)
+
+
Partition / storage:
+
* Ext4 root partition: 32Gb on SSD
+
* 512MB swap
+
* 5GB ZFS ZIL (write journal)
+
* 472GB ZFS cache (ARC2 read cache)
+
+
* ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available)
+
+
'''Running services:'''
+
* OS: Proxmox 6 (based on debian 10 buster)
+
+
=== ovh4 ===
+
Mainly storage server, VM/CT host is needed.
+
+
See [[Infrastructure/VM cluster]].
+
+
'''Hardware configuration:'''
+
* CPU: Intel Xeon-D 1541 (8c/16t)
+
* RAM: 32GB
+
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.4)
+
+
Partition / storage:
+
* Ext4 root partition: 32Gb on SSD
+
* 512MB swap
+
* 5GB ZFS ZIL (write journal)
+
* 472GB ZFS cache (ARC2 read cache)
+
+
* ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available)
+
+
'''Running services:'''
+
* OS: Proxmox 6 (based on debian 10 buster)
== History ==
== History ==