Changes

Jump to navigation Jump to search
2,773 bytes added ,  09:12, 16 May 2021
no edit summary
Line 1: Line 1:  
[[Category:ProductOpener]]
 
[[Category:ProductOpener]]
 
[[Category:Developer]]
 
[[Category:Developer]]
 +
[[Category:Roadmap]]
    
This page describes the hardware/software infrastructure for the Open Food Facts + Open Beauty Facts projects.
 
This page describes the hardware/software infrastructure for the Open Food Facts + Open Beauty Facts projects.
Line 7: Line 8:     
* Hardware needs: [[Infrastructure Planning]]
 
* Hardware needs: [[Infrastructure Planning]]
 +
 +
== 2021 roadmap ==
 +
* Please expand desirable objectives (not hardware needs)
 +
*
 +
* …
    
== Current infrastructure ==
 
== Current infrastructure ==
Line 14: Line 20:     
'''Hardware configuration:'''
 
'''Hardware configuration:'''
* Dell 1U R440 server (1 Xeon Silver 4110)
+
* Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t)
 
* RAM: 64GB (DDR4@2666)
 
* RAM: 64GB (DDR4@2666)
 
* Disks:
 
* Disks:
Line 29: Line 35:     
'''Hardware configuration:'''
 
'''Hardware configuration:'''
* Dell 1U R440 server (1 Xeon Silver 4110)
+
* Dell 1U R440 server (1 Xeon Silver 4110: 8c/16t)
 
* RAM: 64GB (DDR4@2666)
 
* RAM: 64GB (DDR4@2666)
 
* Disks:
 
* Disks:
Line 38: Line 44:  
* 1 apache + mod_perl (not used)
 
* 1 apache + mod_perl (not used)
 
* 1 MongoDB (production)
 
* 1 MongoDB (production)
 +
* Robotoff (dockerized)
 +
 +
=== robotoff ===
 +
Hetzner - cpx51
 +
 +
'''Hardware configuration:'''
 +
* 16 vCPU
 +
* Storage: 50GB
 +
* RAM: 32GB
 +
'''Running services:'''
 +
* Tensorflow Serving (Tensorflow ML models)
 +
* Robotoff ANN API: logo similarity service, memory-hungry
 +
 +
=== no name yet ===
 +
Dedicated OVH - soyoustart server (rented):
 +
 +
'''Hardware configuration:'''
 +
* E3-SAT-1-32
 +
* Storage: SoftRaid 3x2To SATA
 +
* RAM: 32GB DDR3 1333 MHz
 +
* CPU: Xeon E3-1245v2 (4c/8th)
 +
'''Running services:'''
 +
* wiki
 +
* zammad (soon)
    
=== dev ===
 
=== dev ===
Dedicated OVH server (rented):
+
Dedicated OVH - soyoustart server (rented):
    
'''Hardware configuration:'''
 
'''Hardware configuration:'''
Line 49: Line 79:  
'''Running services:'''
 
'''Running services:'''
 
* OS: debian 9.8
 
* OS: debian 9.8
* 1 robotoff (dockerized)
   
* 1 nginx reverse proxy
 
* 1 nginx reverse proxy
* 1 apache + mod_perl (https://world.dev.openfoodfacts.org - auth: off / off)
+
* 1 apache + mod_perl (https://openfoodfacts.dev - auth: off / off)
 
* 1 mongodb
 
* 1 mongodb
   Line 58: Line 87:     
'''Hardware configuration:'''
 
'''Hardware configuration:'''
* Dell R710 server
+
* Dell R710 server (2U)
 
* Storage (ZFS pool) with:
 
* Storage (ZFS pool) with:
 
** 6 x 2TB HITACHI HUS72402 (SAS)
 
** 6 x 2TB HITACHI HUS72402 (SAS)
Line 67: Line 96:  
'''Running services:'''
 
'''Running services:'''
 
* OS: Proxmox 6 (debian 10 based)
 
* OS: Proxmox 6 (debian 10 based)
 +
 +
'''Network''':
 +
* uplink: optic fiber from OVH (1G down/500M up) with dedicated IPv4 and IPv6/72
 +
* ethernet 1Gbps (bonded for backup)
 +
* infiniband 40Gbps (proxmox cluster backbone + access to storage server)
    
=== backup ===
 
=== backup ===
Line 72: Line 106:     
'''Hardware configuration:'''
 
'''Hardware configuration:'''
* Supermicro storage server
+
* Supermicro storage server (4U)
 
* Storage (ZFS pool) with:
 
* Storage (ZFS pool) with:
 
** 36 SAS bays (populated disks evolving with time are needs)
 
** 36 SAS bays (populated disks evolving with time are needs)
Line 78: Line 112:  
** 16GB Intel Optane SSD: write journal (ZIL)
 
** 16GB Intel Optane SSD: write journal (ZIL)
 
* RAM: 128GB
 
* RAM: 128GB
* CPU: '''Running services:'''
+
* CPU:  
 +
'''Running services:'''
 
* OS: Proxmox 6 (debian 10 based)
 
* OS: Proxmox 6 (debian 10 based)
 
* Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots)
 
* Local NFS access from dev2 to /srv /srv2 backups (nghtly rsync + ZFS snapshots)
 
* Proxmox CT/VM replication
 
* Proxmox CT/VM replication
 +
 +
=== ovh1 ===
 +
VM/CT server for computing usages.
 +
 +
See [[Infrastructure/VM cluster]].
 +
 +
'''Hardware configuration:'''
 +
* CPU: AMD Epyc 7451 (24c/48t)
 +
* RAM: 256GB
 +
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.1) on vRack
 +
* 2 x 1TB SSD NVMe
 +
 +
Partition / storage:
 +
* Ext4 root partition: 32Gb on RAID1 /dev/md2
 +
* 512MB swap
 +
* 920GB ZFS pool on remaining space (mirror)
 +
 +
'''Running services:'''
 +
* OS: Proxmox 6 (based on debian 10 buster)
 +
 +
=== ovh2 ===
 +
VM/CT server for computing usages (same as ovh1).
 +
 +
See [[Infrastructure/VM cluster]].
 +
 +
'''Hardware configuration:'''
 +
* CPU: AMD Epyc 7451 (24c/48t)
 +
* RAM: 256GB
 +
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.2) on vRack
 +
* 2 x 1TB SSD NVMe
 +
 +
Partition / storage:
 +
* Ext4 root partition: 32Gb on RAID1 /dev/md2
 +
* 512MB swap
 +
* 920GB ZFS pool on remaining space (mirror)
 +
 +
'''Running services:'''
 +
* OS: Proxmox 6 (based on debian 10 buster)
 +
 +
=== ovh3 ===
 +
Mainly storage server, VM/CT host is needed.
 +
 +
See [[Infrastructure/VM cluster]].
 +
 +
'''Hardware configuration:'''
 +
* CPU: Intel Xeon-D 1541 (8c/16t)
 +
* RAM: 32GB
 +
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.3)
 +
 +
Partition / storage:
 +
* Ext4 root partition: 32Gb on SSD
 +
* 512MB swap
 +
* 5GB ZFS ZIL (write journal)
 +
* 472GB ZFS cache (ARC2 read cache)
 +
 +
* ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available)
 +
 +
'''Running services:'''
 +
* OS: Proxmox 6 (based on debian 10 buster)
 +
 +
=== ovh4 ===
 +
Mainly storage server, VM/CT host is needed.
 +
 +
See [[Infrastructure/VM cluster]].
 +
 +
'''Hardware configuration:'''
 +
* CPU: Intel Xeon-D 1541 (8c/16t)
 +
* RAM: 32GB
 +
* 1 GB/s public bandwith; 3 GB/s private bandwith (10.0.0.4)
 +
 +
Partition / storage:
 +
* Ext4 root partition: 32Gb on SSD
 +
* 512MB swap
 +
* 5GB ZFS ZIL (write journal)
 +
* 472GB ZFS cache (ARC2 read cache)
 +
 +
* ZFS storage (6 x 12TB HDD) in RAIDZ2 (2 disks for redundancy, around 42TB available)
 +
 +
'''Running services:'''
 +
* OS: Proxmox 6 (based on debian 10 buster)
    
== History ==
 
== History ==

Navigation menu