Set up mirrors page on voxpupuli.org

@ripienaar

Track mirror offers and set up mirrors page.

I think it makes sense to also provide apt/yum mirrors under voxpupuli.org, bevause that's an established domain. This could either be a redirect to the existing mirror or an actual mirror(s). Some people also offered us mirror resources, like @ripienaar.

@evgeni

For Foreman's repos our setup has a webserver at OSUOSL to send the correct caching headers and then it's fronted by a sponsored Fastly account.

More specifically, profiles::repo::deb and profiles::repo::rpm are the backend profiles. The deb caching headers and rpm caching headers are probably the most interesting parts. Note we also have scripts in our publishing pipelines to clear caches on the CDN to ensure content is fresh.

Today Overlook InfraTech's hosting uses the s3-compatible hosting at OSUOSL and I don't know if that can also send caching headers. If you don't use those, the CDN usage may be a lot higher because it can't cache. Even though it's sponsored, I think it's only up to a certain point. Another risk is that you could end up overloading your backend.

@evgeni set up a large part of that infra and I'm sure he's happy to answer questions. (see #50)

Liquid Telecom/Cassava Technologies would be happy to offer mirror services for Africa should it be needed - happy to chat on slack/irc or other platform if needed

@jessereynolds

From @jessereynolds

mirror.aarnet.edu.au have told me in a ticket (SD-58121) that they'd be happy to mirror openvox, once rsync is ready. They hope that they can be added to an acl to bypass rate limiting that often bites them with other repos they mirror. And they of course want to know what kind of size it might be (approx 5GB at the moment but it will grow a bunch, if anyone has any estimates there that'd be helpful) ... AARNET is the australian academic and research network that provides high speed internet access to universities and similar organisations, and back in the day was the internet in Australia.

@ripienaar

Mirror offers or opportunities:

@ripienaar
Hetzner (via @bastelfreak)
University of Chicago (via Lincoln Bryant)
https://openvox.repo.nfrance.com/ <--- a mirror in France (near Toulouse) (from Phillipe Beaumont )

@anthonysomerset

From @anthonysomerset

Liquid Intelligent Technologies is now available as a mirror for openvox - based in Nairobi, Kenya on 10gig pipes
https://openvox.mirror.liquidtelecom.com/
rsync available at openvox.mirror.liquidtelecom.com either
openvox = ALL
openvox-apt = APT only
openvox-yum = YUM only
currently syncing via rclone every 12 hours will refine as needed/requested - ideally switching to rsync later if possible
oh and IPV6 too 😉 (edited)

Maybe an unusual question, but: do you actually need mirrors?
They usually come at a very high maintenance cost: you need to keep them in sync, inform the users which one to use etc.
If you can get CDN sponsoring (Fastly, Bunny, whoever), you have a single place for all of that and don't need to worry.

In the past I've asked SNT to mirror oVirt and they happily did for a long time. https://www.snt.utwente.nl/en/service/ftp-server. Having said that, I was also thinking about Fastly sponsoring, which #50 is about.

If we get fastly, we need it less, but we should still offer the ability so that people can grab an internal copy easily (for their internal repo servers)

Additionally, once rsync is working I'll request mirroring on mirror.rackspace.com, likely mirror.rackspace.com/openvox/(yum|apt)/

What mechanism will be used to choose mirrors? Will a mirror list be maintained and - at least rhel - the fastest mirror plugin will then required by the release rol?

What about deb?

The background with the question is how is that list maintained and how quick can mirrors be added and removed, moved etc?

Trying to figure out the effort in maintaining public mirrors and how sticky things have to be over the long run.

It would also be useful to get some idea about bandwidth usage. One can extrapolate from puppet repos maybe in case someone knows? (We would now be way below that but in time more etc)

My view of the ideal world would be

a CDN based primary mirror on the openvox domain for default install instructions which will be adequate for the majority of users
allow syncing of the mirror via a recognised mechanism for anyone that needs to for any sensible reason - and provide guidance e.g. size, recommended sync interval etc
provide additional documentation that provides a maintained list of mirrors and generic instructions for how to use these instead of the default mirror/release file e.g. remove the release package, manually create a repo/sources file for your given OS (or better yet a pointer to example manifests to configure via openvox)

The users that would "need" to use a custom mirror are ultimately going to know how to maintain such a mirror and how to configure it, this isn't like an OS level package mirror where we need to potentially cater for all skill levels

I'm happy to provide an AU based mirror. I have fibre and a static IP, so should be pretty solid.

I can offer up a East Coast CA mirror

Host: mirror.its.dal.ca (HTTP/HTTPS/RSYNC)
Connectivity: 10GbE to CANet IPv4/IPv6 available
Contact: karl.vollmer@dal.ca

Add a Repositories and mirrors page to the OpenVox 8.x and 9.x docs

The mirrors listed in this issue are now published at https://docs.openvoxproject.org/openvox/latest/mirrors.html (OpenVoxProject/openvox-docs#481). The page also explains how to point agents at a mirror and how to run your own. New mirror offers posted here will be added to that page.

@miharp

Hello @miharp, could you please add @ovh's mirror to the list? It's at http://openvox.mirrors.ovh.net/ and https://openvox.mirrors.ovh.net/ (IPv4-only for now), synced daily. It's anycast with 5 Gbit/s in per location, currently:

Australia (Sydney)
Canada (Beauharnois, Toronto)
France (Gravelines, Paris, Roubaix, Strasbourg)
India (Mumbai)
Italy (Milan)
Singapore (Singapore)

You can reach the team managing the mirror at mirror@ovh.net.

EDIT: I created OpenVoxProject/openvox-docs#528 to add it to the doc.

Add the OVHcloud mirror to the public mirrors table

Navigation Menu

Repository navigation

Set up mirrors page on voxpupuli.org #41

13 remaining items

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Set up mirrors page on voxpupuli.org #41

Description

Activity

ekohl commented on Jan 28, 2025

anthonysomerset commented on Jan 29, 2025

binford2k commented on Feb 13, 2025

binford2k commented on Feb 13, 2025

binford2k commented on Feb 13, 2025

evgeni commented on Feb 13, 2025

ekohl commented on Feb 13, 2025

jstraw commented on Feb 13, 2025

ripienaar commented on Feb 13, 2025

anthonysomerset commented on Feb 14, 2025

albatrossflavour commented on Feb 25, 2025

vollmerk commented on Feb 25, 2025

13 remaining items

miharp commented on Oct 13, 2026

sbraz commented on Oct 14, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions