So as Auke stated, making a mirror will be very inefficient and time/space consuming. I
think your best option is to use our mixer-tools, and create your own update content that
mirrors our own. Take a look here:
This will outline the steps to actually create a full, working Clear update of your own,
just like the ones you see upstream in our update section. However, you will need to make
a couple changes to avoid downloading RPM's from upstream every single time you create
an update/release. If you follow the setup in that link, it will enable you to orchestrate
your own Clear "mixes", which can be composed of only Clear content, thus you
essentially have a "mirror" of our updates or versions, and you can decide what
content you want to be in it (you can just build it with all bundles and have a full
copy). The changes you will want to do in order to avoid massive network transfers are:
1.) Figure out which version you want to use (i.e latest, etc), and download the content
from here https://download.clearlinux.org/releases/9130/clear/x86_64/os/
This is the repo that contains all the RPM's for that version, and this URL is where
mixer goes to grab the RPM's it needs. After you copy this (this will be your only
outward network transfer), you will be locked on that version's content if you want to
avoid making any more network transfers. To update to new upstream content you will need
to copy the folder from the new version again, this is up to your discretion when/how
often you want to do it.
2.) In your .yum-mix.conf, change the baseurl= in the [clear] subsection to point to where
your -local- "os" folder that you downloaded resides, i.e
Yum understands the file protocol so instead of going out to clearlinux.org
, it will now
look up your local path to download the rpm's.
3.) Follow the steps outlined in the mixer documentation, and you will have a full,
working Clear update that you can then point your VM or Clear image to.
To update your Clear image to your "mixer" image, you must do a swupd verify
--fix and provide it the URL where your mixer update content is stored, such as some
local apache server that you can set up on your machine. After that point, your Clear
image will look at your local URL's for subsequent updates.
This is probably the best way to do this for now, but the process is being updated to make
From: Kok, Auke-jan H
Sent: Friday, July 01, 2016 2:59 PM
To: Marcu, Tudor
Subject: Fwd: Re: [Dev] About mirroring Clear Linux download repo
-------- Forwarded Message --------
Subject: Re: [Dev] About mirroring Clear Linux download repo
Date: Fri, 1 Jul 2016 14:38:55 -0700
From: Auke Kok <auke-jan.h.kok(a)intel.com>
To: Kexy Biscuit <kexybiscuit(a)outlook.com>, dev(a)lists.clearlinux.org
On 07/01/2016 08:07 AM, Kexy Biscuit wrote:
Dear Clear Linux developers,
I want to deploy Clear Linux in China. As we all know, China's international
network connection is slow, and for university in China, international
bandwidth is charged by flow.
As a result, I'd like to know how to create a mirror for
. I would like to know if there is a rsync address,
or a git address, and how big is the whole repo.
contains several large components:
- rpms and src.rpms for each released package
- images for each version
- software update repositories for each released version
Each of these components is possibly terabytes of data, making mirroring
prohibitive. For this reason we are not offering rsync archives, and
logically, mirroring yourself will be expensive if bandwidth usage is
your cost factor. To give an indication of size: Each day several
gigabytes of data are updated on our download server.
I'd strongly discourage people to make mirrors for that reason.
Dev mailing list