/[gentoo]/xml/htdocs/doc/en/source_mirrors.xml
Gentoo

Diff of /xml/htdocs/doc/en/source_mirrors.xml

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

Revision 1.8 Revision 1.40
1<?xml version='1.0' encoding="UTF-8"?> 1<?xml version='1.0' encoding="UTF-8"?>
2<!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.40 2012/05/07 19:07:17 darkside Exp $ -->
2<!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> 3<!DOCTYPE guide SYSTEM "/dtd/guide.dtd">
3 4
4<guide link="/doc/en/source_mirrors.xml"> 5<guide>
6
5<title>Gentoo Linux Source Mirrors Policy</title> 7<title>Gentoo Linux Source Mirrors Policy</title>
6<author title="Author"><mail link="klieber@gentoo.org">Kurt Lieber</mail></author>
7 8
9<author title="Author">
10 <mail link="klieber@gentoo.org">Kurt Lieber</mail>
11</author>
12<author title="Editor">
13 <mail link="cshields@gentoo.org">Corey Shields</mail>
14</author>
15<author title="Editor">
16 <mail link="bennyc@gentoo.org">Benny Chuang</mail>
17</author>
18<author title="Editor">
19 <mail link="jforman@gentoo.org">Jeffrey Forman</mail>
20</author>
21<author title="Editor">
22 <mail link="robbat2@gentoo.org">Robin H. Johnson</mail>
23</author>
24<author title="Editor">
25 <mail link="fox2mike@gentoo.org">Shyam Mani</mail>
26</author>
27
28<abstract>
29This document explains the requirements for source mirrors.
30</abstract>
31
32<!-- The content of this document is licensed under the CC-BY-SA license -->
33<!-- See http://creativecommons.org/licenses/by-sa/2.5 -->
34<license/>
8<version>1.1</version> 35<version>1.15</version>
9<date>17 Feb 2003</date> 36<date>2012-05-07</date>
10 37
11<chapter> 38<chapter>
12<title>Requirements</title> 39<title>Requirements</title>
13<section> 40<section>
14<title>Minimum Bandwidth</title> 41<title>Minimum Bandwidth</title>
15<body> 42<body>
43
44<p>
16<p> To properly host a source mirror you should have a minimum of 2Mbps upstream bandwidth. 45To properly host a source mirror, you should have a minimum of 5Mbps upstream
17ADSL and cable connections do not generally make adequate connections for distfile hosts due to their limited upstream performance.</p> 46bandwidth. ADSL and cable connections do not generally make adequate
47connections for distfile hosts due to their limited upstream performance.
48</p>
49
50</body>
51</section>
52<section>
53<title>Minimum Disk Space</title>
54<body>
55
56<p>
57The space requirements depend on whether you choose to run a "Full" mirror or a
58"Distfiles only" mirror. Full mirrors require 240 GB of disk space. Distfiles
59only mirrors require 150 GB of space.
60</p>
61
18</body> 62</body>
19</section> 63</section>
20<section> 64<section>
21<title>Minimum User Count</title> 65<title>Minimum User Count</title>
22<body> 66<body>
67
68<p>
23<p>We ask that you support a minimum of 5 and preferrably 10 concurrent user connections.</p> 69We ask that you support a minimum of 15 and preferrably 30 or more concurrent
70user connections.
71</p>
72
24</body> 73</body>
25</section> 74</section>
26<section> 75<section>
27<title>Update Frequency</title> 76<title>Update Frequency</title>
28<body> 77<body>
78
79<p>
29<p>All mirrors must be synchronized every four hours, starting at midnight, UTC.</p> 80All mirrors must be synchronized every four hours, starting at midnight in your
81local time zone. This helps distribute the load out over a period of time,
82rather than having all mirrors synchronize at the same time.
83</p>
84
85</body>
86</section>
87<section>
88<title>Mirror Needs</title>
89<body>
90
91<p>
92Your mirror may not be added immediately to our listing and given access to the
93private distribution point. We add mirrors on an as-needed basis so as not to
94clutter up the listing, and to provide an adequate amount of high speed mirrors.
95You are more than welcome to peek in <uri
96link="irc://irc.gentoo.org/gentoo-mirrors">#gentoo-mirrors</uri> on IRC and chat
97up to see the status of your mirror being added to our official network.
98</p>
99
30</body> 100</body>
31</section> 101</section>
32</chapter> 102</chapter>
103
33<chapter> 104<chapter>
34<title>Implementation details</title> 105<title>Implementation details</title>
35<section> 106<section>
36<body> 107<body>
108
109<p>
37<p>for new source mirror requests, the procedure will be as follows:</p> 110For new source mirror requests, the procedure will be as follows:
38<p>Set up your server to rsync with www.ibiblio.org::gentoo. Once you have a complete mirror of that server, please file a bug report on bugs.gentoo.org under the "rsync" category stating that you have a new mirror and wish it to be added to the list of official mirrors.</p> 111</p>
39<p>We will then verify that the mirror exists and we can connect to it properly. Then, in the next 48-72 hours we will determine if your mirror is syncing correctly and in accordance with this policy.</p>
40 112
41<p>If all steps went smoothly, we will then add you to our list of <uri link="http://www.gentoo.org/main/en/mirrors.xml">download mirrors</uri> on the main web site. We will also send you the login information for our private master distfile mirror which is only available to official Gentoo Linux source mirrors.</p>
42
43<p>Additionally, you, the mirror admin will be added to the gentoo-mirrors mailing list (low traffic) so that you can follow all issues associated with source mirrors.
44</p> 113<p>
114Set up your server to rsync with ftp.ussg.iu.edu::gentoo-distfiles. Once you
115have a complete mirror of that server, please file a bug report on <uri
116link="http://bugs.gentoo.org/enter_bug.cgi?product=Mirrors">bugs.gentoo.org</uri>
117under the <c>Mirrors</c> category stating that you have a new mirror and wish
118it to be added to the list of official mirrors. Please specify whether you
119wish to be a "Full" mirror or "Distfiles only" mirror. Distfiles
120only mirrors will be designated as such on the website.
121</p>
122
123<p>
124Full mirrors must carry the following directories (plus any directories that
125get added in the future):
126</p>
127
128<ul>
129 <li>/releases (60G)</li>
130 <li>/experimental (10-20G)</li>
131 <li>/distfiles (160G)</li>
132 <li>/snapshots (1G)</li>
133</ul>
134
135<p>
136Distfiles only mirrors need to carry the following directories:
137</p>
138
139<ul>
140 <li>/distfiles (160G)</li>
141 <li>/snapshots (1G)</li>
142</ul>
143
144<p>
145We will then verify that the mirror exists and we can connect to it properly.
146Then, in the next 2 weeks, we will determine if your mirror is syncing
147correctly and in accordance with this policy.
148</p>
149
150<p>
151If all steps went smoothly, we will then add you to our list of <uri
152link="/main/en/mirrors2.xml">download mirrors</uri> on the main web site. We
153will also send you the login information for our private master distfile mirror
154which is only available to official Gentoo Linux source mirrors.
155</p>
156
157<p>
158Additionally, you, the mirror admin, will be requested to subscribe to the
159gentoo-mirrors mailing list (low traffic) so that you can follow all issues
160associated with source mirrors.
161</p>
162
45<note> 163<note>
46Thanks for helping out Gentoo Linux users and developers! :) For any mirror administration issues or problems, please contact <mail link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. 164Thanks for helping out Gentoo Linux users and developers! :) For any mirror
165administration issues or problems, please contact <mail
166link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>.
47</note> 167</note>
168
169<warn>
170Do NOT email mirror-admin@gentoo.org for mirror requests, please file a bug. It
171makes mirror tracking easier on us.
172</warn>
173
48</body> 174</body>
49</section> 175</section>
50</chapter> 176</chapter>
177
51<chapter> 178<chapter>
52<title>Short FAQ</title> 179<title>Short FAQ</title>
53<section> 180<section>
181<title>
54<title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> 182Q: Who should I contact regarding new mirrors or to get my mirror added to the
183Gentoo web site?
184</title>
55<body> 185<body>
186
187<p>
56<p>A: Please file a bug on bugs.gentoo.org under the rsync category.</p> 188A: Please file a bug on bugs.gentoo.org under the <c>Mirrors</c> category.
189</p>
190
57</body> 191</body>
58</section> 192</section>
59<section> 193<section>
60<title>Q: Who should I contact regarding mirror issues and maintenance?</title> 194<title>Q: Who should I contact regarding mirror issues and maintenance?</title>
61<body> 195<body>
196
197<p>
62<p>A: Please file a bug on bugs.gentoo.org under the rsync category.</p> 198A: Please file a bug on bugs.gentoo.org under the <c>Mirrors</c> category.
63</body> 199</p>
64</section>
65 200
201</body>
66<section> 202</section>
203<section>
204<title>
205Q: I run a private source mirror for my company. Can I still access the
206private master source mirror?
207</title>
208<body>
209
210<p>
211A: Because our resources are limited, we need to ensure we allocate them in
212such a way to provide the maximum amount of benefit to our users. As such, we
213limit connections to our master rsync and distfile mirrors to public mirrors
214only. Users are welcome to use our regular mirror system to establish a
215private source mirror.
216</p>
217
218</body>
219</section>
220<section>
67<title>Q) How do I find the mirror nearest to me?</title> 221<title>Q: How do I find the mirror nearest to me?</title>
68<body>
69<p>A) mirrorselect was designed to do this for you. If you haven't already run <c>emerge mirrorselect</c> then do it.
70Then run: <c>mirrorselect</c>. An ncurses-based menu will display allowing you to select a mirror close to you.
71</p>
72</body> 222<body>
73</section> 223
224<p>
225A: mirrorselect was designed to do this for you. If you haven't already run
226<c>emerge mirrorselect</c>, then please do so. Then run: <c>mirrorselect</c>.
227An ncurses-based menu will display allowing you to select a mirror close to
228you.
229</p>
230
231</body>
74<section> 232</section>
75<title>Q) How much space does a full source mirror require?</title>
76<body>
77<p>A) At the moment, a full mirror requires between 30GB and 40GB of disk space.
78</p>
79</body>
80</section> 233<section>
234<title>
235Q: I don't have that much disk space. Can I mirror part of the sources?
236</title>
237<body>
238
239<p>
240A: Yes, if you are unable to mirror our full sources, you can elect to mirror
241the following two directories only:
242</p>
243
244<ul>
245 <li>/distfiles</li>
246 <li>/snapshots</li>
247</ul>
248
249<p>
250These two directories will require approximately 50GB of space and you will be
251listed on our site as a distfiles-only mirror.
252</p>
253
254</body>
81<section> 255</section>
256<section>
257<title>
82<title>Q) Do I have to turn on Directory Indexing for directories served up via HTTP?</title> 258Q: Do I have to turn on Directory Indexing for directories served up via HTTP?
259</title>
260<body>
261
262<p>
263A: Directory Indexing is required for the /releases and /experimental
264directories, but can be turned off for all other directories (including
265/distfiles) if you wish.
266</p>
267
83<body> 268</body>
84<p>A) Direcetory Indexing is required for the /releases and /experimental directories, but can be turned off for all other directories (including /distfiles) if you wish. 269</section>
270
271<section>
272<title>Q: Do I have to mirror historical? I mean, it is old releases.</title>
273<body>
274
85</p> 275<p>
276A: Of course not, it is quite a bit of data. In your rsync command, add
277<path>--exclude=/releases/historical</path> to your rsync options. This will
278exclude historical and save you quite a bit of space.
279</p>
280
86</body> 281</body>
87</section> 282</section>
88</chapter> 283</chapter>
89</guide> 284</guide>

Legend:
Removed from v.1.8  
changed lines
  Added in v.1.40

  ViewVC Help
Powered by ViewVC 1.1.20