| 1 | <?xml version='1.0' encoding="UTF-8"?> |
1 | <?xml version='1.0' encoding="UTF-8"?> |
|
|
2 | <!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.27 2005/04/12 17:52:20 alin Exp $ --> |
| 2 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
3 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
| 3 | |
4 | |
| 4 | <guide link="/doc/en/source_mirrors.xml"> |
5 | <guide link="/doc/en/source_mirrors.xml"> |
| 5 | <title>Gentoo Linux Source Mirrors Policy</title> |
6 | <title>Gentoo Linux Source Mirrors Policy</title> |
| 6 | <author title="Author"><mail link="klieber@gentoo.org">Kurt Lieber</mail></author> |
7 | <author title="Author"> |
|
|
8 | <mail link="klieber@gentoo.org">Kurt Lieber</mail> |
|
|
9 | </author> |
|
|
10 | <author title="Editor"> |
|
|
11 | <mail link="cshields@gentoo.org">Corey Shields</mail> |
|
|
12 | </author> |
|
|
13 | <author title="Editor"> |
|
|
14 | <mail link="bennyc@gentoo.org">Benny Chuang</mail> |
|
|
15 | </author> |
|
|
16 | <author title="Editor"> |
|
|
17 | <mail link="jforman@gentoo.org">Jeffrey Forman</mail> |
|
|
18 | </author> |
| 7 | |
19 | |
|
|
20 | <abstract> |
|
|
21 | This document explains the requirements for source mirrors. |
|
|
22 | </abstract> |
|
|
23 | |
|
|
24 | <license/> |
| 8 | <version>1.1</version> |
25 | <version>1.6</version> |
| 9 | <date>17 Feb 2003</date> |
26 | <date>2005-04-11</date> |
| 10 | |
27 | |
| 11 | <chapter> |
28 | <chapter> |
| 12 | <title>Requirements</title> |
29 | <title>Requirements</title> |
| 13 | <section> |
30 | <section> |
| 14 | <title>Minimum Bandwidth</title> |
31 | <title>Minimum Bandwidth</title> |
| 15 | <body> |
32 | <body> |
|
|
33 | |
|
|
34 | <p> |
| 16 | <p> To properly host a source mirror you should have a minimum of 5Mbps upstream bandwidth. |
35 | To properly host a source mirror, you should have a minimum of 5Mbps upstream |
| 17 | ADSL and cable connections do not generally make adequate connections for distfile hosts due to their limited upstream performance.</p> |
36 | bandwidth. ADSL and cable connections do not generally make adequate |
|
|
37 | connections for distfile hosts due to their limited upstream performance. |
|
|
38 | </p> |
|
|
39 | |
|
|
40 | </body> |
|
|
41 | </section> |
|
|
42 | <section> |
|
|
43 | <title>Minimum Disk Space</title> |
|
|
44 | <body> |
|
|
45 | |
|
|
46 | <p> |
|
|
47 | The space requirements depend on whether you choose to run a "Full" mirror or a |
|
|
48 | "Distfiles only" mirror. Full mirrors require 90 GB of disk space. Distfiles |
|
|
49 | only mirrors require 40 GB of space. |
|
|
50 | </p> |
|
|
51 | |
| 18 | </body> |
52 | </body> |
| 19 | </section> |
53 | </section> |
| 20 | <section> |
54 | <section> |
| 21 | <title>Minimum User Count</title> |
55 | <title>Minimum User Count</title> |
| 22 | <body> |
56 | <body> |
|
|
57 | |
|
|
58 | <p> |
| 23 | <p>We ask that you support a minimum of 15 and preferrably 30 concurrent user connections.</p> |
59 | We ask that you support a minimum of 15 and preferrably 30 concurrent user |
|
|
60 | connections. |
|
|
61 | </p> |
|
|
62 | |
| 24 | </body> |
63 | </body> |
| 25 | </section> |
64 | </section> |
| 26 | <section> |
65 | <section> |
| 27 | <title>Update Frequency</title> |
66 | <title>Update Frequency</title> |
| 28 | <body> |
67 | <body> |
| 29 | <p>All mirrors must be synchronized every four hours, starting at midnight in your local time zone. This helps distribute the load out over a period of time, rather than having all mirrors synchronize at the same time.</p> |
68 | |
|
|
69 | <p> |
|
|
70 | All mirrors must be synchronized every four hours, starting at midnight in your |
|
|
71 | local time zone. This helps distribute the load out over a period of time, |
|
|
72 | rather than having all mirrors synchronize at the same time. |
|
|
73 | </p> |
|
|
74 | </body> |
|
|
75 | </section> |
|
|
76 | |
|
|
77 | <section> |
|
|
78 | <title>Mirror Needs</title> |
|
|
79 | <body> |
|
|
80 | <p> |
|
|
81 | Your mirror may not be added immediately to our listing and given access to the private distribution point. We add mirrors |
|
|
82 | on an as-needed basis so as not to clutter up the listing, and to provide an adequate amount of high speed mirrors. You are more than |
|
|
83 | welcome to peek in #gentoo-mirrors on irc.freenode.org and chat up to see the status of your mirror being added to our official network. |
|
|
84 | </p> |
| 30 | </body> |
85 | </body> |
| 31 | </section> |
86 | </section> |
| 32 | </chapter> |
87 | </chapter> |
|
|
88 | |
| 33 | <chapter> |
89 | <chapter> |
| 34 | <title>Implementation details</title> |
90 | <title>Implementation details</title> |
| 35 | <section> |
91 | <section> |
| 36 | <body> |
92 | <body> |
|
|
93 | |
|
|
94 | <p> |
| 37 | <p>for new source mirror requests, the procedure will be as follows:</p> |
95 | For new source mirror requests, the procedure will be as follows: |
| 38 | <p>Set up your server to rsync with www.ibiblio.org::gentoo. Once you have a complete mirror of that server, please file a bug report on bugs.gentoo.org under the "rsync" category stating that you have a new mirror and wish it to be added to the list of official mirrors.</p> |
96 | </p> |
| 39 | <p>We will then verify that the mirror exists and we can connect to it properly. Then, in the next 48-72 hours we will determine if your mirror is syncing correctly and in accordance with this policy.</p> |
|
|
| 40 | |
97 | |
| 41 | <p>If all steps went smoothly, we will then add you to our list of <uri link="http://www.gentoo.org/main/en/mirrors.xml">download mirrors</uri> on the main web site. We will also send you the login information for our private master distfile mirror which is only available to official Gentoo Linux source mirrors.</p> |
|
|
| 42 | |
|
|
| 43 | <p>Additionally, you, the mirror admin will be added to the gentoo-mirrors mailing list (low traffic) so that you can follow all issues associated with source mirrors. |
|
|
| 44 | </p> |
98 | <p> |
| 45 | <note> |
99 | Set up your server to rsync with ftp.ussg.iu.edu::gentoo-distfiles. Once you |
| 46 | Thanks for helping out Gentoo Linux users and developers! :) For any mirror administration issues or problems, please contact <mail link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
100 | have a complete mirror of that server, please file a bug report on |
| 47 | </note> |
101 | bugs.gentoo.org under the "rsync" category stating that you have a new mirror |
| 48 | </body> |
102 | and wish it to be added to the list of official mirrors. Please specify |
| 49 | </section> |
103 | whether you wish to be a "Full" mirror or "Distfiles only" mirror. Distfiles |
| 50 | </chapter> |
104 | only mirrors will be designated as such on the website. |
| 51 | <chapter> |
105 | </p> |
| 52 | <title>Short FAQ</title> |
106 | |
| 53 | <section> |
|
|
| 54 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
|
|
| 55 | <body> |
|
|
| 56 | <p>A: Please file a bug on bugs.gentoo.org under the rsync category.</p> |
|
|
| 57 | </body> |
|
|
| 58 | </section> |
|
|
| 59 | <section> |
|
|
| 60 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
|
|
| 61 | <body> |
|
|
| 62 | <p>A: Please file a bug on bugs.gentoo.org under the rsync category.</p> |
|
|
| 63 | </body> |
|
|
| 64 | </section> |
|
|
| 65 | <section> |
|
|
| 66 | <title>Q: I run a private source mirror for my company. Can I still access the private master source mirror?</title> |
|
|
| 67 | <body> |
|
|
| 68 | <p>A: Because our resources are limited, we need to ensure we allocate them in such a way |
|
|
| 69 | to provide the maximum amount of benefit to our users. As such, we limit connections |
|
|
| 70 | to our master rsync and distfile mirrors to public mirrors only. Users are welcome to use our regular mirror system to establish a private source mirror. |
|
|
| 71 | </p> |
107 | <p> |
| 72 | </body> |
108 | Full mirrors must carry the following directories (plus any directories that |
| 73 | </section> |
109 | get added in the future): |
| 74 | |
|
|
| 75 | <section> |
|
|
| 76 | <title>Q: How do I find the mirror nearest to me?</title> |
|
|
| 77 | <body> |
|
|
| 78 | <p>A: mirrorselect was designed to do this for you. If you haven't already run <c>emerge mirrorselect</c> then do it. |
|
|
| 79 | Then run: <c>mirrorselect</c>. An ncurses-based menu will display allowing you to select a mirror close to you. |
|
|
| 80 | </p> |
110 | </p> |
| 81 | </body> |
111 | |
| 82 | </section> |
|
|
| 83 | <section> |
|
|
| 84 | <title>Q: How much space does a full source mirror require?</title> |
|
|
| 85 | <body> |
|
|
| 86 | <p>A: At the moment, a full mirror requires between 30GB and 40GB of disk space and comprises the following four directories. |
|
|
| 87 | </p> |
|
|
| 88 | <ul> |
112 | <ul> |
| 89 | <li>/release</li> |
113 | <li>/releases</li> |
| 90 | <li>/experimental</li> |
114 | <li>/experimental</li> |
| 91 | <li>/distfiles</li> |
115 | <li>/distfiles</li> |
| 92 | <li>/snapshots</li> |
116 | <li>/snapshots</li> |
|
|
117 | <li>/grp</li> |
| 93 | </ul> |
118 | </ul> |
| 94 | <p>In order to be a full Gentoo Linux source mirror, we ask that you mirror all four of these directories in their entirety.</p> |
119 | |
| 95 | </body> |
120 | <p> |
| 96 | </section> |
121 | Distfiles only mirrors need to carry the following directories: |
| 97 | <section> |
122 | </p> |
| 98 | <title>Q: I don't have that much disk space. Can I mirror part of the sources?</title> |
123 | |
| 99 | <body> |
|
|
| 100 | <p>A: Yes, if you are unable to mirror our full sources, you can elect to mirror the following two directories only:</p> |
|
|
| 101 | <ul> |
124 | <ul> |
| 102 | <li>/distfiles</li> |
125 | <li>/distfiles</li> |
| 103 | <li>/snapshots</li> |
126 | <li>/snapshots</li> |
| 104 | </ul> |
127 | </ul> |
| 105 | <p>These two directories will require approximately 20GB of space and you will be listed on our site as a distfiles-only mirror.</p> |
128 | |
|
|
129 | <p> |
|
|
130 | We will then verify that the mirror exists and we can connect to it properly. |
|
|
131 | Then, in the next 48-72 hours, we will determine if your mirror is syncing |
|
|
132 | correctly and in accordance with this policy. |
|
|
133 | </p> |
|
|
134 | |
|
|
135 | <p> |
|
|
136 | If all steps went smoothly, we will then add you to our list of <uri |
|
|
137 | link="/main/en/mirrors.xml">download mirrors</uri> on the main web site. We |
|
|
138 | will also send you the login information for our private master distfile mirror |
|
|
139 | which is only available to official Gentoo Linux source mirrors. |
|
|
140 | </p> |
|
|
141 | |
|
|
142 | <p> |
|
|
143 | Additionally, you, the mirror admin, will be requested to subscribe to the |
|
|
144 | gentoo-mirrors mailing list (low traffic) so that you can follow all issues |
|
|
145 | associated with source mirrors. |
|
|
146 | </p> |
|
|
147 | |
|
|
148 | <note> |
|
|
149 | Thanks for helping out Gentoo Linux users and developers! :) For any mirror |
|
|
150 | administration issues or problems, please contact <mail |
|
|
151 | link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
|
|
152 | </note> |
|
|
153 | |
|
|
154 | <warn> |
|
|
155 | Do NOT email mirror-admin@gentoo.org for mirror requests, please file a bug. It makes mirror tracking easier on us. |
|
|
156 | </warn> |
|
|
157 | |
|
|
158 | </body> |
|
|
159 | </section> |
|
|
160 | </chapter> |
|
|
161 | |
|
|
162 | <chapter> |
|
|
163 | <title>Short FAQ</title> |
|
|
164 | <section> |
|
|
165 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
|
|
166 | <body> |
|
|
167 | |
|
|
168 | <p> |
|
|
169 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
|
|
170 | </p> |
|
|
171 | |
|
|
172 | </body> |
|
|
173 | </section> |
|
|
174 | <section> |
|
|
175 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
|
|
176 | <body> |
|
|
177 | |
|
|
178 | <p> |
|
|
179 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
|
|
180 | </p> |
|
|
181 | |
|
|
182 | </body> |
|
|
183 | </section> |
|
|
184 | <section> |
|
|
185 | <title>Q: I run a private source mirror for my company. Can I still access the private master source mirror?</title> |
|
|
186 | <body> |
|
|
187 | |
|
|
188 | <p> |
|
|
189 | A: Because our resources are limited, we need to ensure we allocate them in |
|
|
190 | such a way to provide the maximum amount of benefit to our users. As such, we |
|
|
191 | limit connections to our master rsync and distfile mirrors to public mirrors |
|
|
192 | only. Users are welcome to use our regular mirror system to establish a |
|
|
193 | private source mirror. |
|
|
194 | </p> |
|
|
195 | |
|
|
196 | </body> |
|
|
197 | </section> |
|
|
198 | |
|
|
199 | <section> |
|
|
200 | <title>Q: How do I find the mirror nearest to me?</title> |
|
|
201 | <body> |
|
|
202 | |
|
|
203 | <p> |
|
|
204 | A: mirrorselect was designed to do this for you. If you haven't already run |
|
|
205 | <c>emerge mirrorselect</c>, then please do so. Then run: <c>mirrorselect</c>. |
|
|
206 | An ncurses-based menu will display allowing you to select a mirror close to |
|
|
207 | you. |
|
|
208 | </p> |
|
|
209 | |
|
|
210 | </body> |
|
|
211 | </section> |
|
|
212 | <section> |
|
|
213 | <title>Q: I don't have that much disk space. Can I mirror part of the sources?</title> |
|
|
214 | <body> |
|
|
215 | |
|
|
216 | <p> |
|
|
217 | A: Yes, if you are unable to mirror our full sources, you can elect to mirror |
|
|
218 | the following two directories only: |
|
|
219 | </p> |
|
|
220 | |
|
|
221 | <ul> |
|
|
222 | <li>/distfiles</li> |
|
|
223 | <li>/snapshots</li> |
|
|
224 | </ul> |
|
|
225 | |
|
|
226 | <p> |
|
|
227 | These two directories will require approximately 40GB of space and you will be |
|
|
228 | listed on our site as a distfiles-only mirror. |
|
|
229 | </p> |
|
|
230 | |
| 106 | </body> |
231 | </body> |
| 107 | </section> |
232 | </section> |
| 108 | <section> |
233 | <section> |
| 109 | <title>Q: Do I have to turn on Directory Indexing for directories served up via HTTP?</title> |
234 | <title>Q: Do I have to turn on Directory Indexing for directories served up via HTTP?</title> |
| 110 | <body> |
235 | <body> |
| 111 | <p>A: Directory Indexing is required for the /releases and /experimental directories, but can be turned off for all other directories (including /distfiles) if you wish. |
236 | |
| 112 | </p> |
237 | <p> |
|
|
238 | A: Directory Indexing is required for the /releases and /experimental |
|
|
239 | directories, but can be turned off for all other directories (including |
|
|
240 | /distfiles) if you wish. |
|
|
241 | </p> |
|
|
242 | </body> |
|
|
243 | </section> |
|
|
244 | |
|
|
245 | <section> |
|
|
246 | <title>Q: Do I have to mirror historical? I mean, it is old releases.</title> |
|
|
247 | <body> |
|
|
248 | |
|
|
249 | <p> |
|
|
250 | A: Of course not, it is quite a bit of data. In your rsync command, add |
|
|
251 | <path>--exclude=/releases/historical</path> to your rsync options. This will |
|
|
252 | exclude historical and save you quite a bit of space. |
|
|
253 | </p> |
|
|
254 | |
| 113 | </body> |
255 | </body> |
| 114 | </section> |
256 | </section> |
| 115 | </chapter> |
257 | </chapter> |
| 116 | </guide> |
258 | </guide> |