| 1 | <?xml version='1.0' encoding="UTF-8"?> |
1 | <?xml version='1.0' encoding="UTF-8"?> |
| 2 | <!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.21 2004/10/26 14:04:53 jforman Exp $ --> |
2 | <!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.37 2010/04/28 21:22:01 robbat2 Exp $ --> |
| 3 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
3 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
| 4 | |
4 | |
| 5 | <guide link="/doc/en/source_mirrors.xml"> |
5 | <guide link="/doc/en/source_mirrors.xml"> |
|
|
6 | |
| 6 | <title>Gentoo Linux Source Mirrors Policy</title> |
7 | <title>Gentoo Linux Source Mirrors Policy</title> |
|
|
8 | |
| 7 | <author title="Author"> |
9 | <author title="Author"> |
| 8 | <mail link="klieber@gentoo.org">Kurt Lieber</mail> |
10 | <mail link="klieber@gentoo.org">Kurt Lieber</mail> |
| 9 | </author> |
11 | </author> |
| 10 | <author title="Editor"> |
12 | <author title="Editor"> |
| 11 | <mail link="cshields@gentoo.org">Corey Shields</mail> |
13 | <mail link="cshields@gentoo.org">Corey Shields</mail> |
| … | |
… | |
| 13 | <author title="Editor"> |
15 | <author title="Editor"> |
| 14 | <mail link="bennyc@gentoo.org">Benny Chuang</mail> |
16 | <mail link="bennyc@gentoo.org">Benny Chuang</mail> |
| 15 | </author> |
17 | </author> |
| 16 | <author title="Editor"> |
18 | <author title="Editor"> |
| 17 | <mail link="jforman@gentoo.org">Jeffrey Forman</mail> |
19 | <mail link="jforman@gentoo.org">Jeffrey Forman</mail> |
|
|
20 | </author> |
|
|
21 | <author title="Editor"> |
|
|
22 | <mail link="robbat2@gentoo.org">Robin H. Johnson</mail> |
|
|
23 | </author> |
|
|
24 | <author title="Editor"> |
|
|
25 | <mail link="fox2mike@gentoo.org">Shyam Mani</mail> |
| 18 | </author> |
26 | </author> |
| 19 | |
27 | |
| 20 | <abstract> |
28 | <abstract> |
| 21 | This document explains the requirements for source mirrors. |
29 | This document explains the requirements for source mirrors. |
| 22 | </abstract> |
30 | </abstract> |
| 23 | |
31 | |
|
|
32 | <!-- The content of this document is licensed under the CC-BY-SA license --> |
|
|
33 | <!-- See http://creativecommons.org/licenses/by-sa/2.5 --> |
| 24 | <license/> |
34 | <license/> |
| 25 | <version>1.3</version> |
35 | <version>1.13</version> |
| 26 | <date>June 28, 2004</date> |
36 | <date>2010-04-28</date> |
| 27 | |
37 | |
| 28 | <chapter> |
38 | <chapter> |
| 29 | <title>Requirements</title> |
39 | <title>Requirements</title> |
| 30 | <section> |
40 | <section> |
| 31 | <title>Minimum Bandwidth</title> |
41 | <title>Minimum Bandwidth</title> |
| 32 | <body> |
42 | <body> |
| 33 | |
43 | |
| 34 | <p> |
44 | <p> |
| 35 | To properly host a source mirror, you should have a minimum of 5Mbps upstream |
45 | To properly host a source mirror, you should have a minimum of 5Mbps upstream |
| 36 | bandwidth. ADSL and cable connections do not generally make adequate |
46 | bandwidth. ADSL and cable connections do not generally make adequate |
| 37 | connections for distfile hosts due to their limited upstream performance. |
47 | connections for distfile hosts due to their limited upstream performance. |
| 38 | </p> |
48 | </p> |
| 39 | |
49 | |
| 40 | </body> |
50 | </body> |
| 41 | </section> |
51 | </section> |
| … | |
… | |
| 43 | <title>Minimum Disk Space</title> |
53 | <title>Minimum Disk Space</title> |
| 44 | <body> |
54 | <body> |
| 45 | |
55 | |
| 46 | <p> |
56 | <p> |
| 47 | The space requirements depend on whether you choose to run a "Full" mirror or a |
57 | The space requirements depend on whether you choose to run a "Full" mirror or a |
| 48 | "Distfiles only" mirror. Full mirrors require 60 gigabytes of disk space. |
58 | "Distfiles only" mirror. Full mirrors require 210 GB of disk space. Distfiles |
| 49 | Distfiles only mirrors require 30 gigabytes of space. |
59 | only mirrors require 120 GB of space. |
| 50 | </p> |
60 | </p> |
| 51 | |
61 | |
| 52 | </body> |
62 | </body> |
| 53 | </section> |
63 | </section> |
| 54 | <section> |
64 | <section> |
| 55 | <title>Minimum User Count</title> |
65 | <title>Minimum User Count</title> |
| 56 | <body> |
66 | <body> |
| 57 | |
67 | |
| 58 | <p> |
68 | <p> |
| 59 | We ask that you support a minimum of 15 and preferrably 30 concurrent user |
69 | We ask that you support a minimum of 15 and preferrably 30 or more concurrent |
| 60 | connections. |
70 | user connections. |
| 61 | </p> |
71 | </p> |
| 62 | |
72 | |
| 63 | </body> |
73 | </body> |
| 64 | </section> |
74 | </section> |
| 65 | <section> |
75 | <section> |
| … | |
… | |
| 69 | <p> |
79 | <p> |
| 70 | All mirrors must be synchronized every four hours, starting at midnight in your |
80 | All mirrors must be synchronized every four hours, starting at midnight in your |
| 71 | local time zone. This helps distribute the load out over a period of time, |
81 | local time zone. This helps distribute the load out over a period of time, |
| 72 | rather than having all mirrors synchronize at the same time. |
82 | rather than having all mirrors synchronize at the same time. |
| 73 | </p> |
83 | </p> |
|
|
84 | |
|
|
85 | </body> |
|
|
86 | </section> |
|
|
87 | <section> |
|
|
88 | <title>Mirror Needs</title> |
|
|
89 | <body> |
|
|
90 | |
|
|
91 | <p> |
|
|
92 | Your mirror may not be added immediately to our listing and given access to the |
|
|
93 | private distribution point. We add mirrors on an as-needed basis so as not to |
|
|
94 | clutter up the listing, and to provide an adequate amount of high speed mirrors. |
|
|
95 | You are more than welcome to peek in <uri |
|
|
96 | link="irc://irc.gentoo.org/gentoo-mirrors">#gentoo-mirrors</uri> on IRC and chat |
|
|
97 | up to see the status of your mirror being added to our official network. |
|
|
98 | </p> |
|
|
99 | |
| 74 | </body> |
100 | </body> |
| 75 | </section> |
101 | </section> |
| 76 | </chapter> |
102 | </chapter> |
| 77 | |
103 | |
| 78 | <chapter> |
104 | <chapter> |
| … | |
… | |
| 83 | <p> |
109 | <p> |
| 84 | For new source mirror requests, the procedure will be as follows: |
110 | For new source mirror requests, the procedure will be as follows: |
| 85 | </p> |
111 | </p> |
| 86 | |
112 | |
| 87 | <p> |
113 | <p> |
| 88 | Set up your server to rsync with ftp.ussg.iu.edu::gentoo-distfiles. Once you have a |
114 | Set up your server to rsync with ftp.ussg.iu.edu::gentoo-distfiles. Once you |
| 89 | complete mirror of that server, please file a bug report on bugs.gentoo.org |
115 | have a complete mirror of that server, please file a bug report on <uri |
|
|
116 | link="http://bugs.gentoo.org/enter_bug.cgi?product=Mirrors">bugs.gentoo.org</uri> |
| 90 | under the "rsync" category stating that you have a new mirror and wish it to be |
117 | under the <c>Mirrors</c> category stating that you have a new mirror and wish |
| 91 | added to the list of official mirrors. Please specify whether you wish to be a |
118 | it to be added to the list of official mirrors. Please specify whether you |
| 92 | "Full" mirror or "Distfiles only" mirror. Distfiles only mirrors will be |
119 | wish to be a "Full" mirror or "Distfiles only" mirror. Distfiles |
| 93 | designated as such on the website. |
120 | only mirrors will be designated as such on the website. |
| 94 | </p> |
121 | </p> |
| 95 | |
122 | |
| 96 | <p> |
123 | <p> |
| 97 | Full mirrors must carry the following directories (plus any directories that |
124 | Full mirrors must carry the following directories (plus any directories that |
| 98 | get added in the future): |
125 | get added in the future): |
| 99 | </p> |
126 | </p> |
| 100 | |
127 | |
| 101 | <ul> |
128 | <ul> |
| 102 | <li>/releases</li> |
129 | <li>/releases (45-55G)</li> |
| 103 | <li>/experimental</li> |
130 | <li>/experimental (20-30G)</li> |
| 104 | <li>/distfiles</li> |
131 | <li>/distfiles (110G)</li> |
| 105 | <li>/snapshots</li> |
132 | <li>/snapshots (600M)</li> |
| 106 | <li>/grp</li> |
133 | <li>/grp (0M, obsolete)</li> |
| 107 | </ul> |
134 | </ul> |
| 108 | |
135 | |
| 109 | <p> |
136 | <p> |
| 110 | Distfiles only mirrors need to carry the following directories: |
137 | Distfiles only mirrors need to carry the following directories: |
| 111 | </p> |
138 | </p> |
| 112 | |
139 | |
| 113 | <ul> |
140 | <ul> |
| 114 | <li>/distfiles</li> |
141 | <li>/distfiles (110G)</li> |
| 115 | <li>/snapshots</li> |
142 | <li>/snapshots (600M)</li> |
| 116 | </ul> |
143 | </ul> |
| 117 | |
144 | |
| 118 | <p> |
145 | <p> |
| 119 | We will then verify that the mirror exists and we can connect to it properly. |
146 | We will then verify that the mirror exists and we can connect to it properly. |
| 120 | Then, in the next 48-72 hours, we will determine if your mirror is syncing |
147 | Then, in the next 2 weeks, we will determine if your mirror is syncing |
| 121 | correctly and in accordance with this policy. |
148 | correctly and in accordance with this policy. |
| 122 | </p> |
149 | </p> |
| 123 | |
150 | |
| 124 | <p> |
151 | <p> |
| 125 | If all steps went smoothly, we will then add you to our list of <uri |
152 | If all steps went smoothly, we will then add you to our list of <uri |
| 126 | link="http://www.gentoo.org/main/en/mirrors.xml">download mirrors</uri> on the |
153 | link="/main/en/mirrors2.xml">download mirrors</uri> on the main web site. We |
| 127 | main web site. We will also send you the login information for our private |
154 | will also send you the login information for our private master distfile mirror |
| 128 | master distfile mirror which is only available to official Gentoo Linux source |
155 | which is only available to official Gentoo Linux source mirrors. |
| 129 | mirrors. |
|
|
| 130 | </p> |
156 | </p> |
| 131 | |
157 | |
| 132 | <p> |
158 | <p> |
| 133 | Additionally, you, the mirror admin, will be requested to subscribe to the |
159 | Additionally, you, the mirror admin, will be requested to subscribe to the |
| 134 | gentoo-mirrors mailing list (low traffic) so that you can follow all issues |
160 | gentoo-mirrors mailing list (low traffic) so that you can follow all issues |
| 135 | associated with source mirrors. |
161 | associated with source mirrors. |
| … | |
… | |
| 140 | administration issues or problems, please contact <mail |
166 | administration issues or problems, please contact <mail |
| 141 | link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
167 | link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
| 142 | </note> |
168 | </note> |
| 143 | |
169 | |
| 144 | <warn> |
170 | <warn> |
| 145 | Do NOT email mirror-admin@gentoo.org for mirror requests, please file a bug. It makes mirror tracking easier on us. |
171 | Do NOT email mirror-admin@gentoo.org for mirror requests, please file a bug. It |
|
|
172 | makes mirror tracking easier on us. |
| 146 | </warn> |
173 | </warn> |
| 147 | |
174 | |
| 148 | </body> |
175 | </body> |
| 149 | </section> |
176 | </section> |
| 150 | </chapter> |
177 | </chapter> |
| 151 | |
178 | |
| 152 | <chapter> |
179 | <chapter> |
| 153 | <title>Short FAQ</title> |
180 | <title>Short FAQ</title> |
| 154 | <section> |
181 | <section> |
|
|
182 | <title> |
| 155 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
183 | Q: Who should I contact regarding new mirrors or to get my mirror added to the |
|
|
184 | Gentoo web site? |
|
|
185 | </title> |
| 156 | <body> |
186 | <body> |
| 157 | |
187 | |
| 158 | <p> |
188 | <p> |
| 159 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
189 | A: Please file a bug on bugs.gentoo.org under the <c>Mirrors</c> category. |
| 160 | </p> |
190 | </p> |
| 161 | |
191 | |
| 162 | </body> |
192 | </body> |
| 163 | </section> |
193 | </section> |
| 164 | <section> |
194 | <section> |
| 165 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
195 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
| 166 | <body> |
196 | <body> |
| 167 | |
197 | |
| 168 | <p> |
198 | <p> |
| 169 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
199 | A: Please file a bug on bugs.gentoo.org under the <c>Mirrors</c> category. |
| 170 | </p> |
200 | </p> |
| 171 | |
201 | |
| 172 | </body> |
202 | </body> |
| 173 | </section> |
|
|
| 174 | <section> |
203 | </section> |
|
|
204 | <section> |
|
|
205 | <title> |
| 175 | <title>Q: I run a private source mirror for my company. Can I still access the private master source mirror?</title> |
206 | Q: I run a private source mirror for my company. Can I still access the |
|
|
207 | private master source mirror? |
|
|
208 | </title> |
| 176 | <body> |
209 | <body> |
| 177 | |
210 | |
| 178 | <p> |
211 | <p> |
| 179 | A: Because our resources are limited, we need to ensure we allocate them in |
212 | A: Because our resources are limited, we need to ensure we allocate them in |
| 180 | such a way to provide the maximum amount of benefit to our users. As such, we |
213 | such a way to provide the maximum amount of benefit to our users. As such, we |
| … | |
… | |
| 183 | private source mirror. |
216 | private source mirror. |
| 184 | </p> |
217 | </p> |
| 185 | |
218 | |
| 186 | </body> |
219 | </body> |
| 187 | </section> |
220 | </section> |
| 188 | |
|
|
| 189 | <section> |
221 | <section> |
| 190 | <title>Q: How do I find the mirror nearest to me?</title> |
222 | <title>Q: How do I find the mirror nearest to me?</title> |
| 191 | <body> |
223 | <body> |
| 192 | |
224 | |
| 193 | <p> |
225 | <p> |
| … | |
… | |
| 198 | </p> |
230 | </p> |
| 199 | |
231 | |
| 200 | </body> |
232 | </body> |
| 201 | </section> |
233 | </section> |
| 202 | <section> |
234 | <section> |
|
|
235 | <title> |
| 203 | <title>Q: I don't have that much disk space. Can I mirror part of the sources?</title> |
236 | Q: I don't have that much disk space. Can I mirror part of the sources? |
|
|
237 | </title> |
| 204 | <body> |
238 | <body> |
| 205 | |
239 | |
| 206 | <p> |
240 | <p> |
| 207 | A: Yes, if you are unable to mirror our full sources, you can elect to mirror |
241 | A: Yes, if you are unable to mirror our full sources, you can elect to mirror |
| 208 | the following two directories only: |
242 | the following two directories only: |
| 209 | </p> |
243 | </p> |
| 210 | |
244 | |
| 211 | <ul> |
245 | <ul> |
| 212 | <li>/distfiles</li> |
246 | <li>/distfiles</li> |
| 213 | <li>/snapshots</li> |
247 | <li>/snapshots</li> |
| 214 | </ul> |
248 | </ul> |
| 215 | |
249 | |
| 216 | <p> |
250 | <p> |
| 217 | These two directories will require approximately 30GB of space and you will be |
251 | These two directories will require approximately 50GB of space and you will be |
| 218 | listed on our site as a distfiles-only mirror. |
252 | listed on our site as a distfiles-only mirror. |
| 219 | </p> |
253 | </p> |
| 220 | |
254 | |
| 221 | </body> |
255 | </body> |
| 222 | </section> |
256 | </section> |
| 223 | <section> |
257 | <section> |
|
|
258 | <title> |
| 224 | <title>Q: Do I have to turn on Directory Indexing for directories served up via HTTP?</title> |
259 | Q: Do I have to turn on Directory Indexing for directories served up via HTTP? |
|
|
260 | </title> |
| 225 | <body> |
261 | <body> |
| 226 | |
262 | |
| 227 | <p> |
263 | <p> |
| 228 | A: Directory Indexing is required for the /releases and /experimental |
264 | A: Directory Indexing is required for the /releases and /experimental |
| 229 | directories, but can be turned off for all other directories (including |
265 | directories, but can be turned off for all other directories (including |
| 230 | /distfiles) if you wish. |
266 | /distfiles) if you wish. |
|
|
267 | </p> |
|
|
268 | |
|
|
269 | </body> |
|
|
270 | </section> |
|
|
271 | |
|
|
272 | <section> |
|
|
273 | <title>Q: Do I have to mirror historical? I mean, it is old releases.</title> |
|
|
274 | <body> |
|
|
275 | |
|
|
276 | <p> |
|
|
277 | A: Of course not, it is quite a bit of data. In your rsync command, add |
|
|
278 | <path>--exclude=/releases/historical</path> to your rsync options. This will |
|
|
279 | exclude historical and save you quite a bit of space. |
| 231 | </p> |
280 | </p> |
| 232 | |
281 | |
| 233 | </body> |
282 | </body> |
| 234 | </section> |
283 | </section> |
| 235 | </chapter> |
284 | </chapter> |
Parent Directory
| 
Revision Log
| 
Patch