| 1 | <?xml version='1.0' encoding="UTF-8"?> |
1 | <?xml version='1.0' encoding="UTF-8"?> |
| 2 | <!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.18 2004/06/28 23:31:25 jforman Exp $ --> |
2 | <!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.25 2005/01/30 10:28:31 neysx Exp $ --> |
| 3 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
3 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
| 4 | |
4 | |
| 5 | <guide link="/doc/en/source_mirrors.xml"> |
5 | <guide link="/doc/en/source_mirrors.xml"> |
| 6 | <title>Gentoo Linux Source Mirrors Policy</title> |
6 | <title>Gentoo Linux Source Mirrors Policy</title> |
| 7 | <author title="Author"><mail link="klieber@gentoo.org">Kurt Lieber</mail></author> |
7 | <author title="Author"> |
|
|
8 | <mail link="klieber@gentoo.org">Kurt Lieber</mail> |
|
|
9 | </author> |
|
|
10 | <author title="Editor"> |
| 8 | <author title="Editor"><mail link="cshields@gentoo.org">Corey Shields</mail></author> |
11 | <mail link="cshields@gentoo.org">Corey Shields</mail> |
|
|
12 | </author> |
|
|
13 | <author title="Editor"> |
| 9 | <author title="Editor"> <mail link="bennyc@gentoo.org">Benny Chuang</mail></author> |
14 | <mail link="bennyc@gentoo.org">Benny Chuang</mail> |
|
|
15 | </author> |
|
|
16 | <author title="Editor"> |
| 10 | <author title="Editor"> <mail link="jforman@gentoo.org">Jeffrey Forman</mail></author> |
17 | <mail link="jforman@gentoo.org">Jeffrey Forman</mail> |
|
|
18 | </author> |
| 11 | |
19 | |
| 12 | <abstract> |
20 | <abstract> |
| 13 | This document explains the requirements for source mirrors. |
21 | This document explains the requirements for source mirrors. |
| 14 | </abstract> |
22 | </abstract> |
|
|
23 | |
| 15 | <license/> |
24 | <license/> |
| 16 | <version>1.2</version> |
25 | <version>1.5</version> |
| 17 | <date>8 Mar 2004</date> |
26 | <date>2005-01-28</date> |
| 18 | |
|
|
| 19 | |
27 | |
| 20 | <chapter> |
28 | <chapter> |
| 21 | <title>Requirements</title> |
29 | <title>Requirements</title> |
| 22 | <section> |
30 | <section> |
| 23 | <title>Minimum Bandwidth</title> |
31 | <title>Minimum Bandwidth</title> |
| 24 | <body> |
32 | <body> |
|
|
33 | |
|
|
34 | <p> |
| 25 | <p> To properly host a source mirror, you should have a minimum of 5Mbps upstream bandwidth. |
35 | To properly host a source mirror, you should have a minimum of 5Mbps upstream |
| 26 | ADSL and cable connections do not generally make adequate connections for distfile hosts due to their limited upstream performance.</p> |
36 | bandwidth. ADSL and cable connections do not generally make adequate |
|
|
37 | connections for distfile hosts due to their limited upstream performance. |
|
|
38 | </p> |
|
|
39 | |
| 27 | </body> |
40 | </body> |
| 28 | </section> |
41 | </section> |
| 29 | <section> |
42 | <section> |
| 30 | <title>Minimum Disk Space</title> |
43 | <title>Minimum Disk Space</title> |
| 31 | <body> |
44 | <body> |
| 32 | <p> The space requirements depend on whether you choose to run a "Full" mirror or a "Distfiles only" mirror. Full mirrors require 60 gigabytes of disk space. Distfiles only mirrors require 30 gigabytes of space.</p> |
45 | |
|
|
46 | <p> |
|
|
47 | The space requirements depend on whether you choose to run a "Full" mirror or a |
|
|
48 | "Distfiles only" mirror. Full mirrors require 90 GB of disk space. Distfiles |
|
|
49 | only mirrors require 40 GB of space. |
|
|
50 | </p> |
|
|
51 | |
| 33 | </body> |
52 | </body> |
| 34 | </section> |
53 | </section> |
| 35 | <section> |
54 | <section> |
| 36 | <title>Minimum User Count</title> |
55 | <title>Minimum User Count</title> |
| 37 | <body> |
56 | <body> |
|
|
57 | |
|
|
58 | <p> |
| 38 | <p>We ask that you support a minimum of 15 and preferrably 30 concurrent user connections.</p> |
59 | We ask that you support a minimum of 15 and preferrably 30 concurrent user |
|
|
60 | connections. |
|
|
61 | </p> |
|
|
62 | |
| 39 | </body> |
63 | </body> |
| 40 | </section> |
64 | </section> |
| 41 | <section> |
65 | <section> |
| 42 | <title>Update Frequency</title> |
66 | <title>Update Frequency</title> |
| 43 | <body> |
67 | <body> |
| 44 | <p>All mirrors must be synchronized every four hours, starting at midnight in your local time zone. This helps distribute the load out over a period of time, rather than having all mirrors synchronize at the same time.</p> |
68 | |
|
|
69 | <p> |
|
|
70 | All mirrors must be synchronized every four hours, starting at midnight in your |
|
|
71 | local time zone. This helps distribute the load out over a period of time, |
|
|
72 | rather than having all mirrors synchronize at the same time. |
|
|
73 | </p> |
| 45 | </body> |
74 | </body> |
| 46 | </section> |
75 | </section> |
| 47 | </chapter> |
76 | </chapter> |
|
|
77 | |
| 48 | <chapter> |
78 | <chapter> |
| 49 | <title>Implementation details</title> |
79 | <title>Implementation details</title> |
| 50 | <section> |
80 | <section> |
| 51 | <body> |
81 | <body> |
|
|
82 | |
|
|
83 | <p> |
| 52 | <p>For new source mirror requests, the procedure will be as follows:</p> |
84 | For new source mirror requests, the procedure will be as follows: |
| 53 | <p>Set up your server to rsync with www.ibiblio.org::gentoo. Once you have a complete mirror of that server, please file a bug report on bugs.gentoo.org under the "rsync" category stating that you have a new mirror and wish it to be added to the list of official mirrors. Please specify whether you wish to be a "Full" mirror or "Distfiles only" mirror. Distfiles only mirrors will be designated as such on the website.</p> |
85 | </p> |
|
|
86 | |
|
|
87 | <p> |
|
|
88 | Set up your server to rsync with ftp.ussg.iu.edu::gentoo-distfiles. Once you |
|
|
89 | have a complete mirror of that server, please file a bug report on |
|
|
90 | bugs.gentoo.org under the "rsync" category stating that you have a new mirror |
|
|
91 | and wish it to be added to the list of official mirrors. Please specify |
|
|
92 | whether you wish to be a "Full" mirror or "Distfiles only" mirror. Distfiles |
|
|
93 | only mirrors will be designated as such on the website. |
|
|
94 | </p> |
|
|
95 | |
|
|
96 | <p> |
| 54 | <p>Full mirrors must carry the following directories (plus any directories that get added in the future):</p> |
97 | Full mirrors must carry the following directories (plus any directories that |
|
|
98 | get added in the future): |
|
|
99 | </p> |
|
|
100 | |
| 55 | <ul> |
101 | <ul> |
| 56 | <li>/releases</li> |
102 | <li>/releases</li> |
| 57 | <li>/experimental</li> |
103 | <li>/experimental</li> |
| 58 | <li>/distfiles</li> |
104 | <li>/distfiles</li> |
| 59 | <li>/snapshots</li> |
105 | <li>/snapshots</li> |
| 60 | <li>/grp</li> |
106 | <li>/grp</li> |
| 61 | </ul> |
107 | </ul> |
|
|
108 | |
|
|
109 | <p> |
| 62 | <p>Distfiles only mirrors need to carry the following directories:</p> |
110 | Distfiles only mirrors need to carry the following directories: |
|
|
111 | </p> |
|
|
112 | |
| 63 | <ul> |
113 | <ul> |
| 64 | <li>/distfiles</li> |
114 | <li>/distfiles</li> |
| 65 | <li>/snapshots</li> |
115 | <li>/snapshots</li> |
| 66 | </ul> |
116 | </ul> |
| 67 | |
117 | |
| 68 | <p>We will then verify that the mirror exists and we can connect to it properly. Then, in the next 48-72 hours, we will determine if your mirror is syncing correctly and in accordance with this policy.</p> |
118 | <p> |
|
|
119 | We will then verify that the mirror exists and we can connect to it properly. |
|
|
120 | Then, in the next 48-72 hours, we will determine if your mirror is syncing |
|
|
121 | correctly and in accordance with this policy. |
|
|
122 | </p> |
| 69 | |
123 | |
| 70 | <p>If all steps went smoothly, we will then add you to our list of <uri link="http://www.gentoo.org/main/en/mirrors.xml">download mirrors</uri> on the main web site. We will also send you the login information for our private master distfile mirror which is only available to official Gentoo Linux source mirrors.</p> |
124 | <p> |
| 71 | |
125 | If all steps went smoothly, we will then add you to our list of <uri |
| 72 | <p>Additionally, you, the mirror admin, will be requested to subscribe to the gentoo-mirrors mailing list (low traffic) so that you can follow all issues associated with source mirrors. |
126 | link="/main/en/mirrors.xml">download mirrors</uri> on the main web site. We |
|
|
127 | will also send you the login information for our private master distfile mirror |
|
|
128 | which is only available to official Gentoo Linux source mirrors. |
| 73 | </p> |
129 | </p> |
|
|
130 | |
|
|
131 | <p> |
|
|
132 | Additionally, you, the mirror admin, will be requested to subscribe to the |
|
|
133 | gentoo-mirrors mailing list (low traffic) so that you can follow all issues |
|
|
134 | associated with source mirrors. |
|
|
135 | </p> |
|
|
136 | |
| 74 | <note> |
137 | <note> |
| 75 | Thanks for helping out Gentoo Linux users and developers! :) For any mirror administration issues or problems, please contact <mail link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
138 | Thanks for helping out Gentoo Linux users and developers! :) For any mirror |
|
|
139 | administration issues or problems, please contact <mail |
|
|
140 | link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
| 76 | </note> |
141 | </note> |
|
|
142 | |
|
|
143 | <warn> |
|
|
144 | Do NOT email mirror-admin@gentoo.org for mirror requests, please file a bug. It makes mirror tracking easier on us. |
|
|
145 | </warn> |
|
|
146 | |
| 77 | </body> |
147 | </body> |
| 78 | </section> |
148 | </section> |
| 79 | </chapter> |
149 | </chapter> |
|
|
150 | |
| 80 | <chapter> |
151 | <chapter> |
| 81 | <title>Short FAQ</title> |
152 | <title>Short FAQ</title> |
| 82 | <section> |
153 | <section> |
| 83 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
154 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
| 84 | <body> |
155 | <body> |
|
|
156 | |
|
|
157 | <p> |
| 85 | <p>A: Please file a bug on bugs.gentoo.org under the rsync category.</p> |
158 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
|
|
159 | </p> |
|
|
160 | |
| 86 | </body> |
161 | </body> |
| 87 | </section> |
162 | </section> |
| 88 | <section> |
163 | <section> |
| 89 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
164 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
| 90 | <body> |
165 | <body> |
|
|
166 | |
|
|
167 | <p> |
| 91 | <p>A: Please file a bug on bugs.gentoo.org under the rsync category.</p> |
168 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
|
|
169 | </p> |
|
|
170 | |
| 92 | </body> |
171 | </body> |
| 93 | </section> |
172 | </section> |
| 94 | <section> |
173 | <section> |
| 95 | <title>Q: I run a private source mirror for my company. Can I still access the private master source mirror?</title> |
174 | <title>Q: I run a private source mirror for my company. Can I still access the private master source mirror?</title> |
| 96 | <body> |
175 | <body> |
|
|
176 | |
|
|
177 | <p> |
| 97 | <p>A: Because our resources are limited, we need to ensure we allocate them in such a way |
178 | A: Because our resources are limited, we need to ensure we allocate them in |
| 98 | to provide the maximum amount of benefit to our users. As such, we limit connections |
179 | such a way to provide the maximum amount of benefit to our users. As such, we |
| 99 | to our master rsync and distfile mirrors to public mirrors only. Users are welcome to use our regular mirror system to establish a private source mirror. |
180 | limit connections to our master rsync and distfile mirrors to public mirrors |
|
|
181 | only. Users are welcome to use our regular mirror system to establish a |
|
|
182 | private source mirror. |
| 100 | </p> |
183 | </p> |
|
|
184 | |
| 101 | </body> |
185 | </body> |
| 102 | </section> |
186 | </section> |
| 103 | |
187 | |
| 104 | <section> |
188 | <section> |
| 105 | <title>Q: How do I find the mirror nearest to me?</title> |
189 | <title>Q: How do I find the mirror nearest to me?</title> |
| 106 | <body> |
190 | <body> |
| 107 | <p>A: mirrorselect was designed to do this for you. If you haven't already run <c>emerge mirrorselect</c>, then please do so. |
191 | |
| 108 | Then run: <c>mirrorselect</c>. An ncurses-based menu will display allowing you to select a mirror close to you. |
|
|
| 109 | </p> |
192 | <p> |
|
|
193 | A: mirrorselect was designed to do this for you. If you haven't already run |
|
|
194 | <c>emerge mirrorselect</c>, then please do so. Then run: <c>mirrorselect</c>. |
|
|
195 | An ncurses-based menu will display allowing you to select a mirror close to |
|
|
196 | you. |
|
|
197 | </p> |
|
|
198 | |
| 110 | </body> |
199 | </body> |
| 111 | </section> |
200 | </section> |
| 112 | <section> |
201 | <section> |
| 113 | <title>Q: I don't have that much disk space. Can I mirror part of the sources?</title> |
202 | <title>Q: I don't have that much disk space. Can I mirror part of the sources?</title> |
| 114 | <body> |
203 | <body> |
|
|
204 | |
|
|
205 | <p> |
| 115 | <p>A: Yes, if you are unable to mirror our full sources, you can elect to mirror the following two directories only:</p> |
206 | A: Yes, if you are unable to mirror our full sources, you can elect to mirror |
|
|
207 | the following two directories only: |
|
|
208 | </p> |
|
|
209 | |
| 116 | <ul> |
210 | <ul> |
| 117 | <li>/distfiles</li> |
211 | <li>/distfiles</li> |
| 118 | <li>/snapshots</li> |
212 | <li>/snapshots</li> |
| 119 | </ul> |
213 | </ul> |
| 120 | <p>These two directories will require approximately 30GB of space and you will be listed on our site as a distfiles-only mirror.</p> |
214 | |
|
|
215 | <p> |
|
|
216 | These two directories will require approximately 40GB of space and you will be |
|
|
217 | listed on our site as a distfiles-only mirror. |
|
|
218 | </p> |
|
|
219 | |
| 121 | </body> |
220 | </body> |
| 122 | </section> |
221 | </section> |
| 123 | <section> |
222 | <section> |
| 124 | <title>Q: Do I have to turn on Directory Indexing for directories served up via HTTP?</title> |
223 | <title>Q: Do I have to turn on Directory Indexing for directories served up via HTTP?</title> |
| 125 | <body> |
224 | <body> |
| 126 | <p>A: Directory Indexing is required for the /releases and /experimental directories, but can be turned off for all other directories (including /distfiles) if you wish. |
225 | |
| 127 | </p> |
226 | <p> |
|
|
227 | A: Directory Indexing is required for the /releases and /experimental |
|
|
228 | directories, but can be turned off for all other directories (including |
|
|
229 | /distfiles) if you wish. |
|
|
230 | </p> |
|
|
231 | </body> |
|
|
232 | </section> |
|
|
233 | |
|
|
234 | <section> |
|
|
235 | <title>Q: Do I have to mirror historical? I mean, it is old releases.</title> |
|
|
236 | <body> |
|
|
237 | |
|
|
238 | <p> |
|
|
239 | A: Of course not, it is quite a bit of data. In your rsync command, add |
|
|
240 | <path>--exclude=/releases/historical</path> to your rsync options. This will |
|
|
241 | exclude historical and save you quite a bit of space. |
|
|
242 | </p> |
|
|
243 | |
| 128 | </body> |
244 | </body> |
| 129 | </section> |
245 | </section> |
| 130 | </chapter> |
246 | </chapter> |
| 131 | </guide> |
247 | </guide> |