| 1 | <?xml version='1.0' encoding="UTF-8"?> |
1 | <?xml version='1.0' encoding="UTF-8"?> |
|
|
2 | <!-- $Header: /var/cvsroot/gentoo/xml/htdocs/doc/en/source_mirrors.xml,v 1.27 2005/04/12 17:52:20 alin Exp $ --> |
| 2 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
3 | <!DOCTYPE guide SYSTEM "/dtd/guide.dtd"> |
| 3 | |
4 | |
| 4 | <guide link="/doc/en/rsync.xml"> |
5 | <guide link="/doc/en/source_mirrors.xml"> |
| 5 | <title>Gentoo Linux Source Mirrors Policy</title> |
6 | <title>Gentoo Linux Source Mirrors Policy</title> |
| 6 | <author title="Author"><mail link="klieber@gentoo.org">Kurt Lieber</mail></author> |
7 | <author title="Author"> |
|
|
8 | <mail link="klieber@gentoo.org">Kurt Lieber</mail> |
|
|
9 | </author> |
|
|
10 | <author title="Editor"> |
|
|
11 | <mail link="cshields@gentoo.org">Corey Shields</mail> |
|
|
12 | </author> |
|
|
13 | <author title="Editor"> |
|
|
14 | <mail link="bennyc@gentoo.org">Benny Chuang</mail> |
|
|
15 | </author> |
|
|
16 | <author title="Editor"> |
|
|
17 | <mail link="jforman@gentoo.org">Jeffrey Forman</mail> |
|
|
18 | </author> |
| 7 | |
19 | |
|
|
20 | <abstract> |
|
|
21 | This document explains the requirements for source mirrors. |
|
|
22 | </abstract> |
|
|
23 | |
|
|
24 | <license/> |
| 8 | <version>1.1</version> |
25 | <version>1.6</version> |
| 9 | <date>17 Feb 2003</date> |
26 | <date>2005-04-11</date> |
| 10 | |
27 | |
| 11 | <chapter> |
28 | <chapter> |
| 12 | <title>Requirements</title> |
29 | <title>Requirements</title> |
| 13 | <section> |
30 | <section> |
| 14 | <title>Minimum Bandwidth</title> |
31 | <title>Minimum Bandwidth</title> |
| 15 | <body> |
32 | <body> |
|
|
33 | |
|
|
34 | <p> |
| 16 | <p> To properly host a source mirror you should have a minimum of T1 bandwidth. |
35 | To properly host a source mirror, you should have a minimum of 5Mbps upstream |
| 17 | ADSL and cable connections do not generally make adequate connections for rsync hosts due to their limited upstream performance.</p> |
36 | bandwidth. ADSL and cable connections do not generally make adequate |
|
|
37 | connections for distfile hosts due to their limited upstream performance. |
|
|
38 | </p> |
|
|
39 | |
|
|
40 | </body> |
|
|
41 | </section> |
|
|
42 | <section> |
|
|
43 | <title>Minimum Disk Space</title> |
|
|
44 | <body> |
|
|
45 | |
|
|
46 | <p> |
|
|
47 | The space requirements depend on whether you choose to run a "Full" mirror or a |
|
|
48 | "Distfiles only" mirror. Full mirrors require 90 GB of disk space. Distfiles |
|
|
49 | only mirrors require 40 GB of space. |
|
|
50 | </p> |
|
|
51 | |
| 18 | </body> |
52 | </body> |
| 19 | </section> |
53 | </section> |
| 20 | <section> |
54 | <section> |
| 21 | <title>Minimum User Count</title> |
55 | <title>Minimum User Count</title> |
| 22 | <body> |
56 | <body> |
|
|
57 | |
|
|
58 | <p> |
| 23 | <p>We ask that you support a minimum of 5 and preferrably 10 concurrent user connections.</p> |
59 | We ask that you support a minimum of 15 and preferrably 30 concurrent user |
|
|
60 | connections. |
|
|
61 | </p> |
|
|
62 | |
| 24 | </body> |
63 | </body> |
| 25 | </section> |
64 | </section> |
| 26 | <section> |
65 | <section> |
| 27 | <title>Update Frequency</title> |
66 | <title>Update Frequency</title> |
| 28 | <body> |
67 | <body> |
| 29 | <p>We ask that source mirrors be updated at least 3-4 times throughout the day. At a minimum, source mirrors should be updated once per day.</p> |
68 | |
|
|
69 | <p> |
|
|
70 | All mirrors must be synchronized every four hours, starting at midnight in your |
|
|
71 | local time zone. This helps distribute the load out over a period of time, |
|
|
72 | rather than having all mirrors synchronize at the same time. |
|
|
73 | </p> |
|
|
74 | </body> |
|
|
75 | </section> |
|
|
76 | |
|
|
77 | <section> |
|
|
78 | <title>Mirror Needs</title> |
|
|
79 | <body> |
|
|
80 | <p> |
|
|
81 | Your mirror may not be added immediately to our listing and given access to the private distribution point. We add mirrors |
|
|
82 | on an as-needed basis so as not to clutter up the listing, and to provide an adequate amount of high speed mirrors. You are more than |
|
|
83 | welcome to peek in #gentoo-mirrors on irc.freenode.org and chat up to see the status of your mirror being added to our official network. |
|
|
84 | </p> |
| 30 | </body> |
85 | </body> |
| 31 | </section> |
86 | </section> |
| 32 | </chapter> |
87 | </chapter> |
|
|
88 | |
| 33 | <chapter> |
89 | <chapter> |
| 34 | <title>Implementation details</title> |
90 | <title>Implementation details</title> |
| 35 | <section> |
91 | <section> |
| 36 | <body> |
92 | <body> |
|
|
93 | |
|
|
94 | <p> |
| 37 | <p>for new source mirror requests, the procedure will be as follows:</p> |
95 | For new source mirror requests, the procedure will be as follows: |
| 38 | <p>Someone asks to be a mirror, then we verify that the mirror exists and we can connect to it properly. Then we will contact you and enable your server to connect to <path>rsync1.us.gentoo.org</path>, the master rsync mirror. Then, in the next 48-72 hours we will determine if your mirror is syncing correctly with <path>rsync1.us.gentoo.org</path> and accordingly with this policy.</p> |
96 | </p> |
| 39 | |
97 | |
| 40 | <p>If all steps went smoothly, we will then add you to our list of <uri link="http://www.gentoo.org/main/en/mirrors.xml">download mirrors</uri> on the main web site.</p> |
98 | <p> |
|
|
99 | Set up your server to rsync with ftp.ussg.iu.edu::gentoo-distfiles. Once you |
|
|
100 | have a complete mirror of that server, please file a bug report on |
|
|
101 | bugs.gentoo.org under the "rsync" category stating that you have a new mirror |
|
|
102 | and wish it to be added to the list of official mirrors. Please specify |
|
|
103 | whether you wish to be a "Full" mirror or "Distfiles only" mirror. Distfiles |
|
|
104 | only mirrors will be designated as such on the website. |
|
|
105 | </p> |
| 41 | |
106 | |
| 42 | <p>Additionally, you, the mirror admin will be added to the gentoo-mirrors mailing list (low traffic) so that you can folllow all issues associated with source mirrors. |
107 | <p> |
|
|
108 | Full mirrors must carry the following directories (plus any directories that |
|
|
109 | get added in the future): |
|
|
110 | </p> |
|
|
111 | |
|
|
112 | <ul> |
|
|
113 | <li>/releases</li> |
|
|
114 | <li>/experimental</li> |
|
|
115 | <li>/distfiles</li> |
|
|
116 | <li>/snapshots</li> |
|
|
117 | <li>/grp</li> |
|
|
118 | </ul> |
|
|
119 | |
|
|
120 | <p> |
|
|
121 | Distfiles only mirrors need to carry the following directories: |
|
|
122 | </p> |
|
|
123 | |
|
|
124 | <ul> |
|
|
125 | <li>/distfiles</li> |
|
|
126 | <li>/snapshots</li> |
|
|
127 | </ul> |
|
|
128 | |
|
|
129 | <p> |
|
|
130 | We will then verify that the mirror exists and we can connect to it properly. |
|
|
131 | Then, in the next 48-72 hours, we will determine if your mirror is syncing |
|
|
132 | correctly and in accordance with this policy. |
|
|
133 | </p> |
|
|
134 | |
|
|
135 | <p> |
|
|
136 | If all steps went smoothly, we will then add you to our list of <uri |
|
|
137 | link="/main/en/mirrors.xml">download mirrors</uri> on the main web site. We |
|
|
138 | will also send you the login information for our private master distfile mirror |
|
|
139 | which is only available to official Gentoo Linux source mirrors. |
| 43 | </p> |
140 | </p> |
|
|
141 | |
|
|
142 | <p> |
|
|
143 | Additionally, you, the mirror admin, will be requested to subscribe to the |
|
|
144 | gentoo-mirrors mailing list (low traffic) so that you can follow all issues |
|
|
145 | associated with source mirrors. |
|
|
146 | </p> |
|
|
147 | |
| 44 | <note> |
148 | <note> |
| 45 | Thanks for helping out Gentoo Linux users and developers! :) For any mirror administration issues or problems, please contact <mail link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
149 | Thanks for helping out Gentoo Linux users and developers! :) For any mirror |
|
|
150 | administration issues or problems, please contact <mail |
|
|
151 | link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail>. |
| 46 | </note> |
152 | </note> |
|
|
153 | |
|
|
154 | <warn> |
|
|
155 | Do NOT email mirror-admin@gentoo.org for mirror requests, please file a bug. It makes mirror tracking easier on us. |
|
|
156 | </warn> |
|
|
157 | |
| 47 | </body> |
158 | </body> |
| 48 | </section> |
159 | </section> |
| 49 | </chapter> |
160 | </chapter> |
|
|
161 | |
| 50 | <chapter> |
162 | <chapter> |
| 51 | <title>Short FAQ</title> |
163 | <title>Short FAQ</title> |
| 52 | <section> |
164 | <section> |
| 53 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
165 | <title>Q: Who should I contact regarding new mirrors or to get my mirror added to the Gentoo web site?</title> |
| 54 | <body> |
166 | <body> |
| 55 | <p>A: <mail link="klieber@gentoo.org">klieber@gentoo.org</mail></p> |
167 | |
|
|
168 | <p> |
|
|
169 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
|
|
170 | </p> |
|
|
171 | |
| 56 | </body> |
172 | </body> |
| 57 | </section> |
173 | </section> |
| 58 | <section> |
174 | <section> |
| 59 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
175 | <title>Q: Who should I contact regarding mirror issues and maintenance?</title> |
| 60 | <body> |
176 | <body> |
| 61 | <p>A: <mail link="mirror-admin@gentoo.org">mirror-admin@gentoo.org</mail></p> |
|
|
| 62 | </body> |
|
|
| 63 | </section> |
|
|
| 64 | |
177 | |
|
|
178 | <p> |
|
|
179 | A: Please file a bug on bugs.gentoo.org under the rsync category. |
|
|
180 | </p> |
|
|
181 | |
|
|
182 | </body> |
| 65 | <section> |
183 | </section> |
|
|
184 | <section> |
|
|
185 | <title>Q: I run a private source mirror for my company. Can I still access the private master source mirror?</title> |
|
|
186 | <body> |
|
|
187 | |
|
|
188 | <p> |
|
|
189 | A: Because our resources are limited, we need to ensure we allocate them in |
|
|
190 | such a way to provide the maximum amount of benefit to our users. As such, we |
|
|
191 | limit connections to our master rsync and distfile mirrors to public mirrors |
|
|
192 | only. Users are welcome to use our regular mirror system to establish a |
|
|
193 | private source mirror. |
|
|
194 | </p> |
|
|
195 | |
|
|
196 | </body> |
|
|
197 | </section> |
|
|
198 | |
|
|
199 | <section> |
| 66 | <title>Q) How do I find the mirror nearest to me?</title> |
200 | <title>Q: How do I find the mirror nearest to me?</title> |
|
|
201 | <body> |
|
|
202 | |
|
|
203 | <p> |
|
|
204 | A: mirrorselect was designed to do this for you. If you haven't already run |
|
|
205 | <c>emerge mirrorselect</c>, then please do so. Then run: <c>mirrorselect</c>. |
|
|
206 | An ncurses-based menu will display allowing you to select a mirror close to |
|
|
207 | you. |
|
|
208 | </p> |
|
|
209 | |
| 67 | <body> |
210 | </body> |
| 68 | <p>A) mirrorselect was designed to do this for you. If you haven't already run <c>emerge mirrorselect</c> then do it. |
211 | </section> |
| 69 | Then run: <c>mirrorselect</c>. An ncurses-based menu will display allowing you to select a mirror close to you. |
212 | <section> |
|
|
213 | <title>Q: I don't have that much disk space. Can I mirror part of the sources?</title> |
|
|
214 | <body> |
|
|
215 | |
| 70 | </p> |
216 | <p> |
|
|
217 | A: Yes, if you are unable to mirror our full sources, you can elect to mirror |
|
|
218 | the following two directories only: |
|
|
219 | </p> |
|
|
220 | |
|
|
221 | <ul> |
|
|
222 | <li>/distfiles</li> |
|
|
223 | <li>/snapshots</li> |
|
|
224 | </ul> |
|
|
225 | |
|
|
226 | <p> |
|
|
227 | These two directories will require approximately 40GB of space and you will be |
|
|
228 | listed on our site as a distfiles-only mirror. |
|
|
229 | </p> |
|
|
230 | |
|
|
231 | </body> |
|
|
232 | </section> |
|
|
233 | <section> |
|
|
234 | <title>Q: Do I have to turn on Directory Indexing for directories served up via HTTP?</title> |
|
|
235 | <body> |
|
|
236 | |
|
|
237 | <p> |
|
|
238 | A: Directory Indexing is required for the /releases and /experimental |
|
|
239 | directories, but can be turned off for all other directories (including |
|
|
240 | /distfiles) if you wish. |
|
|
241 | </p> |
|
|
242 | </body> |
|
|
243 | </section> |
|
|
244 | |
|
|
245 | <section> |
|
|
246 | <title>Q: Do I have to mirror historical? I mean, it is old releases.</title> |
|
|
247 | <body> |
|
|
248 | |
|
|
249 | <p> |
|
|
250 | A: Of course not, it is quite a bit of data. In your rsync command, add |
|
|
251 | <path>--exclude=/releases/historical</path> to your rsync options. This will |
|
|
252 | exclude historical and save you quite a bit of space. |
|
|
253 | </p> |
|
|
254 | |
| 71 | </body> |
255 | </body> |
| 72 | </section> |
256 | </section> |
| 73 | </chapter> |
257 | </chapter> |
| 74 | </guide> |
258 | </guide> |