… | |
… | |
25 | <tbody valign="top"> |
25 | <tbody valign="top"> |
26 | <tr class="field"><th class="field-name">GLEP:</th><td class="field-body">59</td> |
26 | <tr class="field"><th class="field-name">GLEP:</th><td class="field-body">59</td> |
27 | </tr> |
27 | </tr> |
28 | <tr class="field"><th class="field-name">Title:</th><td class="field-body">Manifest2 hash policies and security implications</td> |
28 | <tr class="field"><th class="field-name">Title:</th><td class="field-body">Manifest2 hash policies and security implications</td> |
29 | </tr> |
29 | </tr> |
30 | <tr class="field"><th class="field-name">Version:</th><td class="field-body">1.7</td> |
30 | <tr class="field"><th class="field-name">Version:</th><td class="field-body">1.9</td> |
31 | </tr> |
31 | </tr> |
32 | <tr class="field"><th class="field-name">Last-Modified:</th><td class="field-body"><a class="reference external" href="http://www.gentoo.org/cgi-bin/viewcvs.cgi/xml/htdocs/proj/en/glep/glep-0059.txt?cvsroot=gentoo">2010/02/02 05:49:27</a></td> |
32 | <tr class="field"><th class="field-name">Last-Modified:</th><td class="field-body"><a class="reference external" href="http://www.gentoo.org/cgi-bin/viewcvs.cgi/xml/htdocs/proj/en/glep/glep-0059.txt?cvsroot=gentoo">2010/04/07 21:34:24</a></td> |
33 | </tr> |
33 | </tr> |
34 | <tr class="field"><th class="field-name">Author:</th><td class="field-body">Robin Hugh Johnson <robbat2 at gentoo.org>,</td> |
34 | <tr class="field"><th class="field-name">Author:</th><td class="field-body">Robin Hugh Johnson <robbat2 at gentoo.org>,</td> |
35 | </tr> |
35 | </tr> |
36 | <tr class="field"><th class="field-name">Status:</th><td class="field-body">Draft</td> |
36 | <tr class="field"><th class="field-name">Status:</th><td class="field-body">Draft</td> |
37 | </tr> |
37 | </tr> |
… | |
… | |
53 | </table> |
53 | </table> |
54 | <hr /> |
54 | <hr /> |
55 | <div class="contents topic" id="contents"> |
55 | <div class="contents topic" id="contents"> |
56 | <p class="topic-title first">Contents</p> |
56 | <p class="topic-title first">Contents</p> |
57 | <ul class="simple"> |
57 | <ul class="simple"> |
58 | <li><a class="reference internal" href="#abstract" id="id1">Abstract</a></li> |
58 | <li><a class="reference internal" href="#abstract" id="id2">Abstract</a></li> |
59 | <li><a class="reference internal" href="#motivation" id="id2">Motivation</a></li> |
59 | <li><a class="reference internal" href="#motivation" id="id3">Motivation</a></li> |
60 | <li><a class="reference internal" href="#specification" id="id3">Specification</a><ul> |
60 | <li><a class="reference internal" href="#specification" id="id4">Specification</a><ul> |
61 | <li><a class="reference internal" href="#the-bad-news" id="id4">The bad news</a></li> |
61 | <li><a class="reference internal" href="#the-bad-news" id="id5">The bad news</a></li> |
62 | <li><a class="reference internal" href="#how-fast-can-md5-be-broken" id="id5">How fast can MD5 be broken?</a></li> |
62 | <li><a class="reference internal" href="#how-fast-can-md5-be-broken" id="id6">How fast can MD5 be broken?</a></li> |
63 | <li><a class="reference internal" href="#the-good-news" id="id6">The good news</a></li> |
63 | <li><a class="reference internal" href="#the-good-news" id="id7">The good news</a></li> |
64 | <li><a class="reference internal" href="#what-should-be-done" id="id7">What should be done</a></li> |
64 | <li><a class="reference internal" href="#what-should-be-done" id="id8">What should be done</a></li> |
65 | <li><a class="reference internal" href="#checksum-depreciation-timing" id="id8">Checksum depreciation timing</a><ul> |
65 | <li><a class="reference internal" href="#checksum-depreciation-timing" id="id9">Checksum depreciation timing</a><ul> |
66 | <li><a class="reference internal" href="#general-principles" id="id9">General principles:</a></li> |
66 | <li><a class="reference internal" href="#general-principles" id="id10">General principles:</a></li> |
67 | <li><a class="reference internal" href="#immediate-plans" id="id10">Immediate plans:</a></li> |
67 | <li><a class="reference internal" href="#immediate-plans" id="id11">Immediate plans:</a></li> |
68 | </ul> |
68 | </ul> |
69 | </li> |
69 | </li> |
70 | </ul> |
70 | </ul> |
71 | </li> |
71 | </li> |
72 | <li><a class="reference internal" href="#backwards-compatibility" id="id11">Backwards Compatibility</a></li> |
72 | <li><a class="reference internal" href="#backwards-compatibility" id="id12">Backwards Compatibility</a></li> |
73 | <li><a class="reference internal" href="#references" id="id12">References</a></li> |
73 | <li><a class="reference internal" href="#references" id="id13">References</a></li> |
74 | <li><a class="reference internal" href="#thanks-to" id="id13">Thanks to</a></li> |
74 | <li><a class="reference internal" href="#thanks-to" id="id14">Thanks to</a></li> |
|
|
75 | <li><a class="reference internal" href="#id1" id="id15">References</a></li> |
75 | <li><a class="reference internal" href="#copyright" id="id14">Copyright</a></li> |
76 | <li><a class="reference internal" href="#copyright" id="id16">Copyright</a></li> |
76 | </ul> |
77 | </ul> |
77 | </div> |
78 | </div> |
78 | <div class="section" id="abstract"> |
79 | <div class="section" id="abstract"> |
79 | <h1><a class="toc-backref" href="#id1">Abstract</a></h1> |
80 | <h1><a class="toc-backref" href="#id2">Abstract</a></h1> |
80 | <p>While Manifest2 format allows multiple hashes, the question of which |
81 | <p>While Manifest2 format allows multiple hashes, the question of which |
81 | checksums should be present, why, and the security implications of such |
82 | checksums should be present, why, and the security implications of such |
82 | have never been resolved. This GLEP covers all of these issues, and |
83 | have never been resolved. This GLEP covers all of these issues, and |
83 | makes recommendations as to how to handle checksums both now, and in |
84 | makes recommendations as to how to handle checksums both now, and in |
84 | future.</p> |
85 | future.</p> |
85 | </div> |
86 | </div> |
86 | <div class="section" id="motivation"> |
87 | <div class="section" id="motivation"> |
87 | <h1><a class="toc-backref" href="#id2">Motivation</a></h1> |
88 | <h1><a class="toc-backref" href="#id3">Motivation</a></h1> |
88 | <p>This GLEP is being written as part of the work on signing the Portage |
89 | <p>This GLEP is being written as part of the work on signing the Portage |
89 | tree, but is only tangentially related to the actual signing of |
90 | tree, but is only tangentially related to the actual signing of |
90 | Manifests. Checksums present one possible weak point in the overall |
91 | Manifests. Checksums present one possible weak point in the overall |
91 | security of the tree - and a comprehensive security plan is needed.</p> |
92 | security of the tree - and a comprehensive security plan is needed.</p> |
92 | <p>This GLEP is not mandatory for the tree-signing specification, but |
93 | <p>This GLEP is not mandatory for the tree-signing specification, but |
93 | instead aims to improve the security of the hashes used in Manifest2. |
94 | instead aims to improve the security of the hashes used in Manifest2 |
94 | As such, it is also able to stand on it's own.</p> |
95 | [GLEP44]. As such, it is also able to stand on it's own.</p> |
95 | </div> |
96 | </div> |
96 | <div class="section" id="specification"> |
97 | <div class="section" id="specification"> |
97 | <h1><a class="toc-backref" href="#id3">Specification</a></h1> |
98 | <h1><a class="toc-backref" href="#id4">Specification</a></h1> |
98 | <div class="section" id="the-bad-news"> |
99 | <div class="section" id="the-bad-news"> |
99 | <h2><a class="toc-backref" href="#id4">The bad news</a></h2> |
100 | <h2><a class="toc-backref" href="#id5">The bad news</a></h2> |
100 | <p>First of all, I'd like to cover the bad news in checksum security. |
101 | <p>First of all, I'd like to cover the bad news in checksum security. |
101 | A much discussed point, as been the simple question: What is the |
102 | A much discussed point, as been the simple question: What is the |
102 | security of multiple independent checksums on the same data? |
103 | security of multiple independent checksums on the same data? |
103 | The most common position (and indeed the one previously held by myself), |
104 | The most common position (and indeed the one previously held by myself), |
104 | is that multiple checksums would be an increase in security, but we |
105 | is that multiple checksums would be an increase in security, but we |
… | |
… | |
110 | checksum.</p> |
111 | checksum.</p> |
111 | <p>Wang et al [W04] extended Joux's [J04] work on SHA-0 to cover MD4, MD5, |
112 | <p>Wang et al [W04] extended Joux's [J04] work on SHA-0 to cover MD4, MD5, |
112 | HAVAL-128 and RIPEMD families of hashes.</p> |
113 | HAVAL-128 and RIPEMD families of hashes.</p> |
113 | </div> |
114 | </div> |
114 | <div class="section" id="how-fast-can-md5-be-broken"> |
115 | <div class="section" id="how-fast-can-md5-be-broken"> |
115 | <h2><a class="toc-backref" href="#id5">How fast can MD5 be broken?</a></h2> |
116 | <h2><a class="toc-backref" href="#id6">How fast can MD5 be broken?</a></h2> |
116 | <p>For a general collision, not a pre-image attack, since the announcement |
117 | <p>For a general collision, not a pre-image attack, since the announcement |
117 | by Wang et al [W04], the time required to break MD5 has been massively |
118 | by Wang et al [W04], the time required to break MD5 has been massively |
118 | reduced. Originally at 1 hour on a near-supercomputer (IBM P690) and |
119 | reduced. Originally at 1 hour on a near-supercomputer (IBM P690) and |
119 | estimated at 64 hours with a Pentium-3 1.7Ghz. This has gone down to |
120 | estimated at 64 hours with a Pentium-3 1.7Ghz. This has gone down to |
120 | less than in two years, to 17 seconds [K06a].</p> |
121 | less than in two years, to 17 seconds [K06a].</p> |
… | |
… | |
136 | feasible, see [K06b] for an application that can produce two |
137 | feasible, see [K06b] for an application that can produce two |
137 | self-extracting EXE files, with identical MD5s, and whatever payload you |
138 | self-extracting EXE files, with identical MD5s, and whatever payload you |
138 | want.</p> |
139 | want.</p> |
139 | </div> |
140 | </div> |
140 | <div class="section" id="the-good-news"> |
141 | <div class="section" id="the-good-news"> |
141 | <h2><a class="toc-backref" href="#id6">The good news</a></h2> |
142 | <h2><a class="toc-backref" href="#id7">The good news</a></h2> |
142 | <p>Of the checksums presently used by Manifest2 (SHA1, SHA256, RIPEMD160), |
143 | <p>Of the checksums presently used by Manifest2 (SHA1, SHA256, RIPEMD160), |
143 | one stands close to being completely broken: SHA1; and another is |
144 | one stands close to being completely broken: SHA1; and another is |
144 | significantly weakened: RIPEMD160. The SHA2 series has suffered some |
145 | significantly weakened: RIPEMD160. The SHA2 series has suffered some |
145 | attacks, but still remains reasonably solid [G07],[K08].</p> |
146 | attacks, but still remains reasonably solid [G07],[K08].</p> |
146 | <p>To reduce the potential for future problems and any single checksum |
147 | <p>To reduce the potential for future problems and any single checksum |
… | |
… | |
148 | strongest hash available from each family of checksums, and be prepared |
149 | strongest hash available from each family of checksums, and be prepared |
149 | to retire old checksums actively, unless there is a overriding reason to |
150 | to retire old checksums actively, unless there is a overriding reason to |
150 | keep a specific checksum, such as part of a migration plan.</p> |
151 | keep a specific checksum, such as part of a migration plan.</p> |
151 | </div> |
152 | </div> |
152 | <div class="section" id="what-should-be-done"> |
153 | <div class="section" id="what-should-be-done"> |
153 | <h2><a class="toc-backref" href="#id7">What should be done</a></h2> |
154 | <h2><a class="toc-backref" href="#id8">What should be done</a></h2> |
154 | <p>Portage should always try to verify all supported hashes that are |
155 | <p>Portage should always try to verify all supported hashes that are |
155 | available in a Manifest2, starting with the strongest ones as maintained |
156 | available in a Manifest2, starting with the strongest ones as maintained |
156 | by a preference list. Over time, the weaker checksums should be removed |
157 | by a preference list. Over time, the weaker checksums should be removed |
157 | from Manifest2 files, once all old Portage installations have had |
158 | from Manifest2 files, once all old Portage installations have had |
158 | sufficient time to upgrade. Stronger checksums shall be added as soon as |
159 | sufficient time to upgrade. Stronger checksums shall be added as soon as |
… | |
… | |
169 | (python-mhash).</p> |
170 | (python-mhash).</p> |
170 | <p>The existence unsupported hash is not considered to be a failure unless |
171 | <p>The existence unsupported hash is not considered to be a failure unless |
171 | no supported hashes are available for a given Manifest entry.</p> |
172 | no supported hashes are available for a given Manifest entry.</p> |
172 | </div> |
173 | </div> |
173 | <div class="section" id="checksum-depreciation-timing"> |
174 | <div class="section" id="checksum-depreciation-timing"> |
174 | <h2><a class="toc-backref" href="#id8">Checksum depreciation timing</a></h2> |
175 | <h2><a class="toc-backref" href="#id9">Checksum depreciation timing</a></h2> |
175 | <div class="section" id="general-principles"> |
176 | <div class="section" id="general-principles"> |
176 | <h3><a class="toc-backref" href="#id9">General principles:</a></h3> |
177 | <h3><a class="toc-backref" href="#id10">General principles:</a></h3> |
177 | <p>A minimum set of depreciated checksums shall be maintained only to |
178 | <p>A minimum set of depreciated checksums shall be maintained only to |
178 | support old package manager versions where needed by historically used |
179 | support old package manager versions where needed by historically used |
179 | trees:</p> |
180 | trees:</p> |
180 | <ul class="simple"> |
181 | <ul class="simple"> |
181 | <li>New package manager versions should NOT use depreciated checksums in</li> |
182 | <li>New package manager versions should NOT use depreciated checksums in</li> |
… | |
… | |
185 | <li>Removal of depreciated checksums shall happen after no less than 18 |
186 | <li>Removal of depreciated checksums shall happen after no less than 18 |
186 | months or one major Portage version cycle, whichever is greater.</li> |
187 | months or one major Portage version cycle, whichever is greater.</li> |
187 | </ul> |
188 | </ul> |
188 | </div> |
189 | </div> |
189 | <div class="section" id="immediate-plans"> |
190 | <div class="section" id="immediate-plans"> |
190 | <h3><a class="toc-backref" href="#id10">Immediate plans:</a></h3> |
191 | <h3><a class="toc-backref" href="#id11">Immediate plans:</a></h3> |
191 | <p>For the current Portage, both SHA1 and RIPEMD160 should be immediately |
192 | <p>For the current Portage, both SHA1 and RIPEMD160 should be immediately |
192 | removed, as they present no advantages over the already present SHA256. |
193 | removed, as they present no advantages over the already present SHA256. |
193 | SHA256 cannot be replaced immediately with SHA512, as existing Portage |
194 | SHA256 cannot be replaced immediately with SHA512, as existing Portage |
194 | versions need at least one supported algorithm present (SHA256 support |
195 | versions need at least one supported algorithm present (SHA256 support |
195 | was added in June 2006), so it must be retained for some while.</p> |
196 | was added in June 2006), so it must be retained for some while.</p> |
… | |
… | |
204 | </ul> |
205 | </ul> |
205 | </div> |
206 | </div> |
206 | </div> |
207 | </div> |
207 | </div> |
208 | </div> |
208 | <div class="section" id="backwards-compatibility"> |
209 | <div class="section" id="backwards-compatibility"> |
209 | <h1><a class="toc-backref" href="#id11">Backwards Compatibility</a></h1> |
210 | <h1><a class="toc-backref" href="#id12">Backwards Compatibility</a></h1> |
210 | <p>Old versions of Portage may support and expect only specific checksums. |
211 | <p>Old versions of Portage may support and expect only specific checksums. |
211 | This is accounted for in the checksum depreciation discussion.</p> |
212 | This is accounted for in the checksum depreciation discussion.</p> |
212 | <p>For maximum compatiability, we should only have to include each of the |
213 | <p>For maximum compatiability, we should only have to include each of the |
213 | old algorithms that we are officially still supporting, as well as the |
214 | old algorithms that we are officially still supporting, as well as the |
214 | new ones that we prefer.</p> |
215 | new ones that we prefer.</p> |
215 | </div> |
216 | </div> |
216 | <div class="section" id="references"> |
217 | <div class="section" id="references"> |
217 | <h1><a class="toc-backref" href="#id12">References</a></h1> |
218 | <h1><a class="toc-backref" href="#id13">References</a></h1> |
218 | <dl class="docutils"> |
219 | <dl class="docutils"> |
219 | <dt>[AHS] NIST (2007). "NIST's Plan for New Cryptographic Hash Functions",</dt> |
220 | <dt>[AHS] NIST (2007). "NIST's Plan for New Cryptographic Hash Functions",</dt> |
220 | <dd>(Advanced Hash Standard). <a class="reference external" href="http://csrc.nist.gov/pki/HashWorkshop/">http://csrc.nist.gov/pki/HashWorkshop/</a></dd> |
221 | <dd>(Advanced Hash Standard). <a class="reference external" href="http://csrc.nist.gov/pki/HashWorkshop/">http://csrc.nist.gov/pki/HashWorkshop/</a></dd> |
221 | <dt>[BOBO06] Boneh, D. and Boyen, X. (2006). "On the Impossibility of</dt> |
222 | <dt>[BOBO06] Boneh, D. and Boyen, X. (2006). "On the Impossibility of</dt> |
222 | <dd>Efficiently Combining Collision Resistant Hash Functions"; Proceedings |
223 | <dd>Efficiently Combining Collision Resistant Hash Functions"; Proceedings |
… | |
… | |
250 | version (August 17, 2004). Available online from: |
251 | version (August 17, 2004). Available online from: |
251 | <a class="reference external" href="http://eprint.iacr.org/2004/199.pdf">http://eprint.iacr.org/2004/199.pdf</a></dd> |
252 | <a class="reference external" href="http://eprint.iacr.org/2004/199.pdf">http://eprint.iacr.org/2004/199.pdf</a></dd> |
252 | </dl> |
253 | </dl> |
253 | </div> |
254 | </div> |
254 | <div class="section" id="thanks-to"> |
255 | <div class="section" id="thanks-to"> |
255 | <h1><a class="toc-backref" href="#id13">Thanks to</a></h1> |
256 | <h1><a class="toc-backref" href="#id14">Thanks to</a></h1> |
256 | <dl class="docutils"> |
257 | <dl class="docutils"> |
257 | <dt>I'd like to thank the following folks, in no specific order:</dt> |
258 | <dt>I'd like to thank the following folks, in no specific order:</dt> |
258 | <dd><ul class="first last simple"> |
259 | <dd><ul class="first last simple"> |
259 | <li>Ciaran McCreesh (ciaranm) - for pointing out the Joux (2004) paper, |
260 | <li>Ciaran McCreesh (ciaranm) - for pointing out the Joux (2004) paper, |
260 | and also being stubborn enough in not accepting a partial solution.</li> |
261 | and also being stubborn enough in not accepting a partial solution.</li> |
… | |
… | |
263 | codebase.</li> |
264 | codebase.</li> |
264 | </ul> |
265 | </ul> |
265 | </dd> |
266 | </dd> |
266 | </dl> |
267 | </dl> |
267 | </div> |
268 | </div> |
|
|
269 | <div class="section" id="id1"> |
|
|
270 | <h1><a class="toc-backref" href="#id15">References</a></h1> |
|
|
271 | <table class="docutils citation" frame="void" id="glep44" rules="none"> |
|
|
272 | <colgroup><col class="label" /><col /></colgroup> |
|
|
273 | <tbody valign="top"> |
|
|
274 | <tr><td class="label">[GLEP44]</td><td>Mauch, M. (2005) GLEP44 - Manifest2 format. |
|
|
275 | <a class="reference external" href="http://www.gentoo.org/proj/en/glep/glep-0044.html">http://www.gentoo.org/proj/en/glep/glep-0044.html</a></td></tr> |
|
|
276 | </tbody> |
|
|
277 | </table> |
|
|
278 | </div> |
268 | <div class="section" id="copyright"> |
279 | <div class="section" id="copyright"> |
269 | <h1><a class="toc-backref" href="#id14">Copyright</a></h1> |
280 | <h1><a class="toc-backref" href="#id16">Copyright</a></h1> |
270 | <p>Copyright (c) 2006-2010 by Robin Hugh Johnson. This material may be |
281 | <p>Copyright (c) 2006-2010 by Robin Hugh Johnson. This material may be |
271 | distributed only subject to the terms and conditions set forth in the |
282 | distributed only subject to the terms and conditions set forth in the |
272 | Open Publication License, v1.0.</p> |
283 | Open Publication License, v1.0.</p> |
273 | <p>vim: tw=72 ts=2 expandtab:</p> |
284 | <!-- vim: tw=72 ts=2 expandtab: --> |
274 | </div> |
285 | </div> |
275 | |
286 | |
276 | </div> |
287 | </div> |
277 | <div class="footer"> |
288 | <div class="footer"> |
278 | <hr class="footer" /> |
289 | <hr class="footer" /> |
279 | <a class="reference external" href="glep-0059.txt">View document source</a>. |
290 | <a class="reference external" href="glep-0059.txt">View document source</a>. |
280 | Generated on: 2010-02-07 10:37 UTC. |
291 | Generated on: 2010-04-07 21:54 UTC. |
281 | Generated by <a class="reference external" href="http://docutils.sourceforge.net/">Docutils</a> from <a class="reference external" href="http://docutils.sourceforge.net/rst.html">reStructuredText</a> source. |
292 | Generated by <a class="reference external" href="http://docutils.sourceforge.net/">Docutils</a> from <a class="reference external" href="http://docutils.sourceforge.net/rst.html">reStructuredText</a> source. |
282 | |
293 | |
283 | </div> |
294 | </div> |
284 | </body> |
295 | </body> |
285 | </html> |
296 | </html> |