Differences between revisions 375 and 376
Revision 375 as of 2019-05-22 19:10:23
Size: 6711
Editor: HolgerLevsen
Comment: mention #929397: "ftp.d.o: please upload LTS .buildinfo files to ftp-master"
Revision 376 as of 2019-06-13 20:31:05
Size: 7650
Editor: HolgerLevsen
Comment: add a bunch of related bugreports
Deletions are marked like this. Additions are marked like this.
Line 33: Line 33:
 * [[DebianBug:774415|#774415]] devscripts: please add the srebuild wrapper for reproducible builds - package it standalone? https://salsa.debian.org/reproducible-builds/debian-rebuilder-setup/blob/master/builder/srebuild has another variant
Line 34: Line 35:
 * currently debian-policy says "packages ''should'' be reproducible", though we aim for "packages ''must'' be reproducible" though it's still a long road until we'll be there: currently (Oct 2018) there are more than 1250 unreproducible packages in Buster, thus if policy would be changed today, 1250 packages would need to be kicked out of Buster (well, or fixed) immediatly, so this policy change right now is not feasable.  * currently debian-policy (thanks to [[DebianBug:844431|#844431]]) says "packages ''should'' be reproducible", though we aim for "packages ''must'' be reproducible" though it's still a long road until we'll be there: currently (Oct 2018) there are more than 1250 unreproducible packages in Buster, thus if policy would be changed today, 1250 packages would need to be kicked out of Buster (well, or fixed) immediatly, so this policy change right now is not feasable.
Line 48: Line 49:
= Also related =

 * [[DebianBug:895346|#895346]] [devscripts] devscripts: dcmd --buildinfo is not documented
 * [[DebianBug:869567|#869567]] [devscripts] debsign: doesn't sign multiple .buildinfo in the same changes
 * [[DebianBug:898961|#898961]] [devscripts] dscverify: accept .buildinfo from a build with unsigned .dsc which later was signed
 * [[DebianBug:807270|#807270]] [devscripts] mk-origtargz: create reproducible tarballs and --mtime option
 * [[DebianBug:852365|#852365]] [sbuild] sbuild: append-to-version may overwrite incorrect .buildinfo
 * [[DebianBug:923987|#923987]] [sbuild] Should also send the buildinfo in the build mail

https://reproducible-builds.org

It should be possible to reproduce, byte for byte, every build of every package in Debian. More information about reproducible builds in general are available at reproducible-builds.org.

About
About

Howto
Make a package reproducible

?Contribute
?How to help

Toolchain
Experimental toolchain

History
Project history

Salsa / Gitlab
Salsa project / Gitlab

Bugs
Bug reports

Jenkins
Continuous integration

Status

Reproducible builds of Debian as a whole is still not a reality, though individual reproducible builds of packages are possible and being done. So while we are making very good progress, it is a stretch to say that Debian is reproducible.

  • Most packages built in sid today are reproducible under a fixed build-path and environment.

  • We have a new control file *.buildinfo that records the build environment, see deb-buildinfo for reference. Older design drafts are here.

  • We have a continuous integration platform that builds and immediately rebuilds packages. With this we can detect problems related to timestamps, file ordering, CPU usage, (pseudo-)randomness and other things.

  • We are examining packages and sorting out common problems.

  • Many patches have already been submitted, and we are continuously writing new ones.

  • You can check which packages installed on your system are still unreproducible by using the reproducible-check script in the devscripts package.

Big outstanding issues

These are the critical items necessary to have reproducible builds for at least the required packages of Debian

Annoying but not major

Nice to have

  • Tighten up the Policy definition of "reproducible" to be stricter about environment variables and build paths.
  • Discuss which environment variables we should blacklist or whitelist, 876055.

  • #929397: ftp.d.o: please upload LTS .buildinfo files to ftp-master (this is not relevant yet, as Jessie is the LTS release, while only dpkg from Stretch and newer produces .buildinfo files.)

Also related

  • #895346 [devscripts] devscripts: dcmd --buildinfo is not documented

  • #869567 [devscripts] debsign: doesn't sign multiple .buildinfo in the same changes

  • #898961 [devscripts] dscverify: accept .buildinfo from a build with unsigned .dsc which later was signed

  • #807270 [devscripts] mk-origtargz: create reproducible tarballs and --mtime option

  • #852365 [sbuild] sbuild: append-to-version may overwrite incorrect .buildinfo

  • #923987 [sbuild] Should also send the buildinfo in the build mail

There are many other possible nice-to-haves, e.g., making builds independent of their build directory, making it possible to create archive formats (like tar.gz and zip) with different tools yet result in the same byte order, etc. Many of those are valuable, but they shouldn't distract from getting the results of reproducible builds out to users.

Next

For more concrete tasks to be done, look at how to contribute.

Statistics from the continuous integration platform


CategoryDebianDevelopment