Unsquashed version at v2-rc-unsquashed, but that cannot be merged as it
breaks bisects at several points. All bugs will not bisect to this
humongous change.
It all started with a conversion of the Bash scripts to Python, mainly
because I couldn't stand not being able to properly use --options for
run which has a million options.
Then since that required a full testing, I decided to do all the
refactorings that I had in mind at once, and so I did and it became
v2-rc.
This is the largest patch I have ever done! OMG a few weeks of extra time.
I'm never writing a Bash script for anything that starts getting big again.
Some of the features are:
* separate build-qemu and build-gem5 commands
* common: convert scripts to python. Add --option for everything
* rename build to build-buildroot now that we are splitting all the build
commands, Linux kernel to follow
* move all git submodules to submodules/ and all buildroot packages to
packages/
* refactor the out/ structure. Keep projects on toplevel, because guest
projects separate archs and host ones don't, making a toplevel arch wrong
* do-release: rename to just release
https://stackoverflow.com/questions/16174992/cant-get-argparse-to-read-quoted-string-with-dashes-in-it
* run: add --terminal and explain gem5 pdb
* just track the lvimrc
* store CLI kernel config fragment inside buildlroot to avoid conflicts
* gem5: document m5 initparam
* readme: make a bunch of things awesomer
* readme: fix broken refs
* parsec-benchmark: update to 75d55ac446a43c47efb1044844a108c6c330184c
Could not fetch otherwise.
* gem5: M5_OVERRIDE_PY_SOURCE
Fix gem5/build wrong path for dd swapfile. Put it under out/ while we are at it
now that we have out of tree builds.
Allow seq_id larger than 7: broke previously because 08 is not valid octal.
Use timeout --foreground to allow killing scons
Don't upload results by default, too insane.
This is cleaner as it removes yet another .gitignore rule and allows
for one command per arch.
This was prompted by the recent Docker patch creating files as root,
which then breaks future host runs.
Also separate all arguments by newlines. This:
- makes it much easier to minimize when reporting QEMU bugs
- shows the full command on the screen despite line wrapping being turned off
by one of the annoying emulators, to be investigated.
The commands are not yet pristine, because:
- there are some leading spaces
- options not sorted
but it is already a huge improvement, and those operations are now be easy from Vim.
The general strategy is:
- end every variable containing a command with a newline
- when expanding such variables, don't add an extra newline
Most of it was present inside buildroot/output.* and the rest scattered
on top level.
This came about for the n-th time when we were reviewing QEMU trace file
locations.
On one hand, it would be cool to have per arch traces.
This made buildroot/output.${arch}~/ a natural choice.
But on the other, those traces have nothing to do with Buildroot,
and could potentially interfere with Buildroot build files.
It also feels nicer to have buildroot/ pristine source code only,
and keep all output under a single directory out/
Otherwise it was getting messy to distinguish between trace-events
and trace-<pid> in the .gitignore.
Now only the latest trace will be kept, with a fixed name.
This lead to a re-factoring of count boot instructions, since trace2line
relies on the same tracing mechanism.
Also, now that we have common factored, I've decided to put the traces on
the out dir, to concentrate all outputs in a single place, and allow
easy switching between archs.
Don't pass -e on checkpoint restore.
Add benchmarks to how much GEM5 is slower than QEMU.
Rename Kernel boot command line arguments to match kernel docs name.
Document how to pass extra options to GEM5.
Start listing interesting benchmarks to run on GEM5.
Add an openmp hello world.
Semi automated conversion, in part because Pandoc is kind of buggy for adoc:
Some of the commands were along the lines:
for f in *.md; do pandoc --atx-headers --base-header-level=3 -o ${f%.md}.adoc --wrap=none $f; done
sed -Ei '/\[\[.*\]\]/d' *.adoc
while read -r f; do cat $f; echo; done <f >g
