lkmc v2-rc

Unsquashed version at v2-rc-unsquashed, but that cannot be merged as it
breaks bisects at several points. All bugs will not bisect to this
humongous change.

It all started with a conversion of the Bash scripts to Python, mainly
because I couldn't stand not being able to properly use --options for
run which has a million options.

Then since that required a full testing, I decided to do all the
refactorings that I had in mind at once, and so I did and it became
v2-rc.

This is the largest patch I have ever done! OMG a few weeks of extra time.
I'm never writing a Bash script for anything that starts getting big again.

Some of the features are:

* separate build-qemu and build-gem5 commands
* common: convert scripts to python. Add --option for everything
* rename build to build-buildroot now that we are splitting all the build
  commands, Linux kernel to follow
* move all git submodules to submodules/ and all buildroot packages to
  packages/
* refactor the out/ structure. Keep projects on toplevel, because guest
  projects separate archs and host ones don't, making a toplevel arch wrong
* do-release: rename to just release
  https://stackoverflow.com/questions/16174992/cant-get-argparse-to-read-quoted-string-with-dashes-in-it
* run: add --terminal and explain gem5 pdb
* just track the lvimrc
* store CLI kernel config fragment inside buildlroot to avoid conflicts
* gem5: document m5 initparam
* readme: make a bunch of things awesomer
* readme: fix broken refs
* parsec-benchmark: update to 75d55ac446a43c47efb1044844a108c6c330184c
  Could not fetch otherwise.
* gem5: M5_OVERRIDE_PY_SOURCE

trace2line

@@ -1,22 +1,62 @@
-#!/usr/bin/env bash
-. "$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)/common"
-while getopts "${common_getopts_flags}" OPT; do
-  case "$OPT" in
-    ?)
-      common_getopts_case "$OPT"
-      ;;
-  esac
-done
-common_setup
-kernel_dir="${common_build_dir}/linux-custom"
-(
-  if "$common_gem5"; then
-    sed -r 's/^.* (0x[^. ]*)[. ].*/\1/' "$common_trace_txt_file"
-  else
-    sed -r 's/.*pc=//' "$common_trace_txt_file"
-  fi
-) | \
-  xargs "${common_host_dir}/bin/${common_arch}-linux-addr2line" -e "${common_vmlinux}" -fp | \
-  sed -E "s|at ${kernel_dir}/(\./\|)||" | \
-  uniq -c \
-> "${common_run_dir}/trace-lines.txt"
+#!/usr/bin/env python3
+
+'''
+TODO port this to Python fully. I started it, but then it was hanging on some
+IO blocking annoyance in the pipeline, and I don't have the time to deal with
+it, so I'm just going to forward the common options to the old shell script for
+now...
+'''
+
+import os
+import re
+import subprocess
+import sys
+
+import common
+
+parser = common.get_argparse(argparse_args={
+    'description': 'Convert an execution trace containing PC values into the Linux kernel linex executed'
+})
+args = common.setup(parser)
+sys.exit(subprocess.Popen([
+    os.path.join(common.root_dir, 'trace2line.sh'),
+    'true' if args.gem5 else 'false',
+    common.trace_txt_file,
+    common.get_toolchain_tool('addr2line'),
+    common.vmlinux,
+    common.run_dir,
+]).wait())
+
+# This was the full conversion attempt.
+
+# if args.gem5:
+#     def get_pc(line):
+#         # TODO
+#         # stdin = sed -r 's/^.* (0x[^. ]*)[. ].*/\1/' "$common_trace_txt_file")
+#         pass
+# else:
+#     def get_pc(line):
+#         return line.split('=')[-1]
+# with \
+#         subprocess.Popen(
+#             [
+#                 common.get_toolchain_tool('addr2line'),
+#                 '-e',
+#                 common.vmlinux,
+#                 '-f',
+#                 '-p',
+#             ],
+#             stdout=subprocess.PIPE,
+#             stdin=subprocess.PIPE,
+#         ) as proc, \
+#         open(common.trace_txt_file, 'r') as infile, \
+#         open(os.path.join(common.run_dir, 'trace-lines.txt'), 'w') as outfile \
+#     :
+#     for in_line in infile:
+#         proc.stdin.write(get_pc(in_line).encode())
+#         proc.stdin.flush()
+#         stdout = proc.stdout.read()
+#         outfile.write(stdout.decode())
+#     # TODO
+#     # sed -E "s|at ${common.linux_build_dir}/(\./\|)||"
+#     # uniq -c