Add a release test script

Confirms that all the examples that aren't tested in the test suite at
least run. Easy to miss brokenness there. Output can be inspected
manually (it'll vary depending on the kernel version).

Fix defconfig_oldconfig.py, which hadn't been properly updated for the
new API.

1 files changed, 1 insertions, 0 deletions

diff --git a/testsuite.py b/testsuite.py
index 90efc3d..8ba0edc 100644
--- a/testsuite.py
+++ b/testsuite.py
@@ -1705,6 +1705,7 @@ def run_compatibility_tests():
         print("{} arch/defconfig pairs tested".format(nconfigs))
     else:
         print("Some tests failed")
+        sys.exit(1)
 
 def get_arch_srcarch_list():
     """