Running tests requires modules to be built beforehand

[HurryStarfish]

When using MaxIDE and NG to compile a program that imports modules which need to be compiled first, those modules are built automatically, which is very helpful.
Would it be possible for SCT to do the same? Currently, any modules imported by tests need to be built "manually" before the tests can be run, otherwise it spits out a flood of errors like this:

=== STARTING TESTS ===
* AMOUNT OF TESTS: 4
* RUNNING TEST: C:\Programmierung\BlitzMax-NG\src\bccHurryStarfish\tests\framework\language\finally/tests/try_03.bmx
  COMMAND: C:\Programmierung\BlitzMax-NG Finally\bin\bmk.exe makeapp -a -t console -r -g x86 -o "C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/try_03.exe" "C:\Programmierung\BlitzMax-NG\src\bccHurryStarfish\tests\framework\language\finally/tests/try_03.bmx"
  -> PROCESS FAILED !
  ERROR MESSAGE>>>
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.text+0xc2): undefined reference to `__bb_brl_blitz_blitz'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.text+0xce): undefined reference to `bbEmptyString'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.text+0x133): undefined reference to `bbEmptyString'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.text+0x150): undefined reference to `bbEmptyString'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.text+0x1ca): undefined reference to `bbEmptyString'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.data+0x0): undefined reference to `bbStringClass'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.data+0x10): undefined reference to `bbStringClass'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.data+0x28): undefined reference to `bbStringClass'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.data+0x34): undefined reference to `bbStringClass'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.data+0x40): undefined reference to `bbStringClass'
  C:/Programmierung/BlitzMax-NG/src/bccHurryStarfish/tests/framework/language/finally/tests/.bmx/try_02.bmx.console.release.win32.x86.o:try_02.bmx.console.release.win32.x86.c:(.data+0x4c): more undefined references to `bbStringClass' follow
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.text+0x13e): undefined reference to `__bb_brl_blitz_blitz'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.text+0x14f): undefined reference to `bbObjectRegisterType'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.text+0x15b): undefined reference to `bbObjectAtomicNew'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.text+0x16b): undefined reference to `bbObjectDowncast'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.text+0x18b): undefined reference to `bbObjectDowncast'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.data+0x4): undefined reference to `bbObjectFree'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a(standardio.bmx.release.win32.x86.o):standardio.bmx.release.win32.x86.c:(.data+0x18): undefined reference to `bbObjectToString'
  C:/Programmierung/BlitzMax-NG Finally/mod/brl.mod/standardio.mod/standardio.release.win32.x86.a
[...]

[GWRon]

SCT does not compile stuff - it just executes the same command as "MaxIDE" would execute. It just evaluates what is received via the standard pipe or the error pipe of text outputs.

But I had experienced some "skipped" module compilations with newer BMKs too. It fails to compile because it skipped "auto compiling" some stuff. Running the compilation command again - compiles the missing modules (but might again skip one ...) and it then works.

As you see it calls
bmk.exe makeapp -a -t console -r -g x86 -o "source.exe" "source.bmx"
so no "quick" option or so. Means it should not "skip" anything.

---

Do you suggest to have some kind of "rebuild all modules before" param in SCT ?

[GWRon]

If you suggest above's "rebuild module" param:

sct
-m Build modules first. Reads mods.conf for a list of mods to build.

[HurryStarfish]

Running multiple times or using the TTestCompiler.baseConfig.Add("make_mods", "1") didn't seem to make any difference. I also cleared all .a/.i files from the mod folder beforehand.

Do you suggest to have some kind of "rebuild all modules before" param in SCT ?

Not all modules, just the ones used in the tests. I got around the errors by setting MaxIDE to the same build settings I use for my SCT tests (arch etc.), and then compiling a file containing nothing but:

SuperStrict
Framework BRL.Basic

This compiled all the modules I needed, because when building a program in MaxIDE, all the required (=imported) modules are automatically built before the program itself. It would be nice if tests run via SCT had the same behaviour.

[GWRon]

As said: the auto build of required modules is handled by bmk not SCT. SCT just calls 'bmk' to compile a file. 'bmk' then should build all required modules first. And as said it fails to do so here on my computer too - in rare cases and for "random" used modules.

So it automatically should only build the modules it needs (we use "framework" in the tests to only compile what we need and to keep compilation times low and file sizes small).

@woollybah
Maybe you could shed some light here?

[GWRon]

Maybe checkout the latest revision - fixed some module stuff. They should now automatically compile in the background if the test file requires them.