[Libre-soc-bugs] [Bug 1100] create pytest plugin that stores each unit test output in a file and just gives a small output to pytest

[bugzilla-daemon at libre-soc.org]

https://bugs.libre-soc.org/show_bug.cgi?id=1100

Jacob Lifshay <programmerjake at gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|IN_PROGRESS                 |RESOLVED
         Resolution|---                         |FIXED

--- Comment #2 from Jacob Lifshay <programmerjake at gmail.com> ---
I got it to work, it took ~18GB ram to run 32-thread pytest without SILENCELOG
on the commit right before luke disabled a bunch of tests. I didn't have time
to test it but I expect it to take a lot less ram at 8 threads, since the main
process was a few GB and each worker was a few hundred MB to ~1GB.
https://git.libre-soc.org/?p=openpower-isa.git;a=commit;h=6a2de7d216b308182b0367b6240724e2a62b5029

it wrote out **85GB** of logs!

pytest                       7.1.2
pytest-forked                1.4.0
pytest-output-to-files       0.1.0
pytest-xdist                 2.5.0

I ran (in openpower-isa):
pytest --shorten-output-dir=test-out -n auto -v &> log.txt

https://git.libre-soc.org/?p=pytest-output-to-files.git;a=shortlog;h=0ce93414b507273cb02799dd5010683650b49dee

commit 0ce93414b507273cb02799dd5010683650b49dee
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 2 20:33:57 2023 -0700

    reduce line count

commit 46d2bb04ef995f5ef2289fbdf1313f1804b2a427
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 2 20:11:27 2023 -0700

    suspend default capture plugin while capturing

commit c18e34643ed6dfbc06a431fb38e3337962ee01b8
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 2 19:15:49 2023 -0700

    all tests pass!

commit f7b2341b25b46edb557eeb5d8caf85cc3c497d97
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 2 19:15:03 2023 -0700

    update .gitignore

-- 
You are receiving this mail because:
You are on the CC list for the bug.