[Libre-soc-bugs] [Bug 1100] create pytest plugin that stores each unit test output in a file and just gives a small output to pytest

[bugzilla-daemon at libre-soc.org]

https://bugs.libre-soc.org/show_bug.cgi?id=1100

Jacob Lifshay <programmerjake at gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |IN_PROGRESS
         Resolution|FIXED                       |---

--- Comment #3 from Jacob Lifshay <programmerjake at gmail.com> ---
as mentioned:
https://libre-soc.org/irclog/%23libre-soc.2023-06-10.log.html#t2023-06-10T02:08:57

I'd like to change the required version of pytest to 7.3.1 and pytest-xdist to
3.3.1 since we have to install from pip anyway and 3.x is ancient and
ieee754fpu has required at least 6.0 for over a year and because with the
plugin I wrote we don't have the running out of memory issue anymore
(those are the versions CI is currently using)
https://git.libre-soc.org/?p=ieee754fpu.git;a=blob;f=pyproject.toml;h=267ae9af7d6f7a6cb20043c7f6289b3d53213f59;hb=658d12765b103405f7965a0d3c5e399446654686#l2

I'm planning on adding a similar pyproject.toml with the pytest config to
openpower-isa.git to always enable the plugin
(it's only used by pytest, so users don't need it unless they want to run tests
using pytest)
that >=6.0 version requirement was committed may 2022

I added the openpower-isa side of the relevant changes on the pytest7 branch:
https://git.libre-soc.org/?p=openpower-isa.git;a=shortlog;h=refs/heads/pytest7

running pytest with SILENCELOG unset with 8 threads uses 9.46GiB ram on my
system on the pytest7 branch and generates 5.8G of output log files in
test-out/

commit 376be188538728f7cbd32aad38ed324dbe18e3b1
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 9 20:14:44 2023 -0700

    silence log by default just in fmv/fcvt and utf-8 tests

    this is overridable by setting SILENCELOG to any value, which is then used

commit a1fd555dd65757371c111c7f98ce69e49b65b5b4
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 9 19:02:50 2023 -0700

    Revert "disable fmv / fcvt unit tests as there are such a vast number"

    new pytest-output-to-files plugin mitigates memory use

    This reverts commit 329985466b05b821c1f02277224f445051c77bb6.

commit 9ec99a1b36236685ac80c91e9156e42cdfd3918c
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 9 19:02:26 2023 -0700

    Revert "disable fmv-fcvt tests entirely"

    new pytest-output-to-files plugin mitigates memory use

    This reverts commit beadcce36dc23ffc8d599b1ac4601da9500476a4.

commit 36f03ce09789d373de58ef771e92bbc9f314ed59
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 9 19:00:37 2023 -0700

    Revert "far too much memory (58 GB) being used by these unit tests,"

    new pytest-output-to-files plugin mitigates memory use

    This reverts commit e31e5486822023bf99701e410d7b5e55df355048.

commit 29a26474264682cfc311ad93e537c6c08a181006
Author: Jacob Lifshay <programmerjake at gmail.com>
Date:   Fri Jun 9 18:29:48 2023 -0700

    use pytest-output-to-files plugin with pytest==7.3.1 and
pytest-xdist==3.3.1

-- 
You are receiving this mail because:
You are on the CC list for the bug.