programmerjake | pypi i mean | 00:00 |
---|---|---|
lkcl | nice idea. it's certainly a valuable solution | 00:00 |
lkcl | have a look under the active top-level bugs for a location with spare budget | 00:03 |
lkcl | https://bugs.libre-soc.org/show_bug.cgi?id=938 | 00:03 |
programmerjake | seems like eur 200-400 from #775 should be good, shall I allocate that? | 00:10 |
programmerjake | i expect it to take a day, 2 days at most | 00:10 |
programmerjake | can you create a pytest-output-to-files.git repo? | 00:11 |
lkcl | ah don't make it that small, just take the lot | 00:12 |
lkcl | (we've been asked not to do small payments) | 00:13 |
lkcl | ahhh i found two versions of xdist and pytest that work together | 00:16 |
lkcl | pytest=3.2.5 | 00:17 |
lkcl | xdist=1.13 | 00:17 |
programmerjake | uuh, I'm using pytest 7.1.2 and pytest-xdist 2.5.0 | 00:18 |
lkcl | debian/10 has 3.10, yes? | 00:18 |
programmerjake | ci is using pytest_xdist-3.3.1 and pytest-7.3.1 | 00:19 |
programmerjake | so, I'll just depend on pytest >=3,<8 | 00:20 |
lkcl | anything other than the exact versions used by the devscripts is out, jacob, you know that | 00:20 |
programmerjake | well, last I checked the devscripts didn't install pytest | 00:21 |
programmerjake | (which may have changed since then) | 00:21 |
lkcl | that's a problem that needs correcting. | 00:21 |
programmerjake | in any case, if we're publishing on pypi we should support the latest pytest as well | 00:21 |
lkcl | and intriguingly the amount of memory used is staying really low | 00:22 |
programmerjake | running with SILENCELOG? | 00:22 |
lkcl | it's not horrendous in other words. 7 GB so far | 00:22 |
lkcl | no. | 00:22 |
programmerjake | the memory used slowly accumulates since it's 99% output logs | 00:24 |
lkcl | still only 7.5 GB | 00:24 |
programmerjake | can you make the git repo while you're waiting? | 00:25 |
lkcl | oh duh :) | 00:26 |
lkcl | sorry am half-asleep :) | 00:26 |
lkcl | done | 00:27 |
lkcl | 64 utf-8 tests is where it's going slightly mental | 00:28 |
lkcl | was at 7.9 GB, it jumped to 11.9 | 00:28 |
lkcl | 12.4 Gb and i think it's on the last test (only one process @ 100%) | 00:30 |
lkcl | test_caller_fp.py::DecoderTestCase::test_fp_muls3 | 00:32 |
lkcl | taking ages | 00:33 |
lkcl | (and allocated to the same process) | 00:33 |
lkcl | all others @ 0% | 00:33 |
programmerjake | well, just think ... the speed limit is likely writing log entries to the output | 00:33 |
programmerjake | I remember it going >2x faster when SILENCELOG is enabled | 00:34 |
lkcl | only one process is left running at the moment | 00:34 |
lkcl | all others are idle | 00:34 |
lkcl | 12.6 gb | 00:35 |
lkcl | excellent. 12.6 gb using pytest=3.2.5 and xdist=1.13 | 00:35 |
programmerjake | sounds terrible, ci uses 3.6GB iirc | 00:36 |
lkcl | try it with full logs | 00:39 |
lkcl | actually, more sensibly: don't :) it's likely to risk thrashing | 00:41 |
programmerjake | ?? | 00:41 |
programmerjake | don't which? | 00:41 |
lkcl | don't run with full logs | 00:42 |
lkcl | eee getting too late. | 00:42 |
programmerjake | yes! | 00:42 |
programmerjake | SILENCELOG to the rescue | 00:42 |
programmerjake | can you set the git repo to public? | 00:49 |
*** awilfox <awilfox!~awilfox@kelsey.foxkit.us> has quit IRC | 01:16 | |
*** ghostmansd <ghostmansd!~ghostmans@broadband-109-173-83-100.ip.moscow.rt.ru> has quit IRC | 04:33 | |
*** yambo <yambo!~yambo@069-145-110-003.biz.spectrum.com> has quit IRC | 07:55 | |
*** yambo <yambo!~yambo@069-145-110-003.biz.spectrum.com> has joined #libre-soc | 08:07 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@broadband-109-173-83-100.ip.moscow.rt.ru> has quit IRC | 08:54 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.170.167> has joined #libre-soc | 08:54 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.170.167> has quit IRC | 09:25 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.57.180> has joined #libre-soc | 09:26 | |
*** octavius <octavius!~octavius@92.40.168.191.threembb.co.uk> has joined #libre-soc | 09:27 | |
lkcl | er... oh yes, forgot to do the symlink | 09:50 |
lkcl | sorted | 09:51 |
programmerjake | thx! | 09:53 |
*** alethkit <alethkit!23bd17ddc6@sourcehut/user/alethkit> has quit IRC | 11:05 | |
*** WhyNotHugo <WhyNotHugo!bc7d0f0b52@2604:bf00:561:2000::28> has quit IRC | 11:05 | |
*** alethkit <alethkit!23bd17ddc6@sourcehut/user/alethkit> has joined #libre-soc | 11:07 | |
*** WhyNotHugo <WhyNotHugo!bc7d0f0b52@2604:bf00:561:2000::28> has joined #libre-soc | 11:07 | |
programmerjake | found an interesting article for anyone trying to measure algorithm speed differences: https://www.bazhenov.me/posts/paired-benchmarking/ | 11:32 |
lkcl | ohh sigh yes quite an interesting problem | 12:46 |
*** lxo <lxo!~lxo@gateway/tor-sasl/lxo> has quit IRC | 13:16 | |
*** lxo <lxo!~lxo@gateway/tor-sasl/lxo> has joined #libre-soc | 13:31 | |
*** octavius <octavius!~octavius@92.40.168.191.threembb.co.uk> has quit IRC | 15:42 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.57.180> has quit IRC | 15:44 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@91.205.168.99> has joined #libre-soc | 15:45 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@91.205.168.99> has quit IRC | 15:49 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.166.48> has joined #libre-soc | 15:49 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.166.48> has quit IRC | 17:37 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.168.18> has joined #libre-soc | 17:38 | |
*** choozy <choozy!~choozy@75-63-174-82.ftth.glasoperator.nl> has joined #libre-soc | 18:38 | |
*** lxo <lxo!~lxo@gateway/tor-sasl/lxo> has quit IRC | 18:52 | |
*** lxo <lxo!~lxo@gateway/tor-sasl/lxo> has joined #libre-soc | 18:53 | |
*** lxo <lxo!~lxo@gateway/tor-sasl/lxo> has joined #libre-soc | 19:10 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@176.59.168.18> has quit IRC | 19:53 | |
*** ghostmansd[m] <ghostmansd[m]!~ghostmans@91.205.168.99> has joined #libre-soc | 19:54 | |
*** choozy <choozy!~choozy@75-63-174-82.ftth.glasoperator.nl> has quit IRC | 22:12 |
Generated by irclog2html.py 2.17.1 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!