2024-08-19.log

minutejosch: eek yeah, sorry that this caused such issues, will merge00:00
minutejosch: i don't have an imx8mp pocket at home but can probably test tomorrow @ work00:01
joschminute: the only issue which affects my stuff is the one with qcacld. I think that patch should not affect the functionality on the real device, so thank you!00:02
joschminute: the pocket stuff is nothing urgent from my end -- obviously, because i have no pocket :)00:03
joschah i see you already merged the former, thank you!00:04
minutenp!00:05
- NanoCodeBug (QUIT: ) (~nano@c-73-35-191-67.hsd1.wa.comcast.net)00:12
+ NanoCodeBug (~nano@c-73-35-191-67.hsd1.wa.comcast.net)01:46
- mjw (QUIT: Ping timeout: 252 seconds) (~mjw@gnu.wildebeest.org)02:01
+ midfavila (midfavila@sdf.org)02:17
midfavilai dont suppose the reddit user "NanoCupid" is in here? i'm curious as to their escapades with the pocket reform and the milk-v mars CM402:19
noamrandom interjection: the Reform is great.02:27
midfavilaall hail the reform02:29
- arminweigl (QUIT: Ping timeout: 272 seconds) (~arminweig@sourcehut/user/arminweigl)02:32
+ arminweigl (~arminweig@sourcehut/user/arminweigl)02:38
- arminweigl (QUIT: Ping timeout: 244 seconds) (~arminweig@sourcehut/user/arminweigl)02:43
+ arminweigl (~arminweig@sourcehut/user/arminweigl)03:03
- arminweigl (QUIT: Ping timeout: 252 seconds) (~arminweig@sourcehut/user/arminweigl)03:10
+ arminweigl_ (~arminweig@sourcehut/user/arminweigl)03:11
* arminweigl_ -> arminweigl03:11
- arminweigl (QUIT: Ping timeout: 248 seconds) (~arminweig@sourcehut/user/arminweigl)03:16
+ arminweigl_ (~arminweig@sourcehut/user/arminweigl)03:16
* arminweigl_ -> arminweigl03:16
- nsc (QUIT: Ping timeout: 258 seconds) (~nicolas@17-97-142-46.pool.kielnet.net)03:23
- cobra (QUIT: Ping timeout: 276 seconds) (~cobra@user/Cobra)03:23
+ nsc (~nicolas@62-96-142-46.pool.kielnet.net)03:24
joschmidfavila: there is a reform community on reddit?06:24
joschminute: are you using extlinux.conf (u-boot-menu) on the pocket reform with imx8mp?08:11
joschminute: how does your extlinux.conf look like?08:11
josch(i'm again diving into "can we get rid of flash-kernel" land)08:11
minutejosch: for debugging/testing i do, yes09:29
minutei can send you an example in a few hours09:30
joschminute: did you auto-generate it or manually craft it?09:32
+ cobra (~cobra@user/Cobra)09:32
joschwe also talked about support for extlinux.conf on the imx8mq a few days ago and this patch might let reform-display-config do the right things even for u-boot-menu: https://source.mnt.re/reform/reform-tools/-/merge_requests/81/diffs?commit_id=9fd11409ced141f55111d1cccca6cd4a454f1a7e09:34
josch(testers welcome)09:34
joschminute: can this be rebased and merged? https://source.mnt.re/reform/reform-debian-packages/-/merge_requests/5209:58
- NanoCodeBug (QUIT: ) (~nano@c-73-35-191-67.hsd1.wa.comcast.net)10:09
minutejosch: i am manually writing my extlinux confs10:10
minutejosch: yes, !52 can be merged, there will likely be additional fixes but those can be merged at a later time after more testing etc10:11
minutejosch: also cool @ reform-display-config10:14
joschminute: ah okay, then no need to upload your extlinux.conf -- i'm interested in generating it automatically :)10:15
joschminute: thank you, then i'll rebase and merge10:16
josch(this makes things easier because reform-tools has support for the pocket with rk3588 and without the dtb in the repo i have to write exceptions everywhere)10:16
joschalso, the error 500 that were quite frequent until recently seem to be magically gone o010:17
minutei think that wasn't magic but i rebooted the server a week ago or so :D 10:18
minutei think the server needs more ram10:18
joschhuh rebooting fixed it -- it's like windows now! :D10:19
henesyjosch: imx8mq module?10:28
joschhenesy: yes, if you have one, do you want to help? :)10:28
henesyhow do i check?10:29
joschhenesy: cat /proc/device-tree/model10:29
henesyMNT Reform 210:30
joschthat's the imx8mq! :D10:30
henesyhuzzah10:30
henesyhow to place into suspend?10:30
joschi have a couple of things i need victims... errr... testers for -- how comfortable do you feel with trying out things and fixing them up later in case things go wrong?10:31
joschhenesy: systemctl suspend10:31
henesygenerally alright10:31
henesythen i just hit the big circle and wake?10:31
joschyes, circle and then space to wake10:31
henesyhm that did not work10:36
henesywent to sleep but did not wake up10:36
joschhenesy: there is a bit of a hit-and-miss involved10:36
henesywaking up lpc 0% then 'no response from lpc'10:36
henesyand it just sat10:36
joschhenesy: suspend/wake never worked for my reform but it worked great for others10:36
henesytried 3-4 times10:36
henesyweird10:37
chjosch: at $work we have a reboot cronjob for the gitlab runners, because their performance degrades over time 10:57
+ mjw (~mjw@gnu.wildebeest.org)10:58
joschch: oh wow for real? o011:00
chits all a bit meh11:03
joschch: when are you getting your pocket btw?11:03
joschi need to know when i can start pestering you as well :)11:03
chi'm closely following your uboot quests :)11:03
- jacobk (QUIT: Ping timeout: 260 seconds) (~quassel@47-186-105-237.dlls.tx.frontiernet.net)11:04
chmy pocket is in the post-crowdfunding order batch, so probably some time out11:04
+ jacobk (~quassel@47-186-105-237.dlls.tx.frontiernet.net)11:04
henesyjosch: what are your inquiries regarding the pocket? mine is due to arrive soon i believe11:29
joschhenesy: i do not have a pocket reform, so if you know how to un-brick your system, i'm always looking for testers (right now, that would be the new u-boot binary)11:31
minutejosch: looking at MRs now, should i merge this? https://source.mnt.re/reform/reform-debian-packages/-/merge_requests/4212:04
joschminute: if you want to try this out, you could enable both runners for https://source.mnt.re/josch/reform-debian-packages12:08
josch*if you want me to try this out12:08
joschoh sorry, that MR was not marked as draft12:08
joschit should be draft because it's untested and only written from the docs12:08
minuteah12:08
minuteIIRC cross building is often broken, right?12:08
joschyes, if you build against unstable12:09
minutejosch: could/should we merge this? then i could test pocket rk3588 and next rk3588 images https://source.mnt.re/reform/reform-system-image/-/merge_requests/10512:09
joschminute: let me rebase that again to make sure that everything is in place now that you merged the pocket reform rk3588 patch12:10
joschi think that one was mainly a draft because the dtb was missing from the kernel12:11
minutejosch: ok sure!12:11
joschoh i think there was a problem with the u-boot flash.bin12:11
joschand the git tag will only be bumped in my next reform-tools release12:11
joschwhich i'm working on right now12:12
joschi can release immediately if needed12:12
minutesounds good!12:19
joschminute: if you are currently cleaning up git stuff, maybe slap a git tag to the reform-handbook and pocket-reform-handbook git?12:19
minutejosch: can do!12:22
minutejosch: tagged both12:27
joschthank you!12:28
- mjw (QUIT: Ping timeout: 252 seconds) (~mjw@gnu.wildebeest.org)12:38
* Guest5342 -> mjw12:53
- gsora (QUIT: Ping timeout: 245 seconds) (~gsora@user/gsora)14:07
+ gsora (~gsora@user/gsora)14:15
+ NanoCodeBug (~nano@c-73-35-191-67.hsd1.wa.comcast.net)16:29
joschcan somebody, who is not using their reform as their main machine (i have some long running jobs here that i'd hate to interrupt) confirm that the latest system images are unbootable? 16:44
joschif you have time, please test the artifacts produced by this job: https://source.mnt.re/reform/reform-system-image/-/jobs/552316:45
NanoCodeBugjosch: once its finished i can try it on a pocket-reform imx8mp17:00
+ bkeys (~Thunderbi@45.134.140.153)17:03
+ andypiper (~andypiper@89.36.117.58)17:35
joschNanoCodeBug: it is done! :D17:40
NanoCodeBugjosh: i saw! i have it downloading now17:41
joschthank you -- qemu tells me that they do not work17:41
midfavilajosch no but i saw someone mention the JH7110 mars som in relation to the pocket reform on there17:46
midfavilasearch engine brought me there17:46
NanoCodeBugit looks like a neat risc-v som, would be cool to swap one in once risc-v advances a bit more17:48
minuteoh this seems very useful for pocket https://ix.sinbon.eu/product/ix-type-a-to-rj45-jack/?attribute_length=0.1m17:50
minuteanyone else interested?17:50
josch16 EUR sounds actually reasonable17:50
minuteyeah, it's the first company i see that makes ok priced ix cables17:50
NanoCodeBugah! the other socket type, thats a lot cheaper than crowdsupply 17:50
joschthe others seem to be made out of gold...17:51
minuteyeah17:51
minuteand you can use existing rj45 cables then17:51
chACTION interested17:51
minutecool17:51
minutei'll order 10 now and we'll put them in the shop17:51
joschpotentially even for the reform next, no?17:52
NanoCodeBugjosch: it does not boot, i can upload the serial logs somewhere if that helps17:56
jfredvery interested in those cables myself too (though I wonder if shipping will be worth it with me being in the US...)17:56
jfredmale ix to female rj45 is hard to come by though and I was looking for something like that17:56
joschNanoCodeBug: that would be great, thank you!17:57
NanoCodeBugjosch: https://pastebin.com/f90ufwPY - i flashed the image to an sd-card - previously the system booted from the same sd-card on an earlier image - and before that it was configured to boot to an nvme. 18:01
joschNanoCodeBug: okay, so no further output after "Starting kernel ..." i guess?18:03
NanoCodeBugon-screen it falls into initramfs, i think the 2nd half of the log is it falling back to the internal emmc18:04
NanoCodeBugand trying to boot the nvme drive that doesn't exist18:04
joschminute: currently the system images seem to be broken. I'll investigate. Testing the system images with qemu would've helped spotting this early but unfortunately the current arm64 CI runner does not support kvm, so qemu emulation will be veeeeeeery sloooow. Maybe something to think about is a gitlab CI runner that runs on the bare CPU without a container around it like it is set up on the intel box. I 18:04
joschthink at some point you had a CI runner on rk3588.18:04
joschNanoCodeBug: does it by any chance create output like this:18:05
joschNanoCodeBug: https://paste.debian.net/1326906/18:05
joschmost importantly is this message: realpath: /dev/disk/by-label/reformsdroot: No such file or directory18:06
NanoCodeBugjosch: that's identical to what i see on-screen18:07
joschperfect thank you!18:07
joschthis means that this problem would've indeed also been caught by qemu18:08
andypiperha i just spent ~£30 to get an ix adapter18:11
andypiperneed to be more patient18:11
andypiperin other news my A311D module arrived so I can think about moving to that in the Pocket, or CM418:11
minutejosch: yes, this research was part of my decision to keep ix industrial around for the next... fitting in full size ethernet would require some pretty brutal design changes18:12
minuteso we will just bundle that adapter18:12
minutejosch: ok, we can soonish deploy a rk3588 runner in a reform motherboard case etc etc... probably in a month18:13
joschyes, no rush, just something to keep in mind -- it would help spot issues like this early18:13
joschnow i know what to do with my evening... sigh...18:14
minutejosch: ok so is it broken on more than 1 platform?18:15
minutei can try on a311d pocket now and on rk3588 reform and on imx8mq reform18:15
joschminute: it's broken on qemu and imx8mp pocket -- i'm not sure whether testing it on more platforms will yield anything useful18:16
[tj]" SINBON will advise the relevant payment method on placement of order "18:16
minutejosch: ok, i will test on imx8mq18:17
joschminute: if you want to test anything, then maybe the imx8mplus u-boot MR? :)18:17
joschoh imx8mq is also interesting18:17
minuteok imx8mplus uboot is much harder to test though :D18:17
joschyuuup :/18:17
joschandypiper already tried without success18:17
joschso it needs somebody to investigate what goes wrong18:18
joschandypiper wasn't able to collect anything on uart18:18
minuteok, but it sounds like the kernel is booting (for NanoCodeBug), but there's trouble after that in initramfs?18:18
joschyes18:19
minutethere won't be interesting stuff on uart without kernel args tweaking i think18:19
joschin the initramfs shell, i am missing the disk in /dev18:19
joschat least in qemu18:19
minutesounds like a driver issue?18:19
minutei.e. no driver for the qemu disk18:19
joschif it's a driver issue, why does it show up in qemu as well?18:19
minutewhat kind of disk device does qemu emulate?18:20
joschand if it's a qemu driver issue, why is the same message printed on imx8mplus pocket?18:20
joschit's attached via virtfs18:20
joschso it should be /dev/vda18:20
chthat sounds more like userspace being unhappy18:21
minutejosch: is there a driver for virtfs baked into the kernel?18:21
minuteok, on imx8mq i also get a black screen after uboot works fine18:21
joschoh you are testing it right now, thank you :)18:22
joschafter you adjusted the console=... to point to serial instead of tty, you should see this message as the first error:18:23
joschrealpath: /dev/disk/by-label/reformsdroot: No such file or directory18:23
minuteok, i will flash the imx8mp image and test with my testing pocket reform18:23
minuteoh18:23
+ mrbcmorris (~mrbcmorri@user/mrbcmorris)18:23
mrbcmorrisHey folks, I heard that pocket reform hits the shop.mntre.com with a new default config this week.  Any updates there?  I was about to order last week but decided to hold for info!18:24
minutenow if i could just find a microsd card...18:25
minutemrbcmorris: here are some infos in this thread https://mastodon.social/@mntmn/11297739908057557618:25
minuteok, found one18:26
mrbcmorrisThanks minute!  Travelling late september so was eyeing the pocket as a travel buddy.18:27
- andypiper (QUIT: Quit: My device has gone to sleep. Zzzz…) (~andypiper@89.36.117.58)18:27
chbtw whats a good usb sdcard reader/writer? i seem to have lost all that i ever had18:28
chjosch: how do you go about starting qemu with the .img?18:28
joschch: see emulate.sh in reform-system-image git18:29
joschminute: the other thing we are bitten by is the artifact removal. The last probably working system images from 5 days ago were removed 2 days ago...18:38
joschi'm now trying to build a new image with the reform-debian-packages repo from yesterday -- there were quite a few changes since then, maybe one of those broke things18:42
- mesaoptimizer (QUIT: Quit: nyaa~) (~mesaoptim@user/PapuaHardyNet)18:43
+ mesaoptimizer (~mesaoptim@user/PapuaHardyNet)18:43
NanoCodeBugis there any knowledge of what the rk3588 power consumption is relative to the a311d or imx8mp?18:54
chjosch: dont tell me kmod is the problem18:54
NanoCodeBugi have a rk3588 module on order - just wondering if it will live in the big reform or the little reform.18:54
joschch: i am not -- it could be a lot of things18:55
joschch: a lot changed in our kernel since the last time it worked, so this might not be a problem with Debian unstable at all but with our stuff18:56
joschNanoCodeBug: porque no los dos?! :D18:56
chjosch: the initramfs is missing a lot of kernel modules18:56
chhttps://paste.debian.net/1326912/18:57
chthat cant be enoug18:57
chh18:57
joschch: indeed... old kernel from a week ago has the same issues...18:57
joschso this might be a new bug in Debian unstable...18:57
chdont you like the 'rolling release' m(18:58
NanoCodeBugjosh: if only i could! XD. i would like to optimize the pocket for battery life, then performance. 18:58
joschch: you can also see it like this: if nobody is running unstable, then nobody tests the new stuff :)18:58
chjust wondering now why my amd64 images from today work18:59
ch /usr/lib/dracut/dracut-install: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_519:00
chin your build logs19:00
chso thats certainly broken19:00
chinitramfs-tools should abort when dracut-install crashes like this. my sid aarch64 vm with dracut 'properly' aborts19:01
joschch: thank you for finding this19:04
ch#107902219:04
joschon the plus side, this can just be another easy smoke test in the image building script19:04
chyes19:04
joschmaking sure that a few known modules are in the initramfs is not hard19:04
chor boot qemu and see if that comes up?19:04
chor both19:05
chso many things can go wrong in initramfs, checking that statically is a lot19:05
joschch: booting up qemu is not easy on a gitlab CI runner without kvm19:07
mrbcmorrisnot sure the intersection here between docker and what's being attempted but qemu is pretty easy from a docker perspective in CI19:07
chits easy if you have kvm accel19:08
joschmrbcmorris: easy yes, but very slow without kvm19:08
chotherwise very meh19:08
mrbcmorrisgotcha, sorry-- i'm a bit higher level with my exp, but trying to learn lower.19:08
joschminute: maybe you want to shoot off a message on fedi warning about Debian bug #1079022 and/or #1079031 which will likely make a MNT Reform running unstable unbootable because all modules will be missing from the initramfs19:09
joschthere will of course be apt-listbugs output as well for anybody who attempts to upgrade19:10
minutejosch: aaaa19:10
minutei am in a meeting r/n19:10
joscherrr... i guess blame ch for not having found the reason earlier :D19:11
chhttps://github.com/grml/grml-debootstrap/actions/runs/10457709398/job/28957985085 at least amd4 is broken in the same way19:11
chhttps://per.namespace.at/~ch/screenshot.jpg19:12
joschch: i feel your joy :)19:13
joschch: thank you for finding the bug numbers -- now i can do other things tonight :)19:13
joschi'm going to use snapshot.d.o until this is fixed...19:13
chits in the backlog of d-devel, otherwise i wouldn't have guessed that19:13
chfor grml-debootstrap we excluded building unstable because it was broken too often. but maybe it's worth having a separate 'unstable qa only' pipeline just to check on the state of unstable/amd64 daily :>19:14
chjosch: last thought before i go to where i already should be: even if qemu without kvm accel is painfully slow, and say it takes an hour for a simple test, it might still be worth it19:29
chjosch: at least you'll know userland is okish, kernel is okish19:30
joschch: but i'm running this pipeline very often19:30
chhmm19:30
joschso maybe this is something that should be added selectively only for "main"19:30
chmaybe for the nightly pipeline then?19:30
chor for main only, yes19:30
- NanoCodeBug (QUIT: ) (~nano@c-73-35-191-67.hsd1.wa.comcast.net)19:32
joschah even better, gitlab has jobs that can be triggered manually, and i'd like to run this kind of expensive test sometimes on my feature branches but certainly not always19:40
joschand i think there is something you can add to the yaml such that you have to click a thing in the web thing19:41
+ mark_ (~mjw@gnu.wildebeest.org)19:56
* mjw -> Guest313920:02
- Guest3139 (QUIT: Killed (osmium.libera.chat (Nickname regained by services))) (~mjw@2001:1c06:2488:1400:4fd:39a7:74ac:7bae)20:02
* mark_ -> mjw20:02
+ gustav28 (~gustav@c-1f51205c.019-141-67626730.bbcust.telenor.se)20:02
+ Guest3139 (~mjw@2001:1c06:2488:1400:4fd:39a7:74ac:7bae)20:03
- jacobk (QUIT: Ping timeout: 276 seconds) (~quassel@47-186-105-237.dlls.tx.frontiernet.net)20:18
mrbcmorrisjosch: yeah the when: manual flag helps here.20:31
joschah that was it!21:00
joschmrbcmorris: thank you :)21:00
minutejosch: i've been out of touch for the last 2 hours, any news on what's breaking the images?21:11
minuteotherwise i could go in and debug a bit with imx8mp21:11
joschminute: ch found the bug in Debian unstable, it's this one: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=107902221:15
+ ueli (~ueli@bbcs-121-132.pub.wingo.ch)21:16
minutejosch: oh thank you! looks like it's _almost_ fixed/worked around?21:33
joschminute: not quite. There is disagreement over how this should be fixed: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=107903821:44
joschor rather, what a "fix" is and what is just a "workaround" which the release team does not like21:44
minutemeh :D but will they do a downgrade temporarily or no?21:49
minuteah, that's part of the discussion21:49
mrbcmorrisHey minute I just saw the pocket reform update!  Congrats on getting them all shipped!  Is the best way to order the new configuraiton through the update on Crowd Supply or should I wait for the udpate to the shop.mntre.com?22:05
- gustav28 (QUIT: Quit: Quit) (~gustav@c-1f51205c.019-141-67626730.bbcust.telenor.se)22:15
minutemrbcmorris: where are you in the world? inside or outside EU?22:25
mrbcmorrisKentucky, USA22:25
- ueli (QUIT: Quit: Leaving) (~ueli@bbcs-121-132.pub.wingo.ch)22:27
minutemrbcmorris: crowd supply is probably a good idea then. you can order the recommended wifi card from asiaRF directly (faster than the built-in one of bpi cm4): https://asiarf.com/product/m27612-bu3-wi-fi-m-2-b-key-module-2242-2230-mt7612u-11ac-2x2-867-mbps/22:39
mrbcmorrisAwesome thanks minute.  I'm excited to get my hands on one of these devices22:51
mrbcmorrisWhats the main rationale for the separate wifi card from the onboard RTW88?  Just better speed/performance?22:57
mrbcmorrisI need to dig into schematics and understand the cost of tying up an m2 port with a wifi card22:58
minutemrbcmorris: that m.2 slot has only usb signals, mainly designed in for WWAN card (broadband)23:00
minutemrbcmorris: the rtl8822cs on the bpi cm4 can only achieve 20-30mbit/s with current drivers and has connection stalls sometimes23:00
mrbcmorristhanks for letting me pester you today with questions.  I hope I can give back to the community somehow in the future as a repayment23:04
- mjw (QUIT: Ping timeout: 248 seconds) (~mjw@gnu.wildebeest.org)23:32
+ NanoCodeBug (~NanoCodeB@c-73-35-191-67.hsd1.wa.comcast.net)23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!