After librem5 has been on a while Millipixels will hang after taking picture

dcz · March 25, 2023, 1:15pm

There is no fix yet. Just a request to gather logs. But that’s in the backlogs.

Rhodez-x · March 25, 2023, 1:32pm

Affirmativ. I would like to be able to provide logs if I experience this.
But I need to know if I’m running the right version of the software and kernel.

I have made an FTrace event iterator with a couple of my friends (one of them did also just recived a L5 as myself). However I’m a little rusty there, so I need to figure out if this could be helpful in any way.
I’ll try to compile our trace event iterator and test it on the phone one of the next days.

It should be possible to both record what the kernel did, but also live debugging. But let me test it out before I say too much.
Maybe you already have smarter tools.

dcz · March 25, 2023, 1:54pm

The backlog contains the description of the versions of the kernel and the tools to capture the logs.

adamd · March 25, 2023, 6:10pm

So far this ‘test kernel’ is awesome! Camera and L5 are working great.
Not sure if its recommended to run this kernel as its intended for testing but…
I got it from here:

Look for:

I installed just these two files:

adamd@pangolin:~/ramdisk/hhh/debian/output$ ls *image*
linux-image-6.1.0-1-librem5_6.1.19pureos1+gitlabci1_arm64.deb
linux-image-librem5_6.1.19pureos1+gitlabci1_arm64.deb

using the usual apt install ./linux-image*

Rhodez-x · March 25, 2023, 6:21pm

Thanks for info.

And well. I expect that my L5 will be reinstalled/reflashed a couple of times.
Why not getting started.

tomoqv · March 26, 2023, 10:29am

I just encountered a Millipixels hang again.

cma.log:

0268.37 155312.84 10567
50273.38 155330.56 10567
50278.38 155348.88 10567
50283.39 155364.56 10567
50288.39 155379.36 10567
50293.39 155388.50 10567
50298.40 155405.50 10567
50303.40 155422.33 10567
50308.41 155440.58 10567
50313.41 155458.23 10567
50318.41 155474.88 10567
50323.42 155492.04 10567
50328.42 155508.09 10567
50333.43 155525.26 10567
50338.43 155542.64 10567
50343.43 155560.43 10567
50348.44 155578.25 10567
50353.44 155596.07 10567
50358.45 155613.94 10567
50363.45 155631.61 10567
50368.46 155649.49 10567
50373.46 155667.31 10567
50378.47 155684.47 10567
50383.47 155702.30 10567
50388.48 155720.16 10567
50393.48 155737.80 10567
50399.16 155756.97 10567
50404.17 155775.27 10567
50409.17 155793.10 10567
50414.17 155811.00 10567
50419.18 155828.87 10567
50424.18 155846.56 10567
50429.19 155864.18 10567
50434.19 155881.99 10567
50439.19 155899.20 10567
50444.20 155917.09 10567
50449.20 155935.39 10567
50454.21 155952.99 10567
50459.21 155971.28 10567
50464.21 155989.20 10567
50469.22 156007.52 10567

end of trace.log:

 millipixels-14418   [000] ..... 47029.545569: cma_alloc_busy_retry: name=linux,cma pfn=0xa0900 page=000000003d13a3f0 count=3206 align=8
 millipixels-14418   [000] ..... 47029.546517: cma_alloc_busy_retry: name=linux,cma pfn=0xa0a00 page=00000000be6f0000 count=3206 align=8
 millipixels-14418   [000] ..... 47029.547362: cma_alloc_busy_retry: name=linux,cma pfn=0xa0b00 page=00000000ba2dd7aa count=3206 align=8
 millipixels-14418   [000] ..... 47029.548204: cma_alloc_busy_retry: name=linux,cma pfn=0xa0c00 page=000000007379ee8e count=3206 align=8
 millipixels-14418   [000] ..... 47029.548703: cma_alloc_busy_retry: name=linux,cma pfn=0xa0d00 page=0000000028e22433 count=3206 align=8
 millipixels-14418   [000] ..... 47029.549214: cma_alloc_busy_retry: name=linux,cma pfn=0xa0e00 page=000000004a0d8c5d count=3206 align=8
 millipixels-14418   [000] ..... 47029.549712: cma_alloc_busy_retry: name=linux,cma pfn=0xa0f00 page=00000000bb6a5b6a count=3206 align=8
 millipixels-14418   [000] ..... 47029.550147: cma_alloc_busy_retry: name=linux,cma pfn=0xa1000 page=00000000d19b8496 count=3206 align=8
 millipixels-14418   [000] ..... 47029.550615: cma_alloc_busy_retry: name=linux,cma pfn=0xa1100 page=00000000ccf6fa48 count=3206 align=8
 millipixels-14418   [000] ..... 47029.551430: cma_alloc_busy_retry: name=linux,cma pfn=0xa1200 page=00000000d7df75b2 count=3206 align=8
 millipixels-14418   [000] ..... 47029.552104: cma_alloc_busy_retry: name=linux,cma pfn=0xa1300 page=000000003daa8062 count=3206 align=8
 millipixels-14418   [000] ..... 47029.552735: cma_alloc_busy_retry: name=linux,cma pfn=0xa1400 page=000000001ac0cb1d count=3206 align=8
 millipixels-14418   [000] ..... 47029.553123: cma_alloc_busy_retry: name=linux,cma pfn=0xa1500 page=000000002ae2777c count=3206 align=8
 millipixels-14418   [000] ..... 47029.553409: cma_alloc_busy_retry: name=linux,cma pfn=0xa1600 page=0000000031079525 count=3206 align=8
 millipixels-14418   [000] ..... 47029.553707: cma_alloc_busy_retry: name=linux,cma pfn=0xa1700 page=000000002d478a32 count=3206 align=8
 millipixels-14418   [000] ..... 47029.553990: cma_alloc_busy_retry: name=linux,cma pfn=0xa1800 page=000000000182b1eb count=3206 align=8
 millipixels-14418   [000] ..... 47029.554285: cma_alloc_busy_retry: name=linux,cma pfn=0xa1900 page=00000000f1db891b count=3206 align=8
 millipixels-14418   [000] ..... 47029.554595: cma_alloc_busy_retry: name=linux,cma pfn=0xa1a00 page=00000000f92a4437 count=3206 align=8
 millipixels-14418   [000] ..... 47029.554889: cma_alloc_busy_retry: name=linux,cma pfn=0xa1b00 page=000000005e09d879 count=3206 align=8
 millipixels-14418   [000] ..... 47029.555547: cma_alloc_busy_retry: name=linux,cma pfn=0xa1c00 page=00000000edbe1db9 count=3206 align=8
 millipixels-14418   [000] ..... 47029.556231: cma_alloc_busy_retry: name=linux,cma pfn=0xa1d00 page=00000000a63dda0f count=3206 align=8
 millipixels-14418   [000] ..... 47029.556937: cma_alloc_busy_retry: name=linux,cma pfn=0xa1e00 page=000000003256f562 count=3206 align=8
 millipixels-14418   [000] ..... 47029.557631: cma_alloc_busy_retry: name=linux,cma pfn=0xa1f00 page=0000000062adec46 count=3206 align=8
 millipixels-14418   [000] ..... 47029.558325: cma_alloc_busy_retry: name=linux,cma pfn=0xa2000 page=00000000fdaa3ead count=3206 align=8
 millipixels-14418   [000] ..... 47029.559137: cma_alloc_busy_retry: name=linux,cma pfn=0xa2100 page=0000000017a14047 count=3206 align=8
 millipixels-14418   [000] ..... 47029.559778: cma_alloc_busy_retry: name=linux,cma pfn=0xa2200 page=000000008e349c08 count=3206 align=8
 millipixels-14418   [000] ..... 47029.560174: cma_alloc_busy_retry: name=linux,cma pfn=0xa2300 page=00000000a99c2aec count=3206 align=8
 millipixels-14418   [000] ..... 47029.560580: cma_alloc_busy_retry: name=linux,cma pfn=0xa2400 page=00000000f29d0355 count=3206 align=8
 millipixels-14418   [000] ..... 47029.560957: cma_alloc_busy_retry: name=linux,cma pfn=0xa2500 page=000000008a9f7246 count=3206 align=8
 millipixels-14418   [000] ..... 47029.561302: cma_alloc_busy_retry: name=linux,cma pfn=0xa2600 page=00000000b0fa55f4 count=3206 align=8
 millipixels-14418   [000] ..... 47029.561754: cma_alloc_busy_retry: name=linux,cma pfn=0xa2700 page=0000000043f683e2 count=3206 align=8
 millipixels-14418   [000] ..... 47029.562481: cma_alloc_busy_retry: name=linux,cma pfn=0xa2800 page=000000002917f7b9 count=3206 align=8
 millipixels-14418   [000] ..... 47029.563207: cma_alloc_busy_retry: name=linux,cma pfn=0xa2900 page=0000000027854c7e count=3206 align=8
 millipixels-14418   [000] ..... 47029.563535: cma_alloc_busy_retry: name=linux,cma pfn=0xa2a00 page=000000004a18c93a count=3206 align=8
 millipixels-14418   [000] ..... 47029.563826: cma_alloc_busy_retry: name=linux,cma pfn=0xa2b00 page=00000000682d9031 count=3206 align=8
 millipixels-14418   [000] ..... 47029.564042: cma_alloc_busy_retry: name=linux,cma pfn=0xa2c00 page=0000000046b70027 count=3206 align=8
 millipixels-14418   [000] ..... 47029.564260: cma_alloc_busy_retry: name=linux,cma pfn=0xa2d00 page=00000000eeaf3a14 count=3206 align=8
 millipixels-14418   [000] ..... 47029.564469: cma_alloc_busy_retry: name=linux,cma pfn=0xa2e00 page=0000000080193ba2 count=3206 align=8
 millipixels-14418   [000] ..... 47029.564685: cma_alloc_busy_retry: name=linux,cma pfn=0xa2f00 page=00000000e0c868f9 count=3206 align=8
 millipixels-14418   [000] ..... 47029.564890: cma_alloc_busy_retry: name=linux,cma pfn=0xa3000 page=00000000a17a849a count=3206 align=8
 millipixels-14418   [000] ..... 47029.565108: cma_alloc_busy_retry: name=linux,cma pfn=0xa3100 page=00000000a8de286b count=3206 align=8
 millipixels-14418   [000] ..... 47029.565341: cma_alloc_busy_retry: name=linux,cma pfn=0xa3200 page=000000004de34527 count=3206 align=8
 millipixels-14418   [000] ..... 47029.565571: cma_alloc_busy_retry: name=linux,cma pfn=0xa3300 page=00000000721cd36e count=3206 align=8
 millipixels-14418   [000] ..... 47029.566183: cma_alloc_busy_retry: name=linux,cma pfn=0xa3400 page=0000000088f7db8f count=3206 align=8
 millipixels-14418   [000] ..... 47029.566827: cma_alloc_busy_retry: name=linux,cma pfn=0xa9f00 page=0000000048a489cb count=3206 align=8
 millipixels-14418   [000] ..... 47029.567359: cma_alloc_busy_retry: name=linux,cma pfn=0xaa000 page=00000000d065c50a count=3206 align=8
 millipixels-14418   [000] ..... 47029.567906: cma_alloc_busy_retry: name=linux,cma pfn=0xaa100 page=000000008eb5c8eb count=3206 align=8
 millipixels-14418   [000] ..... 47029.568439: cma_alloc_busy_retry: name=linux,cma pfn=0xaa200 page=000000003866b3b4 count=3206 align=8
 millipixels-14418   [000] ....

adamd · March 26, 2023, 11:13am

Millipixels has hung again. I was reading @tomoqv post about his hanging so I opened the camera and sure enough. Mine hung trying to get a picture.
Logs:
http://adamd.sdf.org/logs.tgz

dcz · March 26, 2023, 2:44pm

I won’t take a look for a couple days, but much thanks.

dcz · March 31, 2023, 1:13pm

I described my findings: https://source.puri.sm/Librem5/linux/-/merge_requests/671#note_234012

But I still don’t know what’s going on. Maybe someone could try this log-capturing procedure:

Close as many programs as possible
Start the loggers
Note what remained open as the logging started, and whether the screen was locked/off
Use the phone
When encountering a Millipixels hang, close Millipixels and try to take a photo again
Close as many applications as possible, including Millipixels
Take logs
Note what was open and whether the screen was locked/off

tomoqv · April 1, 2023, 4:59pm

This is really odd. I will give the logging a shot again as soon as I have the time. I am certain that you will find the culprit eventually.

Thanks

mathemagician · April 28, 2023, 5:52pm

Not sure if this will be helpful, but I wanted to offer that this is also a problem I’ve observed with the following millipixels and kernel versions:

millipixels/byzantium,now 0.21.0-1pureos1 arm64
kernel 6.2.0-1

Like the others have noted, I can take pictures and have them save within a few seconds following a reboot, but after sustained use (browser, Geary open, 4g+wifi), Millipixels hangs after taking the picture.

adamd · July 26, 2023, 12:23am

This is still an issue for me. Its been a long time. Does anyone know of any efforts / news / bug reports for this issue I can follow?

dos · July 26, 2023, 12:37am

This has been fixed some time ago already and I never seen it happening again since. Millipixels 0.22 is in byzantium since mid-May.

adamd · July 26, 2023, 12:50am

Interesting. I think I am fully updated and it still happens to me. I’ll have to look into that. Thanks for letting me know.

adamd · July 26, 2023, 1:00am

I was running a manually installed version located at /usr/local/bin/millipixels. I removed it, reinstalled millipixels with apt.
So far its WAY faster then before. Render time is a fraction of what it was. The preview seems faster but can’t confirm. The images seem more color correct also. Lots of good stuff has happened for sure. Thanks all for your hard work!