After librem5 has been on a while Millipixels will hang after taking picture

@dcz
I am happy to try this out. I have downloaded the artifact, but could you please PM me some guidance on how to install this as well as the monitor.

Thank you

There’s a file in the zip archive which is called “linux-image-*.deb”.

sudo apt install ./linux-image-*.deb

Paste this into a file called log.py:

import time
open('/sys/kernel/debug/tracing/events/cma/enable', 'w').write('1\n')
while True:
    print(open('/proc/uptime').read().strip(), open('/sys/kernel/debug/cma/linux,cma/used').read().strip())
    time.sleep(1)

Then

sudo python3 ./log.py > cma.log

After some hours, the cma.log should contain the interesting info.

I find two of them, should I install both?

linux-image-6.1.0-1-librem5_6.1.13pureos1+gitlabci1_arm64.deb
linux-image-librem5_6.1.13pureos1+gitlabci1_arm64.deb

Yeah both are fine. You need the first one at least.

Ok, test is in progress. Have taken a number of photos without millipixels hanging and cma.log has started to collect data. I will report back.

For what it is worth, I have also experienced periodic hang on taking pictures. I do not know how to test.

@dcz
During some six hours of running the debug kernel and collecting data, Millipixels haven’t hung at all while taking photos.

Here is the log data, hope it helps:

407.00 868.83 8570
408.01 872.50 8570
409.01 876.24 8570
410.01 879.72 8570
411.01 883.27 8570
412.01 886.85 8570
413.01 890.45 8570
414.02 894.03 8570
415.02 897.56 8570
416.02 900.97 8570
417.02 904.56 8570
418.03 908.17 8570
419.03 911.73 8570
420.03 915.32 8570
421.03 918.85 8570
422.03 922.39 8570
423.04 925.93 8570
424.04 929.50 8570
425.04 933.08 8570
426.04 936.76 8570
427.04 940.48 8570
428.04 944.15 8570
429.05 947.79 8570
430.05 951.53 8570
431.05 955.28 8570
432.05 959.01 8570
433.06 962.46 8570
434.06 966.16 8570
435.06 969.88 8570
436.06 973.63 8570
437.06 977.37 8570
438.07 981.02 8570
439.07 984.68 8570
440.07 988.33 8570
441.07 991.81 8570
442.08 995.41 8570
443.08 998.93 8570
444.08 1002.49 8570
445.08 1006.13 8570
446.08 1009.41 8570
447.08 1011.81 8570
448.09 1014.07 8570
449.09 1016.35 8570
450.09 1018.61 8570
451.09 1020.28 8570
452.09 1022.52 8570
453.10 1024.68 8570
454.10 1027.10 8570
455.10 1029.17 8570
456.10 1031.05 8570
457.10 1033.44 8570
458.11 1035.78 8570
459.11 1038.03 8570
460.11 1040.02 8570
461.11 1042.38 8570
462.11 1044.30 8570
463.11 1045.64 8570
464.12 1047.09 8570
465.12 1048.82 8570
466.12 1050.76 8570
467.13 1052.02 8570
468.13 1053.43 8570
469.13 1055.17 8570
470.13 1057.55 8570
471.13 1060.14 8570
472.13 1062.68 8570
473.14 1066.03 8570
474.14 1069.57 8570
475.14 1073.15 8570
476.14 1075.93 8570
477.15 1078.88 8570
478.15 1082.45 8570
479.15 1086.12 8570
480.15 1089.79 8570
481.15 1093.44 8570
482.16 1097.14 8570
483.16 1100.82 8570
484.16 1104.49 8570
485.16 1108.10 8570
486.17 1111.74 8570
487.17 1115.43 8570
488.17 1119.06 8570
489.17 1122.67 8570
490.17 1126.40 8570
491.18 1130.04 8570
492.18 1133.68 8570
493.18 1137.03 8570
494.18 1140.71 8570
495.18 1144.41 8570

The python script didn’t seem to be working for me. Adding flush=True to the print statement made it work better for me. Then I could use | tee to watch what was happening. Or tail -f the log file, etc.

    print(open('/proc/uptime').read().strip(), open('/sys/kernel/debug/cma/linux,cma/used').read().strip(),flush=True)

I had to Ctrl-C out of the script, tried a couple of times, then I noticed that it had started to collect data anyway.

1 Like

My camera isn’t breaking. Is the data collected still useful? Seems there may be something in that kernel that fixed it.? Perhaps I just have not waited long enough / tried using my camera enough.

This log file looks like it collected data after 5 minutes of running (the first 2 numbers are seconds), so something went wrong. But it’s good to hear that it doesn’t hang up. There’s a patch I slipped into that kernel which might be fixing it.

So yeah, there’s still value in testing this kernel and using this script.

Do you mean it’s not breaking with the kernel that I linked to? Was it breaking before?

Yes, the log script doesn’t run properly. I had to Ctrl-C out of it and thought it didn’t work, but obviously it did something at least. I can run it again if you can look into why it doesn’t finish.

Could you describe in detail how you executed the script?

According to your instructions above:

sudo python3 ./log.py > cma.log

I placed the script in my home folder.

Edit: After a closer look at the script I realize that it is a loop that is not supposed to finish. I can keep it running, but do you really want a reading every second, or is every minute sufficient?

It depends on how often you start multiple programs in parallel. I need enough granularity to know which program caused the spike.

Unfortunately the Millipixels hangs are back. My cma.log is now 139kB, so I don’t know if you want me to paste it here?

Edit: Without a restart of the phone, I can now take pictures again. Problem is, I need to restart the phone soon as I can’t recover the latest modem crash (I believe this was improved in the kernel update before I installed the debug version).

cma.log

11790.66 41742.20 11610
11791.67 41745.84 11610
11792.68 41749.64 11610
11793.69 41753.30 11610
11794.69 41757.19 11610
11795.70 41760.63 11610
11796.71 41764.48 11610
11797.72 41768.24 11610
11798.72 41771.90 11610
11799.73 41775.50 11610
11800.74 41779.12 11610
11801.74 41782.76 11610
11802.75 41786.65 11610
11803.76 41790.44 11610
11804.77 41794.30 11610
11805.78 41797.68 11610
11806.78 41801.40 11610
11807.79 41805.14 11610
11808.80 41809.03 11610
11809.81 41812.40 11610
11810.81 41815.99 11610
11811.82 41819.71 11610
11812.83 41823.58 11610
11813.84 41827.33 11610
11814.84 41831.03 11610
11815.85 41834.73 11610
11816.86 41838.33 11610
11817.87 41842.10 11610
11818.87 41845.96 11610
11819.88 41849.67 11610
11820.89 41853.57 11610
11821.89 41857.13 11610
11822.90 41860.57 11610
11823.91 41864.34 11610
11824.92 41868.11 11610
11825.92 41871.78 11610
11826.93 41875.23 11610
11827.94 41879.04 11610
11828.95 41882.63 11610
11829.95 41886.32 11610
11830.96 41889.99 11610
11831.97 41893.55 11610
11832.98 41897.30 11610
11833.99 41900.77 11610
11834.99 41904.63 11610
11836.00 41908.40 11610
11837.01 41912.24 11610
11838.02 41915.95 11610
11839.04 41919.14 11610
11840.05 41922.89 11610
11841.06 41926.59 11610
11842.07 41930.34 11610
11843.07 41934.13 11610
11844.08 41937.15 11610
11845.09 41940.92 11610
11846.10 41944.44 11610
11847.10 41948.18 11610
11848.11 41951.90 11610
11849.12 41955.72 11610
11850.13 41959.20 11610
11851.13 41963.06 11610
11852.14 41966.81 11610
11853.15 41970.69 11610
11854.16 41974.32 11610
11855.16 41977.99 11610
11856.17 41981.39 11610
11857.18 41985.16 11610
11858.19 41988.86 11610
11859.19 41992.76 11610
11860.20 41996.53 11610
11861.21 42000.35 11610
11862.22 42003.50 11610
11863.23 42007.35 11610
11864.23 42011.08 11610
11865.24 42014.84 11610
11866.25 42018.61 11610
11867.26 42022.08 11610
11868.27 42025.85 11610
11869.27 42029.68 11610
11870.28 42033.34 11610
11871.29 42037.17 11610
11872.30 42040.61 11610
11873.31 42044.38 11610
11874.31 42048.15 11610
11875.32 42051.98 11610
11876.33 42055.74 11610
11877.34 42059.30 11610
11878.35 42062.84 11610
11879.36 42066.69 11610
11880.37 42070.43 11610
11881.37 42074.16 11610
11882.38 42077.58 11610
11883.39 42081.29 11610
11884.40 42085.08 11610
11885.41 42088.82 11610
11886.41 42092.46 11610
11887.42 42096.26 11610
11888.43 42099.70 11610
11889.44 42103.49 11610
11890.45 42107.26 11610
11891.46 42111.08 11610
11892.47 42114.81 11610
11893.47 42118.63 11610
11894.48 42122.00 11610
11895.49 42125.82 11610
11896.50 42129.60 11610
11897.50 42133.40 11610
11898.51 42137.20 11610
11899.52 42140.42 11610
11900.53 42144.16 11610
11901.53 42148.02 11610
11902.54 42151.60 11610
11903.55 42155.18 11610
11904.56 42158.79 11610
11905.56 42162.19 11610
11906.57 42165.99 11610
11907.58 42169.86 11610
11908.58 42173.58 11610
11909.59 42177.44 11610
11910.60 42180.73 11610
11911.61 42184.56 11610
11912.61 42188.25 11610
11913.62 42192.09 11610
11914.63 42195.77 11610
11915.64 42199.31 11610
11916.64 42203.09 11610
11917.65 42206.88 11610
11918.66 42210.48 11610
11919.67 42214.03 11610
11920.68 42217.81 11610
11921.68 42221.26 11610
11922.69 42225.01 11610
11923.70 42228.81 11610
11924.71 42232.65 11610
11925.72 42236.21 11610
11926.73 42239.65 11610
11927.73 42243.30 11610
11928.74 42247.16 11610
11929.75 42250.63 11610
11930.75 42254.50 11610
11931.76 42257.94 11610
11932.77 42261.83 11610
11933.78 42265.49 11610
11934.78 42269.21 11610
11935.79 42272.92 11610
11936.80 42276.77 11610
11937.81 42280.46 11610
11938.82 42284.04 11610
11939.82 42287.81 11610
11940.83 42291.62 11610
11941.84 42295.30 11610
11942.85 42298.96 11610
11943.85 42302.66 11610
11944.86 42306.18 11610
11945.87 42309.88 11610
11946.88 42313.72 11610
11947.89 42317.53 11610
11948.89 42321.42 11610
11949.91 42324.84 11610
11950.91 42328.53 11610
11951.92 42331.25 11610
11952.93 42333.84 11610
11953.95 42335.46 11610
11954.96 42338.10 11610
11955.97 42340.92 11610
11956.98 42344.42 11610
11957.98 42348.12 11610
11958.99 42351.40 11610
11960.00 42355.09 11610
11961.01 42358.97 11610
11962.01 42362.39 11610
11963.02 42366.30 11610
11964.03 42369.74 11610
11965.04 42373.55 11610
11966.04 42377.08 11610
11967.06 42380.23 11610
11968.07 42383.65 11610
11969.07 42387.48 11610
11970.08 42391.25 11610
11971.09 42393.44 11610
11972.11 42395.80 11610
11973.12 42398.42 11610
11974.13 42399.48 11610
11975.16 42401.49 11610
11976.17 42403.92 11610
11977.18 42406.65 11610
11978.19 42410.34 11610
11979.20 42414.23 11610
11980.20 42417.62 11610
11981.21 42420.37 11610
11982.22 42422.82 11610
11983.23 42426.68 11610
11984.24 42430.08 11610
11985.25 42433.58 11610
11986.26 42437.00 11610
11987.27 42440.47 11610
11988.28 42443.80 11610
11989.30 42446.13 11610
11990.31 42448.16 11610
11991.32 42451.99 11610
11992.33 42455.71 11610
11993.34 42459.11 11610
11994.34 42462.84 11610
11995.35 42466.66 11610
11996.36 42470.44 11610
11997.37 42474.19 11610
11998.38 42477.64 11610
11999.38 42481.44 11610
12000.39 42485.24 11610
12001.40 42488.68 11610
12002.41 42492.39 11610
12003.41 42496.29 11610
12004.42 42500.05 11610
12005.43 42503.63 11610
12006.44 42507.10 11610
12007.44 42510.84 11610
12008.45 42514.29 11610
12009.46 42518.16 11610
12010.47 42521.92 11610
12011.47 42525.76 11610
12012.48 42529.51 11610
12013.49 42533.34 11610
12014.49 42536.95 11610
12015.51 42540.43 11610
12016.52 42544.13 11610
12017.53 42547.95 11610
12018.53 42551.73 11610
12019.54 42555.26 11610
12020.55 42558.99 11610
12021.55 42562.45 11610
12022.56 42566.07 11610
12023.57 42569.68 11610
12024.58 42573.38 11610
12025.59 42577.16 11610
12026.60 42580.95 11610
12027.61 42584.51 11610
12028.61 42588.26 11610
12029.62 42591.96 11610
12030.63 42595.61 11610
12031.63 42599.38 11610
12032.64 42603.04 11610
12033.65 42606.57 11610
12034.66 42609.99 11610
12035.67 42612.66 11610
12036.68 42616.26 11610
12037.68 42620.10 11610
12038.69 42623.69 11610
12039.70 42626.76 11610
12040.71 42630.55 11610
12041.71 42634.34 11610
12042.72 42638.08 11610
12043.73 42641.97 11610
12044.73 42645.73 11610
12045.74 42649.06 11610
12046.75 42652.72 11610
12047.75 42656.48 11610
12048.76 42660.16 11610
12049.77 42663.77 11610
12050.78 42667.54 11610
12051.78 42671.04 11610
12052.79 42674.78 11610
12053.80 42678.54 11610
12054.80 42682.10 11610
12055.81 42685.83 11610
12056.82 42689.30 11610
12057.83 42693.10 11610
12058.83 42696.86 11610
12059.84 42700.76 11610
12060.85 42704.57 11610
12061.86 42708.03 11610
12062.86 42711.61 11610
12063.87 42715.46 11610
12064.88 42719.26 11610
12065.88 42723.03 11610
12066.89 42726.81 11610
12067.90 42730.22 11610
12068.90 42733.98 11610
12069.91 42737.78 11610
12070.92 42741.42 11610
12071.93 42745.22 11610
12072.94 42748.92 11610
12073.94 42752.46 11610
12074.95 42756.07 11610
12075.96 42759.87 11610
12076.97 42763.72 11610
12077.98 42767.48 11610
12078.98 42770.38 11610
12079.99 42774.14 11610
12081.00 42777.98 11610
12082.01 42781.74 11610
12083.02 42785.54 11610
12084.02 42788.22 11610
12085.03 42792.01 11610
12086.04 42795.63 11610
12087.05 42799.44 11610
12088.06 42803.09 11610
12089.07 42806.59 11610
12090.08 42810.16 11610
12091.08 42813.97 11610
12092.09 42817.72 11610
12093.10 42821.55 11610
12094.11 42824.86 11610
12095.12 42828.54 11610
12096.13 42832.31 11610
12097.13 42836.09 11610
12098.14 42839.75 11610
12099.15 42843.66 11610
12100.15 42847.17 11610
12101.16 42851.02 11610
12102.17 42854.52 11610
12103.18 42858.32 11610
12104.19 42861.22 11610
12105.19 42864.95 11610
12106.20 42868.69 11610
12107.21 42872.56 11610
12108.22 42876.31 11610
12109.22 42880.15 11610
12110.23 42883.69 11610
12111.24 42887.25 11610
12112.25 42891.07 11610
12113.25 42894.81 11610
12114.26 42898.57 11610
12115.27 42902.07 11610
12116.28 42905.80 11610
12117.28 42909.50 11610
12118.29 42912.95 11610
12119.30 42916.41 11610
12120.30 42920.21 11610
12121.31 42923.99 11610
12122.32 42927.77 11610
12123.33 42931.64 11610
12124.33 42935.44 11610
12125.34 42938.70 11610
12126.35 42942.28 11610
12127.36 42946.15 11610
12128.36 42949.90 11610
12129.37 42953.57 11610
12130.38 42957.35 11610
12131.39 42961.06 11610
12132.39 42964.68 11610
12133.40 42968.41 11610
12134.41 42972.00 11610
12135.42 42975.87 11610
12136.42 42979.63 11610
12137.43 42983.33 11610
12138.45 42986.84 11610
12139.45 42990.47 11610
12140.46 42994.26 11610
12141.47 42998.12 11610
12142.47 43001.73 11610
12143.48 43005.42 11610
12144.49 43008.77 11610
12145.50 43012.46 11610
12146.51 43016.17 11610
12147.52 43020.05 11610
12148.53 43023.78 11610
12149.54 43027.65 11610
12150.54 43031.08 11610
12151.55 43034.78 11610
12152.56 43038.37 11610
12153.57 43042.25 11610
12154.58 43045.98 11610
12155.58 43049.82 11610
12156.59 43053.44 11610
12157.60 43056.99 11610
12158.61 43060.51 11610
12159.62 43064.35 11610
12160.63 43068.13 11610
12161.63 43071.92 11610
12162.64 43075.69 11610
12163.65 43079.25 11610
12164.66 43083.00 11610
12165.67 43086.82 11610
12166.68 43090.44 11610
12167.69 43094.19 11610
12168.69 43097.68 11610
12169.70 43101.50 11610
12170.71 43105.31 11610
12171.72 43109.18 11610
12172.72 43112.93 11610
12173.73 43116.79 11610
12174.74 43119.96 11610
12175.75 43123.73 11610
12176.76 43127.49 11610
12177.76 43131.33 11610
12178.77 43134.36 11610
12179.78 43136.95 11610
12180.79 43138.76 11610
12181.80 43141.77 11610
12182.81 43145.35 11610
12183.82 43148.92 11610
12184.82 43152.72 11610
12185.83 43156.54 11610
12186.84 43159.21 11610
12187.85 43161.98 11610
12188.85 43165.74 11610
12189.86 43169.58 11610
12190.87 43172.99 11610
12191.88 43176.75 11610
12192.88 43180.47 11610
12193.89 43184.03 11610
12194.90 43187.62 11610
12195.91 43191.49 11610
12196.91 43195.29 11610
12197.92 43199.07 11610
12198.93 43202.43 11610
12199.94 43205.89 11610
12200.95 43209.68 11610
12201.95 43213.53 11610
12202.96 43217.27 11610
12203.97 43220.89 11610
12204.97 43224.34 11610
12205.98 43228.14 11610
12206.99 43231.71 11610
12208.00 43235.47 11610
12209.00 43239.25 11610
12210.01 43242.78 11610
12211.02 43246.58 11610
12212.03 43250.46 11610
12213.03 43254.20 11610
12214.04 43257.99 11610
12215.05 43261.69 11610
12216.06 43265.22 11610
12217.07 43268.62 11610
12218.07 43272.44 11610
12219.08 43276.25 11610
12220.09 43280.16 11610
12221.09 43283.91 11610
12222.10 43287.20 11610
12223.11 43290.91 11610
12224.12 43294.78 11610
12225.13 43298.47 11610
12226.13 43302.15 11610
12227.14 43305.58 11610
12228.15 43309.35 11610
12229.15 43313.13 11610
12230.16 43316.87 11610
12231.17 43320.63 11610
12232.18 43324.22 11610
12233.18 43327.92 11610
12234.19 43331.79 11610
12235.20 43335.40 11610
12236.21 43339.23 11610
12237.21 43342.62 11610
12238.22 43346.27 11610
12239.23 43350.01 11610
12240.24 43353.92 11610
12241.24 43357.60 11610
12242.25 43361.48 11610
12243.26 43365.25 11610
12244.27 43368.82 11610
12245.27 43372.51 11610
12246.28 43375.97 11610
12247.29 43379.75 11610
12248.30 43383.57 11610
12249.30 43387.34 11610
12250.31 43391.17 11610
12251.32 43394.61 11610
12252.33 43398.38 11610
12253.34 43402.11 11610
12254.34 43405.79 11610
12255.35 43409.63 11610
12256.36 43413.43 11610
12257.36 43417.24 11610
12258.37 43420.94 11610
12259.38 43424.30 11610
12260.39 43428.10 11610
12261.40 43431.88 11610
12262.40 43435.54 11610
12263.41 43439.27 11610
12264.42 43442.77 11610
12265.43 43446.59 11610
12266.43 43450.32 11610
12267.44 43454.22 11610
12268.45 43457.62 11610
12269.46 43461.46 11610
12270.47 43464.41 11610
12271.48 43466.63 11610
12272.49 43470.32 11610
12273.50 43474.12 11610
12274.51 43477.60 11610
12275.52 43481.45 11610
12276.53 43485.22 11610
12277.53 43489.09 11610
12278.54 43492.58 11610
12279.55 43496.37 11610
12280.56 43499.79 11610
12281.57 43503.61 11610
12282.58 43507.36 11610
12283.59 43511.15 11610
12284.60 43514.81 11610
12285.61 43518.43 11610
12286.62 43522.05 11610
12287.62 43525.90 11610
12288.63 43529.62 11610
12289.64 43533.49 11610
12290.64 43537.29 11610
12291.65 43540.84 11610
12292.66 43544.60 11610

As long as it gets to me, I’m happy. I also need another log:

sudo cat /sys/kernel/debug/tracing/trace > trace.log

I can’t paste the trace.log, it is too long.

Edit: I paste the end of it here

 millipixels-16578   [000] ..... 12903.031505: cma_alloc_busy_retry: name=linux,cma pfn=0xa9f00 page=00000000ea179fb1 count=3206 align=8
 millipixels-16578   [000] ..... 12903.031769: cma_alloc_busy_retry: name=linux,cma pfn=0xaa000 page=000000000ea0f42a count=3206 align=8
 millipixels-16578   [000] ..... 12903.032053: cma_alloc_busy_retry: name=linux,cma pfn=0xaa100 page=000000002c0375b2 count=3206 align=8
 millipixels-16578   [000] ..... 12903.032340: cma_alloc_busy_retry: name=linux,cma pfn=0xaa200 page=00000000380fad57 count=3206 align=8
 millipixels-16578   [000] ..... 12903.032599: cma_alloc_busy_retry: name=linux,cma pfn=0xaa300 page=00000000fd624ab3 count=3206 align=8
 millipixels-16578   [000] ..... 12903.032870: cma_alloc_busy_retry: name=linux,cma pfn=0xaa400 page=00000000953ca37f count=3206 align=8
 millipixels-16578   [000] ..... 12903.034793: cma_alloc_finish: name=linux,cma pfn=0xaa500 page=000000007068e2ab count=3206 align=8
 millipixels-16578   [000] ..... 12903.038646: cma_alloc_start: name=linux,cma count=3206 align=8
 millipixels-16578   [000] ..... 12903.038977: cma_alloc_busy_retry: name=linux,cma pfn=0xa2400 page=000000001608d4ee count=3206 align=8
 millipixels-16578   [000] ..... 12903.039220: cma_alloc_busy_retry: name=linux,cma pfn=0xa2500 page=000000003061f5bd count=3206 align=8
 millipixels-16578   [000] ..... 12903.039437: cma_alloc_busy_retry: name=linux,cma pfn=0xa2600 page=0000000082a2549a count=3206 align=8
 millipixels-16578   [000] ..... 12903.039658: cma_alloc_busy_retry: name=linux,cma pfn=0xa2700 page=0000000095f3f8e3 count=3206 align=8
 millipixels-16578   [000] ..... 12903.039887: cma_alloc_busy_retry: name=linux,cma pfn=0xa2800 page=0000000044407b4a count=3206 align=8
 millipixels-16578   [000] ..... 12903.041176: cma_alloc_finish: name=linux,cma pfn=0xab200 page=00000000283ed466 count=3206 align=8
 millipixels-16578   [000] ..... 12903.045239: cma_alloc_start: name=linux,cma count=3206 align=8
 millipixels-16578   [000] ..... 12903.045601: cma_alloc_busy_retry: name=linux,cma pfn=0xa2400 page=000000001608d4ee count=3206 align=8
 millipixels-16578   [000] ..... 12903.045854: cma_alloc_busy_retry: name=linux,cma pfn=0xa2500 page=000000003061f5bd count=3206 align=8
 millipixels-16578   [000] ..... 12903.046065: cma_alloc_busy_retry: name=linux,cma pfn=0xa2600 page=0000000082a2549a count=3206 align=8
 millipixels-16578   [000] ..... 12903.046284: cma_alloc_busy_retry: name=linux,cma pfn=0xa2700 page=0000000095f3f8e3 count=3206 align=8
 millipixels-16578   [000] ..... 12903.046513: cma_alloc_busy_retry: name=linux,cma pfn=0xa2800 page=0000000044407b4a count=3206 align=8
 millipixels-16578   [000] ..... 12903.047398: cma_alloc_finish: name=linux,cma pfn=0xabf00 page=000000005960839e count=3206 align=8
 millipixels-16578   [000] ..... 12903.051227: cma_alloc_start: name=linux,cma count=3206 align=8
 millipixels-16578   [000] ..... 12903.051594: cma_alloc_busy_retry: name=linux,cma pfn=0xa2400 page=000000001608d4ee count=3206 align=8
 millipixels-16578   [000] ..... 12903.051836: cma_alloc_busy_retry: name=linux,cma pfn=0xa2500 page=000000003061f5bd count=3206 align=8
 millipixels-16578   [000] ..... 12903.052054: cma_alloc_busy_retry: name=linux,cma pfn=0xa2600 page=0000000082a2549a count=3206 align=8
 millipixels-16578   [000] ..... 12903.052299: cma_alloc_busy_retry: name=linux,cma pfn=0xa2700 page=0000000095f3f8e3 count=3206 align=8
 millipixels-16578   [000] ..... 12903.052530: cma_alloc_busy_retry: name=linux,cma pfn=0xa2800 page=0000000044407b4a count=3206 align=8
 millipixels-16578   [000] ..... 12903.053283: cma_alloc_busy_retry: name=linux,cma pfn=0xacc00 page=0000000061da811d count=3206 align=8
 millipixels-16578   [000] ..... 12903.053559: cma_alloc_busy_retry: name=linux,cma pfn=0xacd00 page=00000000e007efb5 count=3206 align=8
 millipixels-16578   [000] ..... 12903.053806: cma_alloc_busy_retry: name=linux,cma pfn=0xace00 page=0000000073fe681a count=3206 align=8
 millipixels-16578   [000] ..... 12903.054022: cma_alloc_busy_retry: name=linux,cma pfn=0xacf00 page=000000006afd4b3f count=3206 align=8
 millipixels-16578   [000] ..... 12903.054317: cma_alloc_busy_retry: name=linux,cma pfn=0xad000 page=000000004e25f752 count=3206 align=8
 millipixels-16578   [000] ..... 12903.054634: cma_alloc_busy_retry: name=linux,cma pfn=0xad100 page=000000006086741e count=3206 align=8
 millipixels-16578   [000] ..... 12903.054922: cma_alloc_busy_retry: name=linux,cma pfn=0xad200 page=00000000a15c82d3 count=3206 align=8
 millipixels-16578   [000] ..... 12903.055209: cma_alloc_busy_retry: name=linux,cma pfn=0xad300 page=00000000a370eb21 count=3206 align=8
 millipixels-16578   [000] ..... 12903.055470: cma_alloc_busy_retry: name=linux,cma pfn=0xad400 page=00000000b28fd3c6 count=3206 align=8
 millipixels-16578   [000] ..... 12903.056279: cma_alloc_finish: name=linux,cma pfn=0xad500 page=0000000065fa6f7a count=3206 align=8
 millipixels-16578   [000] ..... 12903.061656: cma_alloc_start: name=linux,cma count=3206 align=8
 millipixels-16578   [000] ..... 12903.062089: cma_alloc_busy_retry: name=linux,cma pfn=0xa2400 page=000000001608d4ee count=3206 align=8
 millipixels-16578   [000] ..... 12903.062337: cma_alloc_busy_retry: name=linux,cma pfn=0xa2500 page=000000003061f5bd count=3206 align=8
 millipixels-16578   [000] ..... 12903.062551: cma_alloc_busy_retry: name=linux,cma pfn=0xa2600 page=0000000082a2549a count=3206 align=8
 millipixels-16578   [000] ..... 12903.062771: cma_alloc_busy_retry: name=linux,cma pfn=0xa2700 page=0000000095f3f8e3 count=3206 align=8
 millipixels-16578   [000] ..... 12903.063003: cma_alloc_busy_retry: name=linux,cma pfn=0xa2800 page=0000000044407b4a count=3206 align=8
 millipixels-16578   [000] ..... 12903.063502: cma_alloc_finish: name=linux,cma pfn=0xae200 page=000000001cbc0281 count=3206 align=8
 millipixels-16578   [002] ..... 12903.681728: cma_release: name=linux,cma pfn=0xae200 page=000000001cbc0281 count=3206
 millipixels-16578   [002] ..... 12903.686701: cma_release: name=linux,cma pfn=0x9af00 page=000000008a2beeeb count=3206
 millipixels-16578   [002] ..... 12903.688182: cma_release: name=linux,cma pfn=0x9c900 page=00000000d3f0383c count=3206
 millipixels-16578   [002] ..... 12903.689597: cma_release: name=linux,cma pfn=0x9d600 page=00000000da01a14c count=3206
 millipixels-16578   [002] ..... 12903.691019: cma_release: name=linux,cma pfn=0x9e300 page=00000000365b30b8 count=3206
 millipixels-16578   [002] ..... 12903.692598: cma_release: name=linux,cma pfn=0x9f000 page=000000002f3e7c31 count=3206
 millipixels-16578   [002] ..... 12903.693715: cma_release: name=linux,cma pfn=0x9fd00 page=0000000006e50bc4 count=3206
 millipixels-16578   [002] ..... 12903.695186: cma_release: name=linux,cma pfn=0xa0a00 page=000000007f0522ef count=3206
 millipixels-16578   [002] ..... 12903.696764: cma_release: name=linux,cma pfn=0xa1700 page=000000008de35401 count=3206
 millipixels-16578   [002] ..... 12903.698263: cma_release: name=linux,cma pfn=0xa3500 page=000000002d386446 count=3206
 millipixels-16578   [002] ..... 12903.699660: cma_release: name=linux,cma pfn=0xa4200 page=00000000f6a2698b count=3206
 millipixels-16578   [002] ..... 12903.701120: cma_release: name=linux,cma pfn=0xa4f00 page=00000000393a0b47 count=3206
 millipixels-16578   [002] ..... 12903.702545: cma_release: name=linux,cma pfn=0xa5c00 page=0000000068058f48 count=3206
 millipixels-16578   [002] ..... 12903.704032: cma_release: name=linux,cma pfn=0xa6900 page=00000000f1dcebf9 count=3206
 millipixels-16578   [002] ..... 12903.705718: cma_release: name=linux,cma pfn=0xa7600 page=000000001aa77ce6 count=3206
 millipixels-16578   [002] ..... 12903.707710: cma_release: name=linux,cma pfn=0xa8300 page=0000000065892562 count=3206
 millipixels-16578   [002] ..... 12903.709121: cma_release: name=linux,cma pfn=0xa9000 page=000000009a86f908 count=3206
 millipixels-16578   [002] ..... 12903.710948: cma_release: name=linux,cma pfn=0xaa500 page=000000007068e2ab count=3206
 millipixels-16578   [002] ..... 12903.712740: cma_release: name=linux,cma pfn=0xab200 page=00000000283ed466 count=3206
 millipixels-16578   [002] ..... 12903.714656: cma_release: name=linux,cma pfn=0xabf00 page=000000005960839e count=3206
 millipixels-16578   [002] ..... 12903.716649: cma_release: name=linux,cma pfn=0xad500 page=0000000065fa6f7a count=3206
 millipixels-16578   [002] ..... 12903.751616: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.752927: cma_alloc_finish: name=linux,cma pfn=0x99500 page=00000000392e9bb0 count=201 align=8
 millipixels-16578   [002] ..... 12903.753223: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.754235: cma_alloc_finish: name=linux,cma pfn=0x99600 page=00000000f54471be count=201 align=8
 millipixels-16578   [002] ..... 12903.754577: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.755703: cma_alloc_finish: name=linux,cma pfn=0x9a300 page=00000000e52c10b4 count=201 align=8
 millipixels-16578   [002] ..... 12903.756010: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.757090: cma_alloc_finish: name=linux,cma pfn=0x9a400 page=0000000034d1586d count=201 align=8
 millipixels-16578   [002] ..... 12903.757399: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.758622: cma_alloc_finish: name=linux,cma pfn=0x9a500 page=000000009f1c730f count=201 align=8
 millipixels-16578   [002] ..... 12903.759100: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.761595: cma_alloc_finish: name=linux,cma pfn=0x9a600 page=0000000002b8d40c count=201 align=8
 millipixels-16578   [002] ..... 12903.761921: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.762406: cma_alloc_finish: name=linux,cma pfn=0x9af00 page=000000008a2beeeb count=201 align=8
 millipixels-16578   [002] ..... 12903.762876: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.763115: cma_alloc_finish: name=linux,cma pfn=0x9b000 page=0000000033c0f00d count=201 align=8
 millipixels-16578   [002] ..... 12903.763563: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.763673: cma_alloc_finish: name=linux,cma pfn=0x9b100 page=00000000664c1172 count=201 align=8
 millipixels-16578   [002] ..... 12903.764063: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.764348: cma_alloc_finish: name=linux,cma pfn=0x9b200 page=000000009e030fef count=201 align=8
 millipixels-16578   [002] ..... 12903.764618: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.764769: cma_alloc_finish: name=linux,cma pfn=0x9b300 page=00000000dcb1c8d8 count=201 align=8
 millipixels-16578   [002] ..... 12903.765173: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.765407: cma_alloc_finish: name=linux,cma pfn=0x9b400 page=0000000058261679 count=201 align=8
 millipixels-16578   [002] ..... 12903.765767: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.765906: cma_alloc_finish: name=linux,cma pfn=0x9b500 page=00000000e8f8b706 count=201 align=8
 millipixels-16578   [002] ..... 12903.766258: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.766501: cma_alloc_finish: name=linux,cma pfn=0x9b600 page=0000000085e4c2c7 count=201 align=8
 millipixels-16578   [002] ..... 12903.766861: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.767016: cma_alloc_finish: name=linux,cma pfn=0x9b700 page=000000007705b4e6 count=201 align=8
 millipixels-16578   [002] ..... 12903.767372: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.767595: cma_alloc_finish: name=linux,cma pfn=0x9b800 page=00000000dc4dedeb count=201 align=8
 millipixels-16578   [002] ..... 12903.767968: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.768181: cma_alloc_finish: name=linux,cma pfn=0x9b900 page=00000000d08a6f75 count=201 align=8
 millipixels-16578   [002] ..... 12903.768557: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.769422: cma_alloc_finish: name=linux,cma pfn=0x9ba00 page=000000003b2f960f count=201 align=8
 millipixels-16578   [002] ..... 12903.769893: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.770878: cma_alloc_finish: name=linux,cma pfn=0x9bb00 page=00000000d09b264f count=201 align=8
 millipixels-16578   [002] ..... 12903.771384: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.773605: cma_alloc_finish: name=linux,cma pfn=0x9bc00 page=00000000260b2243 count=201 align=8
 millipixels-16578   [002] ..... 12903.774526: cma_alloc_start: name=linux,cma count=201 align=8
 millipixels-16578   [002] ..... 12903.776819: cma_alloc_finish: name=linux,cma pfn=0x9bd00 page=00000000cadc7288 count=201 align=8

Its not breaking with:
linux-image-6.1.0-1-librem5_6.1.13pureos1+gitlabci1_arm64.deb
and linux-image-librem5_6.1.13pureos1+gitlabci1_arm64.deb
installed.

Yes it was breaking before I installed them. Perhaps its just chance and it yet will still break.

It logged data since last night. About 50K lines. Log here:
http://adamd.sdf.org/cma.log

Just did a quick bash script to just get the changes and the largest value. Can I assume you are looking for the largest value? If so it was: 77297
http://adamd.sdf.org/cma_log_changes.txt