You can make a difference in the Apple Support Community!

When you sign up with your Apple Account, you can provide valuable feedback to other community members by upvoting helpful replies and User Tips.

External Hard-Drive shows near-constant activity

I have an OWC ThunderBay 4 Mini external drive (4x4TB Samsung SSDs in RAID 10) connected to my 2023 MacMini with 10 Cores. I have been seeing this drive with near-constant activity. I use this drive for "Media," including FinalCutPro projects and video, and a very large (40,000+ photos, 500GB+) Photos library, with "iCloud Photos" and "Download Originals to this Mac."


"Activity Monitor," shows that "photoanalysisd" is occupying 85-95% of a CPU, with a total of 97GB+ Read and 300MB+ Written. It has been in this mode for more than 12 hours, but I have not added a significant number of new photos. I do not see much network traffic (40KB/sec upload and 4 KB/sec download).


Is this normal?

Rebooting does not seem to change this behavior.


Also, I have marked this drive as "Prevent Spotlight from searching these locations," although I suspect that this does not matter.


*sigh*


-- Phil


Mac mini, macOS 14.6

Posted on Oct 12, 2024 3:08 PM

Reply
Question marked as Top-ranking reply

Posted on Oct 13, 2024 3:41 AM

It takes days-weeks for Photos to index such largish library (it does it when the Mac has been idling for a few minutes). I recently disabled sleep in my Mac and let it run all day and night (the display went off after 1-5 minutes idling) and it took a week for my similar library until photos had indexed it.


Make sure to store Photos library on APFS or MacOS Extended (GUID) case insensitive volume. exFAT and other non-Mac formats are not supported and might corrupt the library.

14 replies
Question marked as Top-ranking reply

Oct 13, 2024 3:41 AM in response to pdibello

It takes days-weeks for Photos to index such largish library (it does it when the Mac has been idling for a few minutes). I recently disabled sleep in my Mac and let it run all day and night (the display went off after 1-5 minutes idling) and it took a week for my similar library until photos had indexed it.


Make sure to store Photos library on APFS or MacOS Extended (GUID) case insensitive volume. exFAT and other non-Mac formats are not supported and might corrupt the library.

Oct 13, 2024 10:51 PM in response to pdibello

pdibello wrote:

That said, if this continued, after how long should I be concerned? A month?

With my almost similar sized library it took almost two weeks. I am not sure but after a week when I set the it as a system library, it seemed to take a finishing spurt.


I initially had the library on the Mac mini 2018 internal 1 TB disk so I did not notice the disk activity unless took a peek at the Activity Monitor and let the Mac idle for a few minutes. I have now moved the library to an external SSD to make room for other projects on the internal disk.


I have planned to bite the bullet and cough up some $$ and try iCloud Photos later because my 400 GB library does not fit to my 250 GB iPad Air so I sync only the most recent or oldest movies to it in addition to all images. And syncing is slow and sometimes it has been very flaky.

Nov 19, 2024 9:47 AM in response to pdibello

pdibello wrote:… I am using 4 SSDs in RAID 10 (Samsung 870 EVO)

In spite of my apparent guru status conferred on me by OT, I don't pay much attention to photoanalysisd and its cousins unless something's gone terribly wrong, and then not much. I prefer the "shrug and baskeball" approach.


I'm not at all sure how well Photos works with RAID systems. Photos Libraries seem very sensitive to timing interference by intervening manipulation. I have no idea what I'm talking about, here, but don't think that I've seen any reports of people having complete success operating a Photos Library from RAID storage.


Do you know other people doing this?

Oct 27, 2024 9:16 AM in response to pdibello

So, I have let the process run for about a week. Although my library itself is 542GB, photoanalysisd has read 977.47 GB and photolibraryd has read 825.62 GB. As I mentioned above, I am going to let this run for another week, but I am perplexed about why this is taking so long, and what is actually going on.


I did neither (a) nor (b) above, because I want this behavior to just "go away," but honestly it is not looking good.



The good news is that my MacMini has been up and running without incident for nearly 7 days. Yay, Apple!



Oct 13, 2024 4:00 PM in response to Matti Haveri

Sleep turned off? Check!

APFS? Check!

Case-insensitive? Check!


Interestingly, 3 days ago I moved the Photo Library from spinning media to the Samsung SSD RAID array, so that might be the cause of it, I would guess, but who knows. I used ChronoSync to recoverably copy the data.


That said, if this continued, after how long should I be concerned? A month?

Oct 14, 2024 1:55 PM in response to Matti Haveri

Hmmm... I'll give it 2 weeks then.... but if it continues past that, AND continues past the "500GB+" read milestone (listed in Activity Monitor), then what? (I am up to 112GB + 32GB


My first guess is that the Library might be corrupt, so I may either...

a. Repair the library, or

b. Create a new empty library, and populate it from iCloud. This works because I have "iCloud Photos" and "Download Originals to this Mac" set.


I am inclined to do (a) first because it will take fewer hours.


Thoughts?


--- Phil


Oct 28, 2024 8:10 AM in response to Old Toad

Let's see...I have 602 videos, I have no idea of their size, but the entire library is 540GB.


I am more concerned about the Gigabytes read/written, and their indication that the process may be "stuck." Also, I am using 4 SSDs in RAID 10 (Samsung 870 EVO), and am concerned that I am shortening the lifespan of SSDs. This whole process has written 160GB, and I do not understand it.


Plus, I am a bit OCD and am concerned that "something is not right." :)

Nov 18, 2024 12:34 PM in response to pdibello

Here is the latest...


I have been watching photoanalysisd and photolibraryd run for the past 28 days. Against an iCloud PhotoLibrary of roughly 542 GB, with 28,617 items, 435 GB Originals, including 100's of videos...

-- photoanalysisd has read 3640 GB (3.64 TB), and written 31 GB

-- photolibraryd has read 2257 GB (2.26 TB), and written 337 GB


They have consumed one of the cores on my Mac Mini (Apple M2 Pro) throughout the last 28 days, but never more.


Extrapolated over 5 years (their warrantied life), this represents between .5% and 1% of the total TBW for the Samsungs.


Should I try to create a new photoslibrary and repopulate from the cloud?

Should I even be worried?

Or, should I just have a nice adult beverage, shrug and watch basketball?


:)


-- Phil

Nov 20, 2024 8:54 AM in response to Richard.Taylor

Wow.


I am curious as to what you mean by "timing interference by intervening manipulation". It is hard to imagine that Photos would work differently on RAID than not, since I know that most video professionals (and I suspect most photo professionals) use either RAID of HDDs or NAS. Gosh, I hope that Photos uses the File System, and does not need to "go beneath it," but who knows.


So, it seems as though you suggest that I "shrug" and live with this, since it seems to have no ill effects?


Thanks for your responses to these questions :)


-- Phil

Nov 20, 2024 9:28 AM in response to pdibello

pdibello wrote:…I am curious as to what you mean by "timing interference by intervening manipulation".

I tried to answer that with "I have no idea what I'm talking about, here, "

It is hard to imagine that Photos would work differently on RAID than not, since I know that most video professionals (and I suspect most photo professionals) use either RAID of HDDs or NAS. Gosh, I hope that Photos uses the File System, and does not need to "go beneath it," but who knows.

I think that Photos depends heavily on the processes used in Apple's own formats. We know it has problems with things not connected directly by cable, and we know that it doesn't work well with NAS.


So, it seems as though you suggest that I "shrug" and live with this, since it seems to have no ill effects?

I'm saying, if it were me, I'd continued playing with the RAID system, but that I would be making frequent backups on a separate APSF formatted hard drive, keeping them each at least a month, in case I later found that something had gone horribly wrong.

External Hard-Drive shows near-constant activity

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.