(Well, more of a mugging than a robbery, I suppose)

Yesterday evening I was looking for something to watch. Something I hadn’t seen in a while. I was sure I had purchased it, but according to the Apple TV app running on macOS Catalina 10.15.4.1, it wasn’t able to find it when I did a search.

But I did find it within my library when sorted alphabetically. Phew! It just looked as if Apple was no longer selling that particular title. But at least I could stream and download it. That title was Jean-Pierre Jeunet’s MicMacs, a wonderfully comic French film about the arms industry (got to love the French sense of humour!).

Oh, really? Tell that to the Apple TV app on macOS Catalina and Apple removing content without notice

But I decided that I’d leave it until I’m off on holiday next week when I can really start binging on movies (many of whom were purchased via Apple’s iTunes store recently) – I’ve got:

  • Knives Out
  • Once upon a Time in Hollywood
  • Rocketman
  • Birds of Prey

as well as a few older titles that I’ve not seen in a while that were on sale.

While I was reminiscing over Sylvain Chomet‘s The Illusionist (which is based on an unproduced Jacques Tati script, and was directly responsible for me falling in love with the city of Edinburgh and have not regretted it since), I thought about his other film, Attila Marcel. I hadn’t seen that for a very long while, and thought it’d make for a good evening’s viewing.

ALAS!

Like MicMacs, I couldn’t see it in Apple TV’s search function. What was worse: I couldn’t see it listed alphabetically in the library either. Yet I was damn sure I bought it on iTunes.

Thankfully Apple keeps all orders and invoices going back many years – though they could consider introducing a text search function within the Apple TV and Apple Music apps to make it easier to find particular titles – otherwise it’s you need to do a LOT of scrolling. That, plusan export function for any and all invoices as CSV or Excel format.

I managed to find the original order/invoice:

So that confirms I wasn’t going stark raving mad (entirely possible during this lockdown phase). Tried to go through the usual route of reporting a problem with Apple, but the order was so old. I managed to set-up a generic support ticket with Apple Support. After an hour or two I got a reply:

It’s important to note that I quoted the original order ID when establishing contact. I replied to say that I’ve never hidden any purchases and gave them a screenshot to prove there was nothing being hidden. I then received the following:

Effectively:

“The content provider decided to stop selling their movie on our platform, and either we don’t have the file or are not allowed to give it out – even if you’ve purchased it.”

Where it gets unnecessarily complicated is that Apple sells the Apple TV 4K device which has limited storage – 32Gb or 64Gb. They also sell the iPhone which has a maximum storage capacity of 512Gb. They also have the iPad which goes all the way up to 1Tb. My entire Apple TV/iTunes library sits in around 1.75Tb. And until recently my MacBook Pros have only had a maximum of 1Tb of internal storage – and half of that was being used by Apple Photos and project work.

The entire point of buying from the likes of Apple is to make it easy to access and view my film collection (haha, I’m trying to find another word for collection as it’s not really such if some swine can just come along remove stuff from it at any time without my permission or notice) via the Apple TV device, my iPhone, my iPad or my MacBook Pro.

In the UK, the fair use law prevents us legally from ripping content from physical media that we’ve purchased. Apple seems the best option – especially as they generally give you a similar set of extra features content that you’d find on a DVD or Blu-Ray release.

Now, even if I download all ~4Tb of my content to my Mac and back that content up either to the likes of Backblaze or an external hard drive or NAS, I cannot download the 4K version of the film, nor the iTunes Extras content. Then we have issues of presenting films that have been removed from iTunes like Attila Marcel to the Apple TV, iPhone and iPad. There are options for this:

  • AirPlay (think Google’s Chromecast)
  • Home Share (sharing media library direct from Mac or NAS)

But this isn’t a consistent or nice experience – something that Apple does so very well in almost all other areas of the business.

Some questions:

  • Why Apple doesn’t inform you of any content that’s about to be removed from your library?
  • Apple has seriously screwed the pooch because there is a difference between download and streaming, which is the heart of the matter here (and especially so with the Apple TV device). I keep the movies in their “cloud” to save space and to be able to stream because I generally always have the bandwidth to do so. There is very little need for me to download an entire movie. I think this applies to the vast majority of Apple’s customers, too. This hybrid download/streaming system is an utter mess.

Apple’s own storefront web site makes absolutely no mention that content can be withdrawn. This is what it has to say (at the time of writing, 5th May 2020):

Oh, really?

Buy. Rent. Watch. All inside the app. Welcome to the new home of thousands of films, including the latest blockbusters from iTunes. Now you can buy, rent and watch, all from inside the app — as well as watch everything you’ve previously purchased from iTunes.”

But Apple has done a Hitchhiker’s Guide to the Galaxy style maneuver. To quote from the book written by Douglas Adams, who was a big fan of Apple:

“But the plans were on display…”
“On display? I eventually had to go down to the cellar to find them.”
“That’s the display department.”
“With a flashlight.”
“Ah, well, the lights had probably gone.”
“So had the stairs.”
“But look, you found the notice, didn’t you?”
“Yes,” said Arthur, “yes I did. It was on display in the bottom of a locked filing cabinet stuck in a disused lavatory with a sign on the door saying ‘Beware of the Leopard.”

The search for Apple’s Terms of Service in a nutshell

Apple’s Terms of Service (which, strangely, I found only through a third party web stite) only stipulate redownloads, NOT streaming – which is how I use iTunes/Apple TV content. Again, we’re back to the problem which is a legacy hangover from the early days of iTunes where you had to download everything to be able to watch it. Then the iPhone, the iPad and Apple TV came along. Especially the Apple TV which MUST stream the content.

REDOWNLOADS

You may be able to redownload previously acquired Content (“Redownload”) to your devices that are signed in with the same Apple ID (“Associated Devices”). You can see Content types available for Redownload in your Home Country at https://support.apple.com/en-gb/HT204632. Content may not be available for Redownload if that Content is no longer offered on our Services.

Associated Devices Rules (except Apple Arcade): You can have up to ten
devices (but only a maximum of five computers) signed in with your Apple ID at one time. Each computer must also be authorised using the same Apple ID (to learn more about authorisation of computers, visit
https://support.apple.com/en-gb/HT201251). Devices can be associated
with a different Apple ID once every 90 days.

Associated Devices Rules for Apple Arcade: You can have up to 10 devices
signed in to Apple Arcade per Family member at one time. Devices can be associated with a different Apple ID once every 90 days.

Redownloads vs streaming – nowt mentioned about streaming, necessary for Apple TV

The link in the above only mentions general availability of Apple Media Services. It does not mention the conditions in which content may be removed (and event then, only referring to downloadable content), nor that you will not be notified that the content is no long available.

Not if they’ve pulled the title from their servers you can’t. Be prepared for fiddling with file transfers and AirPlay instead – and extra features going missing as they’re streaming only and can’t be downloaded.

Compare this against Amazon Prime Video’s Terms which are linked to at every option to rent or “buy” (and I use that term loosely now). Amazon are much clearer on the point whereas Apple has been super vague for the past 7 years despite constantly removing content from people’s libraries.

4. DIGITAL CONTENT

i. Availability of Purchased Digital Content. Purchased Digital Content will generally continue to be available to you for download or streaming from the Service, as applicable, but may become unavailable due to potential content provider licensing restrictions or for other reasons, and Amazon will not be liable to you if Purchased Digital Content becomes unavailable for further download or streaming.

Amazon’s Terms for “buying” digital movie or TV content from them – this is very clearly set out: don’t use them for buying film or TV content.

Amazon have made it very clear anything you “buy” from them can vanish at any point. That they don’t have to give you any notice. That they owe you nothing if this occurs. Apple’s terms are more ambiguous because it merely states “redownloads”. Yet the service is primary a streaming service; downloads are a legacy from when iTunes first started when streaming wasn’t available and which just happens to be convenient these days for going offline (for travelling).

  • Why Apple doesn’t offer an immediate refund or compensation if content is removed – people make the assumption that if you purchase something from these services, they have access to it indefinitely. There’s no big massive asterisk next to the purchase button warning you about Apple or the content provider’s ability to remove the film from your cloud library. It should not be considered an extended rental. If you buy a physical CD, DVD or Blu-Ray – you don’t have somebody turn up at your doorstep from the shop that sold it to you and demand it back because their supplier no longer sells to them. Just because something is intangible should not bring about Houdini style hijinks.
  • Why Apple hasn’t thought about and solved this problem already? There have been sporadic reports of content being removed from people’s libraries since at least 2013.
  • If Apple can’t sold this problem technically, then why doesn’t it try to resolve this through its significant legal resources and the major film studios and distributors? If Apple truly is a consumer champion, dedicated to the likes of privacy et. al, it needs to be seen doing a heck of a lot more for protecting consumer’s rights. (Ironic, given the whole right to repair fiasco which is stil ongoing.)

Some experiences of other people:

There are plenty more articles about this, but the point is that in an age where we’re relying more and more on cloud services (including storage), it seems highly unreasonable for Apple to expect us to download every single title we buy from them and keep it somewhere local.

I’ve reach out further to Apple Support and Tim Cook to see what they have to say on the matter and have asked them what they intend to do in the future to protect consumers’ purchases. Apple needs to resolve its issue with the legacy iTunes stuff because it’s now becoming a major problem. Until then, I’m extremely damn nervous to buy anything more from the Apple TV/iTunes store knowing that at any time a content provider can pull the plug just like that.

I’d reach out to Metrodome who distributes (or at least did) Atilla Marcel and ask them what the bloody hell they’re playing at, even though my contract for the purchase is with Apple. But they went into administration in 2016. Maybe the rights reverted to Pathé? Though this doesn’t explain why it has taken this long for the title to be removed from iTunes – I’m pretty sure it was still there at the end of last year (2019). In any event, Amazon’s Prime Video has the title to rent or buy. I may reach out to Pathé and ask them what the hell THEY’RE playing at – especially as there a good number of titles from them happily existing on iTunes that I “own”.

Apple, live up to your creed: Think Different. Yet just don’t think different – do something!

BTW, when the BBC Store closed down, I had around £150 worth of purchases refunded to me in its entirety by BBC Worldwide PLUS a voucher for Amazon which could be used to buy physical or digital content by way of an apology. More companies – especially Apple – need to take note.

As we enter yet another week of lockdown, I’ve been all too successful at remaining indoors. While Sainsbury’s, Tesco, Asda, Ocado, Waitrose and all other grocery stores online delivery services are completely out of bounds, Amazon Prime Now has proven itself worthy over and over again. Best £7.99/month I’ve ever spent.

I’ve managed to keep up stocks of the regular staples including bread and main meals regularly over the past few weeks without too many issues. One has to keep checking available slots, but usually something turns up every few hours. This is in stock contrast to Sainsbury’s which is only delivering to the most vulnerable. Click and Collect is always unavailable.

The big problem with the main supermarkets is that they make the assumption that everybody drives and has a car. I don’t. The bus service where I live has reduced its services to about one bus per hour rather than the usual 10 minutes when they were operating normally. So it could take several hours for me to go grocery shopping each week – and bear in mind that I’d have to cart everything back by myself.

Virtual Music Concerts

I’ve not been to many music concerts in my life (I can count on one hand – The Divine Comedy at The University of East Anglia (UEA) back in the late 90’s, Last Night of the Proms at Hyde Park in the mid 2000’s, and similarly one trip to Guilfest in 2006), but as we’re all still in lockdown, new ways are being found to provide the concert-going experience at home.

Fortnite, the wildly popular video game, recently put on a virtual concert for Travis Scott. The event, called Astronomical, showcased a few of his existing songs as well as previewing a new track. It was rather spectacular – and more importantly, provided a virtual mosh pit where you could jump and run around and, in some cases, swim and fly. The Xbox controller’s haptic feedback engine vibrate in time to the music often.

I’ve put together a few highlights here.

It was a wildly successful event, and I have no doubt that we’ll be seeing more of these things in the future – lockdown or not.

Replacing the daily commute with a webcam

One of the most difficult things I had trouble sourcing when work asked us to start working from home was a webcam. Every other bugger was buying them as well. But I’ve finally managed to get my hands on one, albeit it at a cost which closely matches that of my monthly commute via South Western Railways. It is a 4K webcam, though, and designed for streaming.

Work has a regular weekly meeting with all employees, and a daily virtual coffee/chinwag in which using video is highly encouraged. My 16″ MacBook Pro is hooked up to my new 27″ BenQ monitor, and the lid is closed, so I can’t use the webcam there (and besides which it’s only 720p because Apple has seriously skimped on what is now a vital resource). I’ve used the 2018 iPad Pro temporarily, but the angle is such that it looks up my nose and just isn’t flattering at all. With the new Logitech Brio 4K Stream camera, it’ll sit on top of the monitor and will provide viewers with a much better angle, and at a much better quality.

I imagine that realistically, we won’t be back in the office much until June/July time, so it seems worthwhile making the investment now. Given the potential for reinfection, we may be using video conferencing a lot more.

Photo slideshows and video editing

I’ve started experimenting with Apple Photos’ slideshow functions to put together a few slideshows of various things. One thing that I put together was a tribute to the family cat, Lupin, who sadly passed away last month. It’s quite interesting that looking back on the photos, I took a LOT of pictures of that cat. But alas, it’s not great, so I won’t embed it here.

RIP Lupin Drake

After messing about with Apple Photos, I attempted to put together a slideshow of a trip I made to the Pacific Northwest I went on 5 years ago next month. I wanted to do something a bit special for the 5th anniversary. Alas, Apple Photos is a massive pain in the arse and, combined with my lack of organisational skills in managing the photos and date/time settings on the camera and iPhone, it’s all a bit of a mess. Re-ordering them in the slideshow caused significantly more problems.

I had even imported the exported slideshow into Final Cut Pro X, created some text overlays (with a flag for each country I visited) and polished the presentation. It looked good, apart from noticing the completely out of order photos which kept happening every time I messed about with the export function in Apple Photos. So I’d preview it in Apple Photos, see that it was okay, and got a completely different result from the export after putting all the effort in captioning and graphics and watching the results.

I think what I need to do is create an album, add the photos I want to add there, and then create the slideshow for that. I’ll give that a go soon, but having spent nearly 7 hours very early Saturday morning messing about with Apple Photos and Final Cut Pro X, I’m not in a rush to do so again too soon.

My Pacific Northwest travels of 2015

As a long term Apple user, I’ve seen a lot happen with Apple’s services division over the past 20 years. When they work, they bring me great joy and they are absolutely worth the money. But when they don’t, they are a bigger pain in the arse than South Western Railways and Network Rail.

Having moved over to the 16″ MacBook Pro, one of the first things I did before the move was:

  • Create a current, up-to-date Time Machine backup
  • Copy all data – including Apple Photos and Apple Music/TV to a separate hard drive and copy them back over manually

iCloudy with a chance of rain

When the new machine was running, I copied all my data back over. The first problem was that because I use iCloud Photo Library, Apple immediately enables it even if you don’t want to use it (a bug, perhaps?) – creating a Photos library catalogue. About 99% of having copied the data from the separate hard drive to the Photos directory on the new Mac terminated and told me there was already data there, and then terminated the transfer.

So I thought I’d give Apple the benefit of the doubt and download all my photos and videos stored in iCloud Photo Library (around ~130Gb) and start a new catalogue from scratch. It did work, but it takes forever for the Apple Photos app in macOS Catalina to do its stuff before downloading can happen. It took about 3-4 hours in total to download 10,443 photos and 463 videos. Speaking of iCloud Photo Library – Apple had better start considering offering a 4Tb tier. I’m nowhere near that level yet, but as storage becomes cheaper on MacBook Pros, iMacs and Mac Pros, and as the cameras improve on iPhones, people will start putting everything in iCloud. Obviously I back everything up religiously to Time Machine, Backblaze, Google Drive and separate hard drives, but as we’ve just discovered – it doesn’t always work out the way you think it does. At least I can access all the old photos from the backups manually.

Ch..ch..ch..changes

What is interesting to note is that with macOS Catalina’s Photos app, Apple has made some internal restructuring to the package contents of the catalogue. No longer is there a masters directory containing your original files and filenames, but a directory called originals which contain the original files. But with Apple-encoded filenames. Original filenames appear to be stored as metadata within an internal, locally-stored Apple database.

Apple Music is just as buggy as iTunes

With regards to Apple Music, I originally didn’t have any problems copying that across. The only real issue is that the artwork to albums and playlists was missing. I tried everything I could to try and get them back through the Apple Music app on Catalina, but no joy. The closest I got was to nuke everything in the Music directory and copy back over from the Time Machine backup. They seemed to work – except that every single file was available to download through iCloud. Downloading only doubled the amount of space being used by macOS.

So I completely deleted my Music directory again and tried to get Apple Music to start afresh. Except it didn’t. It picked up my account details and some album artwork straight away. And iCloud Errors galore.

At one point, Apple Music got REALLY confused.

So I did a bit of digging around. There aren’t many articles about Apple Music on Catalina and how to fix problems. But this is how I “fixed” mine – where “fixed” was to get Apple Music to start from scratch – newly created directory, no files downloaded, all music stored in iCloud – then start to download music as an when needed. Over 56,000 tracks is a bit much.

I hate Windows registry, but Apple’s Library can just as bad…

Having closed Apple Music and deleted the Music subdirectory from within the Music directory in my home directory, I opened a terminal, I navigated to

~/Library/Caches

and nuked any files or directories that mention iTunes or Music in their file/directory names. This gets rid of any caches built up by Apple Music/iTunes. So it should forget anything you’ve done so far. But this isn’t enough. I then changed to:

~/Library/Preferences

and nuked any files or directories that mention iTunes or Music in the file/directory names. From there I fired up Apple Music and was greeted by the Apple Music welcome screen. And everything worked as expected from that point onwards. I downloaded my playlist music just fine, along with a number of albums. All good. And everything has been fine for the past 24 hours.

More internal local changes

Again, with macOS Catalina, Apple has re-arranged the internal file structure for Apple Music. My backups had an iTunes directory with all the media stored in there, and a Music directory which had a single package file within it. When starting Apple Music anew, there is a Music subdirectory containing the same package, followed by a media directory.

Within the Media subdirectory, you can see that (when arranged alphabetically) Apple Music files are stored separately from purchased/uploaded music.

When attempting to get things working from backup, it seemed Apple Music was completely confused. I’ve got to say, Apple, that you’ve made a right pig’s ear of this and I’m not happy. When I’ve set-up Apple Music on my work Mac, it was fine because I hadn’t any existing files. But if I had brought them in, I’m sure I’d suffer similar problems.

What is the point of backups if they don’t work properly – especially if the issue is being caused by bugs or changes made by the same company you’ve bought the hardware AND software from?

macOS Catalina – a steaming pile of horse poop

Regardless of whether its new hardware or existing hardware, the macOS Catalina experience has been awful. My work Mac Mini (2018) was bricked by the update and required a logic board replacement. The 2018 MacBook Pro was fine, but clearly the backups I’ve been making haven’t been suitable for transferring to a new machine – or even to the same machine because of all the changes between Mojave and Catalina.

A while back, I spoke to some people from a VERY big international games company, and the problems they were having with Catalina were numerous. Don’t forget that Catalina drops support for 32-bit apps. And many of them are games.

There are so many game titles which are all 32-bit, and not compatible with macOS Catalina, making Steam for macOS pretty redundant right now. At least there’s Apple Arcade, right?

I do love my 16″ MacBook Pro, but I want to see Apple seriously step up their services/macOS game because right now it’s simply not good enough.