Many moons ago (back in 2013), I discussed DSD audio. While over the years I've talked about DSD from a a number of different angles (eg. JRiver realtime conversion listening, PCM <--> DSD conversion, conversion 2015, equipment DSD playback measurements like PonoPlayer / TEAC UD-501 / Oppo BDP-105 / Oppo Sonica DAC), concerns from that very first discussion about DSD still irks me these days!
The main issue is simply this: the lack of ability for gear and software to support both tagging and data compression when dealing with DSD. This IMO truly has been a ridiculous state of affairs for so many years! Despite years of cheerleading in the industry and even smaller sales outfits like NativeDSD Music already putting files out there for consumers, the relative inelegance of it all is rather silly.
As usual, I find it rather baffling that the typical mainstream audiophile press remains silent on deficiencies like this. To me, it is issues like these, while perhaps not "sexy" nor provides the press something to market to consumers, that when addressed can actually move the hobby forward. Unlike yet another megabuck product that provides a few minutes of eye-candy at best and affects the few, "infrastructural" changes can affect the many. Yet another example of the myopia of the audiophile press and an inability to muster any leadership in changing the industry and hobby in meaningful ways.
For today, let's not worry about the pros and cons of DSD itself or if 1-bit multi-megahertz sampling sounds significantly different to PCM. Also, let's for a moment not worry about the fact that many SACDs are just PCM upsamples. Suffice it to say that there are albums that originated in DSD such as those from Channel Classics. Also, some old analogue recordings such as some of the original Sony DSD's appear to have been converted directly to DSD from tape. As a perfectionist (neurotic) audiophile, since I have purchased a number of these recordings over the years, I'm happier to keep them in the original digital format rather than conversion to PCM if possible. And ideally, it would be nice for these few DSD albums to be played back using mature systems that don't feel like they were "hacked" to support them.
As I laid out in the 2013 DSD article, the problem with the traditional DSD file formats .dsf and .dff is simply how primitive they are! DSD is typically quite an inefficient data format and screams out for compression. And as I noted earlier this year, I have a system of meticulous tagging for my music library and it would be ridiculous to incorporate a bunch of DSD albums without a decent way to keep them tagged within the collection.
Historically, SACDs can utilize DST for lossless compression (Richard Murison of BitPerfect wrote a post about DST a few years back). These days, there's just no support for this. While DST decompression can be found in the wild to convert a ripped SACD .iso, and both foobar (using SACD plugin) and JRiver can play them back, as far as I am aware, there is no free compression software. Years ago, the Philips ProTECH DST Encoder was available for studio projects, but I don't know what has happened to the software these days or if it has been incorporated into some other studio package; last I saw was this announcement that Sonic Studio took over the software in 2005.
With the release of SACD, the world was introduced to what we would call these days "DSD64" (2.8MHz) or 1-bit 64 x 44.1kHz sampling rate. Around 2007, with affordable devices like the Korg MR1000, we started seeing higher-resolution DSD128 (5.6MHz), then DSD256 (11.2MHz), and most recently even DSD512 (22.6MHz) capabilities in modern DACs. These higher sample rate variants suck up even more data and IMO, it would be ridiculously unwise not to implement some form of lossless compression with such files!
It was therefore wonderful to see that in December 2016, with the release of WavPack 5.0.0, we finally have the inclusion of DSD data compression into an open-source file format.
Although these days, for PCM, almost all devices have the capability to play back and convert FLAC (even finally the latest Apple products), not as many can manage WavPack. For the audio historians among us, the development of WavPack in fact predated FLAC. The first version of WavPack was released way back in 1998!
II. Batch conversion to WavPack...
As you would expect, no problem at all decompressing these .wv files back to .dff or .dsf using the aptly named wvunpack.exe command line if you ever wanted to one day (check out the WavPack command line documentation).
III. Playback... The road ahead?
Unfortunately compatibility has not reached streaming devices quite yet. For example, MPD as typically used in many Linux devices already has incorporated WavPack-DSD handling, but I have not seen or heard of DLNA streaming to Pi3/Volumio or similar set-ups with WavPack-DSD compatibility.
Likewise, although DSD playback with Squeezebox/LMS systems using DSDPlayer plugin has been available for awhile (including realtime DSD-to-PCM transcoding), even though the .wv files are recognized and tagged in the music library, decoding for DSD playback currently is not implemented when streaming to the latest piCorePlayer 3.22 (and nightly LMS 7.9.1 as of November 16, 2017). There are a few pieces that need to be implemented like scanning to report true track duration, reporting to DSDPlayer that the output could be native DSD for consistent transcoding / DoP streaming like with uncompressed .dff and .dsf.
Looking around, I also do not see compatibility yet for WavPack-DSD with Roon.
Well guys, I think it's pretty obvious that I am hoping that WavPack-DSD support can be expanded in the months and years to come as a common way to deal with these DSD files. Hopefully as an open-source format it won't be hard to incorporate into these streaming systems!
It has been a remarkably long time coming... I must admit that with all the hype DSD has received over the years, it's amazing that it has taken this long to finally see the release of a modern way to handle tagging and compression. As I mentioned in my DSD article from 2013, I believe the file format is extremely important and serves as the foundation from which other support software and mechanisms are built. To me, it was rather silly to have all kinds of hype without serious development of this scaffold upon which libraries of music can grow.
Perhaps this is not surprising at all since DSD was never meant to be a consumer computer-audio "format". Rather, it started life as SACD, basically Sony's attempt at another revenue source with strong copy protection mechanisms as their patent life on CDDA was near the end (sort of like how MQA is being offered by Meridian as MLP's patent life comes to a close... That's another story!). DSD64 really only became interesting to audiophiles once SACDs could be digitally ripped when hackers figured out how to use early "jailbroken" Sony Playstation 3's to get the job done back around early 2011 (some instructions). So from the start, DSD playback was driven really by the "underground" and not officially sanctioned by Sony or any of the big companies although I recall Sony did have DSD software in some of their Vaio laptops back in 2007/2008.
Lastly, I think it's great to see WavPack become the first "universal" audio archiving format! It can of course handle high-resolution PCM, now DSD including higher samplerate variants like DSD128 and DSD256. There are also allowances for lossy PCM encoding if needed.
I'm not sure of the longterm commercial viability of DSD these days. It has been quite awhile since I have bought a SACD or DSD download. But at least WavPack 5 is now available and Måns Rullgård added support in SoX awhile back in 2015 so the tools are finally better... I'm not sure if many of us would shed tears if DSD ends up being a legacy format.
Pssst... Logitech Music Server / piCorePlayer developers... I know more DSD work is being done on the code so hopefully there will be good functionality ahead!
I tried michaelvv's post here to play back the DSD-encoded .wv files. I found it worked off and on with my TEAC UD-501 USB DAC playing the music through DoP on my Linux VM LMS set-up - not sure why and I guess YMMV. Eventually I just used the default WavPack 5 decimation to WAV which plays back as 352.8kHz PCM on my "Pi 3 Touch" (in the Linux server, replaced the /usr/share/squeezeboxserver/Bin/x86_64-linux/wvunpack with a newer version 5 binary). Still far from ideal; the ideal being out-of-the-box no hassles playback, native DSD/DoP streaming, handling DSD128+, and seamless transcoding to PCM-only devices like my Transporter. At least I can now incorporate these compressed DSD albums in my system along side all the standard and hi-res PCM.
Doesn't look like much new going on in the audio world in the last few weeks. I guess this means that folks are simply enjoying the music :-).