yabridge/docs/vst3.md

# VST3 serialization

TODO: Flesh this out further

TODO: Link to `src/common/serialization/vst3/README.md`

TODO: Mention the new `Ya<Base>::supports()` mechanism for the monolithic proxy
objects through multiple inheritance

TODO: Explain the monolith

The VST3 SDK uses an architecture where every concrete object inherits from an
interface, and every interface inherits from `FUnknown`. `FUnkonwn` offers a
dynamic casting interface through `queryInterface()` and a reference counting
mechanism that calls `delete this;` when the reference count reaches 0. Every
interface gets a unique identifier. It then uses a smart pointer system
(`FUnknownPtr<I>`) that queries whether the `FUnknown` matches a certain
interface by checking whether the IDs match up, allowing casts to that interface
if the `FUnkonwn` matches. Those smart pointers also use that reference counting
mechanism to destroy the object when the last pointer gets dropped.

Another important part of this system is interface versioning. Old interfaces
cannot be changed, so when the SDK adds new functionality to an existing
interface it defines a new interface that inherits from the old one. The
`queryInterface()` implementation should then allow casts to all of the
implemented interface versions.

Lastly, the interfaces provide both getters for static, non-chancing data (such
as the classes registered in a plugin factory) as well as functions that perform
side effects or return dynamically changing data (such as the input/output
configuration for an audio processor).

Yabridge's serialization and communication model for VST3 is thus a lot more
complicated than for VST2 since all of these objects are loosely coupled and are
instantiated and managed by the host. The basic model works as follows:

1. For an interface `IFoo`, we provide a possibly abstract implementation called
   `YaFoo`.
2. When we want to _proxy_ an interface from one side to the other (let's assume
   we want to allow the native VST3 host to call functions on the `IFoo`
   provided by the Windows VST3 plugin), we need to provide a `YaFoo`
   implementation on the native plugin side that can do callbacks to the
   corresponding `IFoo` object in the Wine plugin host. For most objects, this
   works by first generating a unique identifier to be able to refer to this
   specific `IFoo` instance, and then serializing that identifier together with
   any static payload data into a `YaFoo::ConstructArgs` object. This
   `YaFoo::ConstructArgs` copies this data through a `IPtr<IFoo>` smart pointer
   to the original object we're proxying. This object can be serialized and
   transmitted to the other side using bitsery.
3. The original `IFoo` we are proxying gets added to an
   `std::map<size_t, IPtr<IFoo>>` (in our assumed scenario, this happens on the
   Wine plugin host's side) with the key being that unique instance identifier
   we generated so we can refer to it later on.
4. `YaFoo` implements all the boilerplate required for `FUnknown`. This includes
   the constructor, destructor and methods required for reference counting, as
   well as the query interface. It also implements any static lookup functions
   that can be performed using the data contained in a `YaFoo::ConstructArgs`
   object. Any functions that perform side effects or return dynamic data and
   thus require a callback or control message are marked as pure virtual. These
   callbacks can be performed through yabridge's `Vst3MessageHandler` message
   handling interface. For the sake of clarity, we use the term _callback_ for
   `plugin -> host` function calls and _control message_ for `host -> plugin`
   function calls.
5. The side that requested the object (which we assume to be the native plugin
   here), creates a _proxy object_ called `YaFoo{Plugin,Host}Impl`, so
   `YaFooPluginImpl` in this case. This is an instance of `YaFoo` and thus
   `IFoo`, so we can pass it as an `IFoo` pointer to the host. This object takes
   those `YaFoo::ConstructArgs` and a reference to the bridge instance so it can
   do callbacks or send control messages.
6. If `IFoo` is a versioned interface such as `IPluginFactory{,2,3}`, the
   creation of `YaFoo::ConstrctArgs` and the definition of `YaFoo`'s query
   interface work slightly differently. When copying the data for a plugin
   factory, we'll start copying from `IPluginFactory`, and we'll copy data from
   each newer version of the interface that the `IPtr<IPluginFactory>` supports.
   During this process we keep track of which interfaces were supported by the
   native plugin in a `known_iids` set. In our query interface method we then
   only report support for the same interfaces that were supported by the
   original `IPtr<IPluginFactory` we're proxying.
7. The same mechanism that we use for versioning is also used for objects that
   commonly implement multiple interfaces. A common example of this is an
   `IComponent` (which inherits from `IPluginBase`) also implementing
   `IAudioProcessor` and `IConnectionPoint`.

## Interface Instantiation

Creating a new instance of an interface using the plugin factory wroks as
follows. This describes the object lifecycle. The actual serialization and
proxying is described in the section above.

1. The host calls `createInterface(cid, _iid, obj)` on an IPluginFactory
   implementation exposed to the host as described above.
2. We check which interface we support matches the `_iid`. If we don't support
   the interface, we'll log a message about it and return that we do not support
   the itnerface.
3. If we determine that `_iid` matches `IFoo`, then we'll send a
   `YaFoo::Construct{cid}` to the Wine plugin host process.
4. The Wine plugin host will then call
   `module->getFactory().createInstance<IFoo>(cid)` using the Windows VST3
   plugin's plugin factory to ask it to create an instance of that interface. If
   this operation fails and returns a null pointer, we'll send a
   `kNotImplemented` result code back to indicate that the instantiation was not
   successful and we relay this on the plugin side.
5. As mentioned above, we will generate a unique instance identifier for the
   newly generated object so we can refer to it later. We then serialize that
   identifier along with what other static data is available in `IFoo` in a
   `YaFoo::ConstructArgs` object.
6. We then move `IPtr<IFoo>` to an `std::map<size_t, IPtr<IFoo>>` with that
   unique identifier we generated earlier as a key so we can refer to it later
   in later function calls.
7. On the plugin side we can now use the `YaFoo::Arguments` object we received
   to create a `YaFooPluginImpl` object that can send control messages to the
   Wine plugin host.
8. Finally a pointer to this `YaFooPluginImpl` gets returned as the last step of
   the initialization process.

## Simple objects

For serializing objects of interfaces that purely contain getters and setters
(and thus don't need to perform any host callbacks), we'll simply have a
constructor that takes the `IFoo` by `IPtr` or reference (depending on how it's
used in the SDK) and reads the data from it to create a serializable copy of
that object.

## Safety notes

- None of the destructors in the interfaces defined by the SDK are marked as
  virtual because this could apparently [break binary
  compatibility](https://github.com/steinbergmedia/vst3sdk/issues/21). This
  means that the destructor of the class that implemented `release()` will be
  called. This is something to keep in mind when dealing with inheritence.
- Since everything behind the scenes makes use of these `addRef()` and
  `release()` reference counting functions, we can't use the standard library's
  smart pointers when dealing with objects that are shared with the host or with
  the Windows VST3 plugin. In `IPtr<T>`'s destructor it will call release, and
  the objects will clean themselfs up with a `delete this;` when the reference
  count reaches 0. Combining this with the STL cmart pointers this would result
  in a double free.