View source for Expression Encoder Screen Capture Codec

*Company: [[Microsoft]]
*FourCC: MTS2
*Other names: Titanium Screen Codec 2
*Binary Codec: http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=71895f93-d804-4b70-8440-6b726ea0f12c
*Encoder 2.0: http://download.microsoft.com/download/4/7/B/47B6E0F3-EF66-4A38-AA36-3C6ECF690F36/Media_en.msi
*Encoder 2.0: http://download.microsoft.com/download/5/0/d/50da7510-3c8c-4ebf-8d83-d8c8e403da0b/Encoder_Trial_en.exe
*Samples: http://samples.mplayerhq.hu/V-codecs/MTS2/

This is fast codec used primarily as an intermediate between screen capture and encoding for delivery with Microsoft Expression Encoder. It was originally part of MSR's "Project Titanium". It is most commonly seen in [[ASF]] files with the .xesc extension. 

=== Frame format ===

Every frame seems to start with this header (all numbers are big-endian):

  0-1 width
  2-3 height
  4   2 - intra, 3 - inter)
  5   should be always zero
  6   should be in range 0-100
  7   should be in range 0-2, maybe frame type too? (0 - intra, 1 - inter and 2 - skip frames)

Frame consists of macroblocks in YUV 4:2:0 format. Static VLCs are employed for coding block data.


  for (mb_y = 0; mb_y < mb_width; mb_y++) {
      for (mb_x = 0; mb_x < mb_height; mb_x++) {
          mb_type = get_vlc();
          if (mb_type == 2)
              decode_dct_mb();
          else if (mb_type == 1)
              decode_vq_mb();
      }
  }

Block type VLC:

  0  - 0 (skip)
  10 - 2 (DCT)
  11 - 1 VQ)

==== Decoding long coefficients ====

  val = get_vlc();
  if (val > 0) {
      len = val;
      val = get_bits(len);
      if (val < (1 << (len - 1)))
          val -= (1 << len) - 1;
  }

==== DCT coding ====

In general DCT coding is the same as in MS ATC Screen codec except for bitstream format.

DC coefficient is coded as long coefficient with prediction from its neighbours.

AC coefficients use codebook with entries like <code>(skip << 4) | coef_len</code>.
<code>coef_len = 0</code> means end of block.

Decoding AC is similar to decoding long coefficient:

  val = get_bits(coef_len);
  if (val < (1 << (coef_len - 1)))
      val -= (1 << coef_len) - 1;

There are four VLCs — for luma and chroma blocks DC and for luma and chroma block coded AC information.

==== VQ coding ====

Decoding macroblock properties:

  vec_len[0] = get_vlc(luma_block_vlc); // in 1-4 range
  for (i = 0; i < vec_len[0]; i++)
      vec[0][i] = get_long_coef(luma_entry_vlc);
  vec_len[1] = get_vlc(chroma_block_vlc); // in 1-4 range
  for (i = 0; i < vec_len[1]; i++)
      vec[1][i] = get_long_coef(chroma_entry_vlc);
  vec_len[2] = get_vlc(chroma_block_vlc); // in 1-4 range
  for (i = 0; i < vec_len[2]; i++)
      vec[2][i] = get_long_coef(chroma_entry_vlc);
  for (i = 0; i < 3; i++) {
      flags[i] = vec_len[i] > 0;
      blens[i] = vec_len[i] > 2 ? vec_len[i] - 2 : 0;
  }

Decoding macroblock coefficients:

TODO

[[Category:Video Codecs]]
[[Category:Screen Capture Video Codecs]]