Expression Encoder Screen Capture Codec: Difference between revisions

From MultimediaWiki
Jump to navigation Jump to search
(samples)
No edit summary
 
(3 intermediate revisions by 2 users not shown)
Line 3: Line 3:
*Other names: Titanium Screen Codec 2
*Other names: Titanium Screen Codec 2
*Binary Codec: http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=71895f93-d804-4b70-8440-6b726ea0f12c
*Binary Codec: http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=71895f93-d804-4b70-8440-6b726ea0f12c
*Encoder 2.0: http://download.microsoft.com/download/4/7/B/47B6E0F3-EF66-4A38-AA36-3C6ECF690F36/Media_en.msi
*Encoder 2.0: http://download.microsoft.com/download/5/0/d/50da7510-3c8c-4ebf-8d83-d8c8e403da0b/Encoder_Trial_en.exe
*Samples: http://samples.mplayerhq.hu/V-codecs/MTS2/
*Samples: http://samples.mplayerhq.hu/V-codecs/MTS2/


This is fast codec used primarily as an intermediate between screen capture and encoding for delivery with Microsoft Expression Encoder. It was originally part of MSR's "Project Titanium". It is most commonly seen in [[ASF]] files with the .xesc extension.  
This is fast codec used primarily as an intermediate between screen capture and encoding for delivery with Microsoft Expression Encoder. It was originally part of MSR's "Project Titanium". It is most commonly seen in [[ASF]] files with the .xesc extension.  
=== Frame format ===
Every frame seems to start with this header (all numbers are big-endian):
  0-1 width
  2-3 height
  4  2 - intra, 3 - inter)
  5  should be always zero
  6  should be in range 0-100
  7  should be in range 0-2, maybe frame type too? (0 - intra, 1 - inter and 2 - skip frames)
Frame consists of macroblocks in YUV 4:2:0 format. Static VLCs are employed for coding block data.
  for (mb_y = 0; mb_y < mb_width; mb_y++) {
      for (mb_x = 0; mb_x < mb_height; mb_x++) {
          mb_type = get_vlc();
          if (mb_type == 2)
              decode_dct_mb();
          else if (mb_type == 1)
              decode_vq_mb();
      }
  }
Block type VLC:
  0  - 0 (skip)
  10 - 2 (DCT)
  11 - 1 VQ)
==== Decoding long coefficients ====
  val = get_vlc();
  if (val > 0) {
      len = val;
      val = get_bits(len);
      if (val < (1 << (len - 1)))
          val -= (1 << len) - 1;
  }
==== DCT coding ====
In general DCT coding is the same as in MS ATC Screen codec except for bitstream format.
DC coefficient is coded as long coefficient with prediction from its neighbours.
AC coefficients use codebook with entries like <code>(skip << 4) | coef_len</code>.
<code>coef_len = 0</code> means end of block.
Decoding AC is similar to decoding long coefficient:
  val = get_bits(coef_len);
  if (val < (1 << (coef_len - 1)))
      val -= (1 << coef_len) - 1;
There are four VLCs ­— for luma and chroma blocks DC and for luma and chroma block coded AC information.
==== VQ coding ====
Decoding macroblock properties:
  vec_len[0] = get_vlc(luma_block_vlc); // in 1-4 range
  for (i = 0; i < vec_len[0]; i++)
      vec[0][i] = get_long_coef(luma_entry_vlc);
  vec_len[1] = get_vlc(chroma_block_vlc); // in 1-4 range
  for (i = 0; i < vec_len[1]; i++)
      vec[1][i] = get_long_coef(chroma_entry_vlc);
  vec_len[2] = get_vlc(chroma_block_vlc); // in 1-4 range
  for (i = 0; i < vec_len[2]; i++)
      vec[2][i] = get_long_coef(chroma_entry_vlc);
  for (i = 0; i < 3; i++) {
      flags[i] = vec_len[i] > 0;
      blens[i] = vec_len[i] > 2 ? vec_len[i] - 2 : 0;
  }
Decoding macroblock coefficients:
TODO


[[Category:Video Codecs]]
[[Category:Video Codecs]]
[[Category:Screen Capture Video Codecs]]
[[Category:Screen Capture Video Codecs]]
[[Category:Undiscovered Codecs]]

Latest revision as of 06:32, 7 July 2012

This is fast codec used primarily as an intermediate between screen capture and encoding for delivery with Microsoft Expression Encoder. It was originally part of MSR's "Project Titanium". It is most commonly seen in ASF files with the .xesc extension.

Frame format

Every frame seems to start with this header (all numbers are big-endian):

 0-1 width
 2-3 height
 4   2 - intra, 3 - inter)
 5   should be always zero
 6   should be in range 0-100
 7   should be in range 0-2, maybe frame type too? (0 - intra, 1 - inter and 2 - skip frames)

Frame consists of macroblocks in YUV 4:2:0 format. Static VLCs are employed for coding block data.


 for (mb_y = 0; mb_y < mb_width; mb_y++) {
     for (mb_x = 0; mb_x < mb_height; mb_x++) {
         mb_type = get_vlc();
         if (mb_type == 2)
             decode_dct_mb();
         else if (mb_type == 1)
             decode_vq_mb();
     }
 }

Block type VLC:

 0  - 0 (skip)
 10 - 2 (DCT)
 11 - 1 VQ)

Decoding long coefficients

 val = get_vlc();
 if (val > 0) {
     len = val;
     val = get_bits(len);
     if (val < (1 << (len - 1)))
         val -= (1 << len) - 1;
 }

DCT coding

In general DCT coding is the same as in MS ATC Screen codec except for bitstream format.

DC coefficient is coded as long coefficient with prediction from its neighbours.

AC coefficients use codebook with entries like (skip << 4) | coef_len. coef_len = 0 means end of block.

Decoding AC is similar to decoding long coefficient:

 val = get_bits(coef_len);
 if (val < (1 << (coef_len - 1)))
     val -= (1 << coef_len) - 1;

There are four VLCs ­— for luma and chroma blocks DC and for luma and chroma block coded AC information.

VQ coding

Decoding macroblock properties:

 vec_len[0] = get_vlc(luma_block_vlc); // in 1-4 range
 for (i = 0; i < vec_len[0]; i++)
     vec[0][i] = get_long_coef(luma_entry_vlc);
 vec_len[1] = get_vlc(chroma_block_vlc); // in 1-4 range
 for (i = 0; i < vec_len[1]; i++)
     vec[1][i] = get_long_coef(chroma_entry_vlc);
 vec_len[2] = get_vlc(chroma_block_vlc); // in 1-4 range
 for (i = 0; i < vec_len[2]; i++)
     vec[2][i] = get_long_coef(chroma_entry_vlc);
 for (i = 0; i < 3; i++) {
     flags[i] = vec_len[i] > 0;
     blens[i] = vec_len[i] > 2 ? vec_len[i] - 2 : 0;
 }

Decoding macroblock coefficients:

TODO