MultimediaWiki - User contributions [en]

Talk:VC-1

2012-10-08T17:03:19Z

Shahriman:

Why do we have the spec for VC-9 linked here?

Microsoft Video For Windows API

2012-02-16T09:52:55Z

Shahriman:

* Company: [[Microsoft]]
* [[Category_talk:Video_FourCCs|Compiled list of VFW codecs ]]

Microsoft's Video for Windows (VfW) API uses a refreshingly simple API. A Windows dynamic link library (DLL) that conforms to the VfW API is expected to export a single function with the following declaration:

LRESULT WINAPI DriverProc(
DWORD dwDriverId,
HDRVR hDriver,
UINT uMsg,
LPARAM lParam1,
LPARAM lParam2);

All parameters are 32 bits wide. The parameters are defined as follows:

* dwDriverId: A pointer to any private data that the codec needs to maintain between driver calls.
* hDriver: Unknown; may not be especially important.
* uMsg: This message parameter defines what operation DriverProc should perform on this particular call.
* lParam1: Operation-specific data field that varies depending on uMsg.
* lParam2: Operation-specific data field that varies depending on uMsg.

The DriverProc() function returns a 32-bit number indicating status as defined by the VfW API.

Other data structures:

typedef struct {
DWORD dwSize;
DWORD fccType;
DWORD fccHandler;
DWORD dwVersion;
DWORD dwFlags;
LRESULT dwError;
LPVOID pV1Reserved;
LPVOID pV2Reserved;
DWORD dnDevNode;
} ICOPEN;

typedef struct {
DWORD dwFlags;
LPBITMAPINFOHEADER lpbiInput;
LPVOID lpInput;
LPBITMAPINFOHEADER lpbiOutput;
LPVOID lpOutput;
DWORD ckid;
} ICDECOMPRESS;

driver primitives
0x0001 DRV_LOAD
0x0003 DRV_OPEN
0x0004 DRV_CLOSE
0x0006 DRV_FREE

driver return codes
0x0000 DRVCNF_CANCEL
0x0001 DRVCNF_OK
0x0002 DRVCNF_RESTART

driver messages
0x400A ICM_DECOMPRESS_GET_FORMAT
0x400B ICM_DECOMPRESS_QUERY
0x400C ICM_DECOMPRESS_BEGIN
0x400D ICM_DECOMPRESS
0x400E ICM_DECOMPRESS_END
0x401D ICM_DECOMPRESS_SET_PALETTE
0x401E ICM_DECOMPRESS_GET_PALETTE

references:
* Microsoft vfw.h API file
* [http://www.xvid.org XviD] source code

[[Category:Multimedia APIs]]

Libav Summer Of Code 2012

2012-02-01T14:38:06Z

Shahriman: /* 1st Tier Project Proposals */

== How it works ==

Google's Summer of Code program is simple: you (the student) work on a project, full-time, during the whole summer, and you get assistance (advice, mentoring) from a seasoned FFmpeg/Libav developer who knows his way around the project and has considerable standing in the community. By doing so, you'll learn to operate in an opensource project, you'll get relevant coding experience, and you'll have a chance at earning money while doing fun stuff during the summer. So, you need a project, a mentor, do a qualification task (see below) so we can quickly assess how good a candidate we feel you'll be for the program, and then you can apply.

=== Selecting a project ===
Below, you'll find two lists of projects:
* Projects with a mentor
* Projects without a mentor
If you choose a project with a mentor, talk to that mentor (see below) and select a suitable qualification task. Once completed, you're eligible for participating in our Summer of Code program. If you choose a project without a mentor, your first job is to find a mentor (see below). Then, once you've found a mentor, continue as before. If you don't like any of the projects, you're free to define your own project and find a mentor as mentioned before (see below for caveats).

=== Contacting developers/mentors ===
Once you've found a project (with or without mentor), start talking to the developers of the FFmpeg and Libav projects. We can often be found on IRC, and you can talk to us on mailinglists also. Hop on irc.freenode.net channels #ffmpeg-devel or #libav-devel, or talk to us on libav-devel@libav.org or ffmpeg-devel@ffmpeg.org. (At this point, you're probably wondering why there are 2 IRC channels and 2 mailinglists. Ask your mentor, it'll make for a good first conversation topic.) Here, you'll be able to ask around for mentors for projects without a mentor if you need to. If you're trying to define your own project, explain (with reasonable amount of detail) what you intend to achieve and why you think your project should be in our Summer of Code program. Once you've found a mentor, you're good to start your qualification task.

Note that the self-selected mentor needs to have considerable standing in the community to be eligible for mentoring. Likewise, if you choose to define your own Summer of Code project, some community members of considerable standing need to vouch for your project.

=== Your qualification task ===
The goal of a qualification task is to see if the mentor and student feel that together, they will be able to finish the project of their choice. More specifically, the mentor will want to test whether he thinks that the student has the skills and work ethics to complete a large coding project in a limited amount of time. The student will want to make sure that the mentor provides (useful) assistance when necessary. Therefore, students should select a mentor and a Summer of Code project before starting their work on a qualification task. The qualification task is often (but not necessarily) related to the selected project. For example, if your project will be to reverse engineer a new video codec, the qualification task may be to write a partial bitstream parser for that codec. If your project is to write a muxer for a container format, the qualification task may be to write the code to write the stream header.

=== Applying ===
While you're working on your qualification task, apply at http://www.google-melange.com/. The degree (and detail) with which you've finished your qualification task will determine how likely your project is to be selected. In the past few years, students that completely finished their qualification task always got selected as Summer of Code students, but that may vary depending on the number of spots we get assigned by Google, and the number of students that apply.

=== Videolan qualification tasks ===
A completed FFmpeg/Libav qualifications task is also accepted as a qualification task for the VLC organization (does NOT include x264).

== 1st Tier Project Proposals ==
1st tier project proposals are project ideas that are reasonably well defined '''AND''' have a mentor volunteered.

=== HEVC/H265 decoder ===

* HEVC is the next-generation video standard from the MPEG standards committee. Your job is to write a decoder that can playback HEVC files.
* It does not need to be SIMD-optimized, but preferably has relevant functions separated in DSP contexts so they're easy to optimize later on.
* This task will depend on the current standardisation status of HEVC. Final publication is in 2013 but there may be parts which will not change much anyway.

''Mentor: [[User:Ronald_S._Bultje|Ronald S. Bultje]]''

=== DTS-HD decoder ===

* ETSI released specifcations (http://www.etsi.org/deliver/etsi_ts/102100_102199/102114/01.03.01_60/ts_102114v010301p.pdf). Your job is to complete the existing decoder with the following features.

(1) Add support for mixed Core + DTS-HD stream structure
(DtsCoreFrame+DtsHdFrame+DtsCoreFrame+DtsHdFrame+...), used by Blu-Ray main
and commentary tracks.
(2) Add support for XXCh extension (6.1 and 7.1 channels).
(3) Add support for X96 extension (96khz).
(4) Add support for XLL extension (lossless).
(5) Add support for a pure DTS-HD stream structure
(DtsHdFrame+DtsHdFrame+DtsHdFrame+...), used by Blu-Ray PiP tracks.
(6) Add support for XBR extension (extra bitrate).

''Mentor: Benjamin Larsson''

=== MPEG-4 ALS Roundup ===

This task is to update and enhance the existing ALS decoder as well as integrate
and enhance the rudimentary encoder found at:
https://github.com/justinruggles/FFmpeg-alsenc

Possible features are:

* implement rls-lms in the decoder
* do correct channel layout/sort handling in the decoder
* update to current master
* use codec private options
* implement encode2(), setting pts and duration
* document options and examples in encoders.texi
* come up with a good set of encoding tests for FATE
* implement mcc/channel sort in the encoder
* implement rls-lms in the encoder
* implement float support

''Mentor: Justin Ruggles''

=== On2 VP7 Decoder ===

VP7 is a DCT-based video codec. At the moment, it seems to lack a reference implementation, but we do have a spec and may take hint from libavcodec's VP8 and VP6 decoder and libvpx. MPlayer can decode VP7 by loading a binary. To begin working on the project, one has to setup a reference decoder against which to compare our output. This can be done by either writing a wrapper for the binary or (may be) hacking libvpx itself.

You might want to discuss with us how and where to start. Drop by on IRC if you need help. It is not as difficult as it sounds.

* [http://multimedia.cx/mirror/VP7_Data_Format_and_Decoder_Overview.pdf Specification]
* [http://samples.mplayerhq.hu/V-codecs/VP7/ Samples]

''Mentor: [[User:shahriman|Mashiat Sarker Shakkhar]]''

== 2nd Tier (need mentor) Project Proposals ==

=== AACS implementation ===
* this task is to get libbluray integrated with ffmpeg and working with as many discs as possible.
* Add the ability to encode and decode using Advanced Access Content System to FFmpeg.
* Specifications: http://www.aacsla.com/specifications/
* existing implementation e.g. DumpHD: http://forum.doom9.org/showthread.php?t=123111
* Most parts (BD-J, MKB, title key generation) probably do not belong into FFmpeg, this should be discussed with us before submitting an application
** possible solution: only implement "lowest" level (decode given the correct title key) but implement CSS en- and decryption as secondary goal

FFmpeg / Libav Summer Of Code

2012-02-01T14:01:21Z

Shahriman:

The [[FFmpeg]] project has been a participant in the [http://code.google.com/soc/ Google Summer of Code] program since 2006. In 2011, the [[Libav]] fork became part of the same Summer of Code effort.

* [[FFmpeg / Libav Summer of Code 2012|2012 project page]]
* [[FFmpeg / Libav Summer Of Code 2011|2011 project page]]
* [[FFmpeg Summer Of Code 2010|2010 project page]]
* [[FFmpeg Summer Of Code 2009|2009 project page]]
* [[FFmpeg Summer Of Code 2008|2008 project page]]
* [[FFmpeg Summer Of Code 2007|2007 project page]]
* [[FFmpeg Summer Of Code 2006|2006 project page]]

Each accepted project is developed in its own sandbox, separate from the main Libav codebase. Naturally, the end goal of each of the accepted projects ought to be to have that code in shape for acceptance into the production codebase. This page tracks the status of each project and how well each student did.

== 2006 Projects ==

=== VC-1 Decoder ===
* Student: [[User:Kostya|Kostya Shishkov]]
* Mentor: [[User:Multimedia Mike|Mike Melanson]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== AMR-NB Decoder ===
* Student: [[User:superdump|Robert Swain]]
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Student Status: FFmpeg committer. Project not finished during SoC.
* Code Status: Continued in another Summer of Code [[FFmpeg Summer Of Code#Finish AMR-NB decoder and write an encoder|task]] and accepted into the FFmpeg codebase.

=== AC-3 Decoder ===
* Student: [[User:Cloud9|Kartikey Mahendra BHATT]]
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Student Status: disappeared, project unfinished
* Code Status: Picked up by [[User:Jruggle|Justin Ruggles]] and committed to FFmpeg.

=== AAC Decoder ===
* Student: Maxim Gavrilov
* Mentor: [[User:ods15|Oded Shimon]]
* Student Status: disappeared, project unfinished
* Code Status: Picked up by [[User:andoma|Andreas Öman]] and [[User:superdump|Robert Swain]] and committed to FFmpeg.

=== Vorbis Encoder ===
* Student: Mathew Philip
* Mentor: [[User:ods15|Oded Shimon]]
* Student Status: disappeared, project barely started
* Code Status: Picked up by [[User:ods15|Oded Shimon]] and committed to FFmpeg.

== 2007 Projects ==

=== RealVideo 4 Decoder ===
* Student: [[User:Kostya|Kostya Shishkov]]
* Mentor: [[User:Multimedia Mike|Mike Melanson]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase. The project goal morphed to include a RealVideo 3 decoder since the 2 schemes are so similar.

=== QCELP Decoder ===
* Student: [[User:Reynaldo|Reynaldo Verdejo Pinochet]]
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Student Status: FFmpeg commiter. Produced a working decoder during SoC but the code didn't reach SVN before the end of the program.
* Code Status: Picked up by Kenan Gillet and with the help of [[User:Reynaldo|Reynaldo]] committed to FFmpeg. Some features still missing, though.

=== Matroska Muxer ===
* Student: David Conrad
* Mentor: [[User:aurel|Aurélien Jacobs]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== Video Filter API (AKA [[Libavfilter|libavfilter]]) ===
* Student: [[User:Koorogi|Bobby Bingham]]
* Mentor: [[User:Merbanan|Benjamin Larsson]] and Michael Niedermayer
* Student Status: project not finished during SoC
* Code Status: Accepted into the FFmpeg codebase.

=== E-AC-3 Decoder ===
* Student: Bartlomiej Wolowiec
* Mentor: [[User:Jruggle|Justin Ruggles]]
* Student Status: FFmpeg committer; code produced worked for most available samples, but there were some unimplemented features.
* Code Status: Picked up by [[User:Jruggle|Justin Ruggles]], finished and committed to FFmpeg.

=== JPEG 2000 Encoder and Decoder ===
* Student: Kamil Nowosad
* Mentor: [[User:pengvado|Loren Merritt]]
* Student Status: disappeared, project unfinished
* Code Status: The code is working but not all features are supported., committed to FFmpeg.

=== Dirac Encoder and Decoder ===
* Student: Marco Gerards
* Mentor: [[User:Lu_zero|Luca Barbato]]
* Student Status: project not finished during SoC
* Code Status: Decoder committed to FFmpeg, the encoder still needs more work.

=== TS Muxer ===
* Student: Xiaohui Sun
* Mentor: [[User:bcoudurier|Baptiste Coudurier]]
* Student Status: disappeared, project unfinished
* Code Status: [[Interesting Patches#PES packetizer by Xiaohui Sun|Changes]] requested during the review process for FFmpeg inclusion were never made.

== 2008 Projects ==

=== Generic frame-level multithreading support ===
* Student: Alexander Strange
* Mentor: Kristian Jerpetjoen
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== Nellymoser Encoder ===
* Student: Bartlomiej Wolowiec
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== ALAC Encoder ===
* Student: [[User:Jai|Jai Menon]]
* Mentor: [[User:Jruggle|Justin Ruggles]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== LGPL reimplementation of GPL sws_scale parts ===
* Student: Keiji Costantini
* Mentor: [[User:Lu_zero|Luca Barbato]]
* Student Status: project unfinished
* Code Status: The GPL YUV table generator has since been implemented as LGPL by [[User:Kostya|Kostya Shishkov]].

=== AAC-LC Encoder ===
* Student: [[User:Kostya|Kostya]]
* Mentor: [[User:Andoma|Andreas Öman]]
* Student Status: FFmpeg committer
* Code Status: merged but terrible

=== MLP/TrueHD encoder ===
* Student: [[User:Angustia|Ramiro Polla]]
* Mentor: [[User:Jruggle|Justin Ruggles]]
* Student Status: FFmpeg committer
* Code Status: MLP encoder never finished, MLP decoder committed to FFmpeg.

=== WMA Pro Decoder ===
* Student: Sascha Sommer
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== MXF Muxer ===
* Student: [[User:spyfeng|Zhentan Feng]]
* Mentor: [[User:Bcoudurier|Baptiste Coudurier]]
* Student Status: finished project
* Code Status: Accepted into the FFmpeg codebase.

== 2009 Projects ==

=== RTMP Support (Flash streaming) ===
* Student: [[User:Kostya|Kostya Shishkov]]
* Mentor: [[User:Ronald S. Bultje|Ronald Bultje]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== libswscale cleanup ===
* Student: [[User:Angustia|Ramiro Polla]]
* Mentor: [[User:reimar|Reimar Döffinger]]
* Student Status: FFmpeg committer
* Code Status: partially committed

=== S/PDIF muxer ===
* Student: Bartlomiej Wolowiec
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== Playlist/Concatenation Support for FFmpeg ===
* Student: [[User:Gkovacs|Geza Kovacs]]
* Mentor: [[User:Bcoudurier|Baptiste Coudurier]]
* Student Status: project not finished during SoC
* Code Status: unfinished

=== JPEG2000 decoder and encoder ===
* Student: [[User:Jai|Jai Menon]]
* Mentor: [[User:Jruggle|Justin Ruggles]]
* Student Status: abandoned project
* Code Status: unfinished

=== Implement the New Seeking API in Libavformat ===
* Student: [[User:spyfeng|Zhentan Feng]]
* Mentor: [[User:Bcoudurier|Baptiste Coudurier]]
* Student Status: project not finished during SoC
* Code Status: unfinished

=== [[MPEG-4 Audio Lossless Coding (ALS)|MPEG-4 ALS]] decoder ===
* Student: Thilo Borgmann
* Mentor: [[User:Jruggle|Justin Ruggles]]
* Student Status: FFmpeg committer
* Code Status: Accepted into the FFmpeg codebase.

=== Implementation of AVFilter infrastructure and various audio filters ===
* Student: Kevin Dubois
* Mentor: [[User:Vitor|Vitor Sessak]]
* Student Status: project not finished during SoC
* Code Status: unfinished

=== Finish AMR-NB decoder and write an encoder ===
* Student: Colin McQuillan
* Mentor: [[User:superdump|Robert Swain]]
* Student Status: AMR-NB decoder almost finished during SoC
* Code Status: AMR-NB decoder accepted into the FFmpeg codebase, AMR-NB encoder not started.

== 2010 Projects ==

=== Improve RTSP/RTP layer ===
* Student: Josh Allmann
* Student Status: Active contributor
* Mentor: [[User:Lu_zero|Luca Barbato]], [[User:Mstorsjo|Martin Storsjö]]
* Code Status: Fully integrated ([[Improve RTSP/RTP layer|checklist]])

=== Writing an AMR-WB audio decoder ===
* Student: Marcelo Povoa
* Mentor: [[User:superdump|Robert Swain]]
* Code Status: AMR-WB decoder accepted into the FFmpeg codebase

=== MMS protocol Implementation ===
* Student: [[User:spyfeng|Zhentan Feng]]
* Mentor: [[User:Ronald S. Bultje|Ronald Bultje]]
* Code Status: MMSH and MMST protocols accepted into FFmpeg codebase, MMSU protocol not started.

=== G.723.1 Decoder/Encoder ===
* Student: Mohamed Naufal
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Code Status: Accepted into the FFmpeg codebase..

=== Libavfilter audio framework and filters ===
* Student: S.N. Hemanth Meenakshisundaram
* Mentor: Stefano Sabatini
* Code status: partially integrated in the FFmpeg codebase

=== MOD audio playback support ===
* Student: Sebastian Vater
* Mentor: Stefano Sabatini, Vitor Sessak
* Code status: implemented in external repo, not integrated into FFmpeg codebase

=== Accurate Seeking API ===
* Student: Michael Chinen
* Mentor: [[User:Bcoudurier|Baptiste Coudurier]]

== 2011 Projects ==

=== BSAC AAC Decoder ===
* Student: Young Han Lee
* Mentor: [[User:AConverse|Alex Converse]]
* Code Status: [http://github.com/yhlee/bsac Started]

=== Playlist Support ===
* Student: [[User:elenril|Anton Khirnov]]
* Mentor: [[User:Lu_zero|Luca Barbato]]

=== Improve the audio filtering support in libavfilter ===
* Student: Mina Nagy
* Mentor: [[User:stefanosa|Stefano Sabatini]]
* Code Status: partially committed

=== DTS Encoder ===
* Student: Xiang Wang
* Mentor: [[User:Merbanan|Benjamin Larsson]]
* Project Status: failed

=== VC-1 decoder missing features implementation ===
* Student: Mashiat Sarker Shakkhar
* Mentor: [[User:Ronald S. Bultje|Ronald Bultje]]
* Code Status: [https://github.com/shahriman/libav WiP]

=== Complete WMVP/WVP2 decoder ===
* Student: Alberto Delmás
* Mentor: [[User:Kostya|Kostya Shishkov]]
* Code Status: Accepted into the FFmpeg codebase.

=== Implement Windows Television (WTV) muxer ===
* Student: [[User:spyfeng|Zhentan Feng]]
* Mentor: [[User:suxen_drol|Peter Ross]]
* Code Status: Accepted into the FFmpeg codebase.

=== Hardware Accelerated H264 Decoding on Android ===
* Student: Mohamed Naufal
* Mentor: [[User:Mstorsjo|Martin Storsjö]]
* Code Status: Accepted into the FFmpeg codebase.

=== Flash screen video (1)/2 ===
* Student: [[User:DonDiego|Diego Biurrun]]
* Mentor: [[User:Jumpyshoes|Daniel Kang]]
* Project Status: failed

=== Dirac Video Codec update ===
* Student: Jordi Ortiz
* Mentor: [[User:Lu_zero|Luca Barbato]]
* Code Status: Decoder accepted into the FFmpeg codebase.

[[Category:FFmpeg]]
[[Category:Libav]]

REDCode

2012-01-22T18:04:40Z

Shahriman:

* Extension: r3d
* FourCC: REDC
* Company: [http://www.red.com/ RED Digital Cinema]
* Samples:
** http://redrelay.net/ (the .r3d files on various members' pages) (''dead link'')
** Some camera test footage can be found [http://www.bealecorner.org/red/test-080108/index.html here]

REDCode data can occur in [[MOV]] files or in their own custom R3D container. Audio is stored as [[PCM]] while the video is stored in a special [[JPEG 2000]] format that has 4 planes -- 2 green, 1 red, and 1 blue. The 4 planes correspond to a Bayer pattern arrangement:

R G1
G2 B

[[Category:Video Codecs]]
[[Category:Undiscovered Video Codecs]]

REDCode

2012-01-22T18:04:28Z

Shahriman:

* Extension: r3d
* FourCC: REDC
* Company: [http://www.red.com/ RED Digital Cinema]
* Samples:
** http://redrelay.net/ (the .r3d files on various members' pages) (''dead link'')
** Some camera test footages can be found [http://www.bealecorner.org/red/test-080108/index.html here]

REDCode data can occur in [[MOV]] files or in their own custom R3D container. Audio is stored as [[PCM]] while the video is stored in a special [[JPEG 2000]] format that has 4 planes -- 2 green, 1 red, and 1 blue. The 4 planes correspond to a Bayer pattern arrangement:

R G1
G2 B

[[Category:Video Codecs]]
[[Category:Undiscovered Video Codecs]]

REDCode

2012-01-22T18:04:07Z

Shahriman:

REDCode

2012-01-22T17:57:27Z

Shahriman:

* Extension: r3d
* FourCC: REDC
* Company: [http://www.red.com/ RED Digital Cinema]
* Samples: http://redrelay.net/ (the .r3d files on various members' pages) (''dead link'')

REDCode data can occur in [[MOV]] files or in their own custom R3D container. Audio is stored as [[PCM]] while the video is stored in a special [[JPEG 2000]] format that has 4 planes -- 2 green, 1 red, and 1 blue. The 4 planes correspond to a Bayer pattern arrangement:

R G1
G2 B

[[Category:Video Codecs]]
[[Category:Undiscovered Video Codecs]]