jamosdev
/
rhubarb-lip-sync
mirror of https://github.com/DanielSWolf/rhubarb-lip-sync.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Change format of changelog

This commit is contained in:
Daniel Wolf 2018-09-01 20:31:50 +02:00
parent 49097b00d7
commit ce02a3a003
1 changed files with 54 additions and 54 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

108
VERSION.md
View File

@ -2,97 +2,97 @@
## Version 1.8.0 ## Version 1.8.0
* Support for Ogg Vorbis (.ogg) file format ([issue #40](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/40)) * **Added** support for Ogg Vorbis (.ogg) file format ([issue #40](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/40)).
* Fixed build error with some versions of Boost ([issue #41](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/41)) * **Fixed** build error with some versions of Boost ([issue #41](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/41)).
## Version 1.7.2 ## Version 1.7.2
* Fixed bug in Rhubarb for Spine where processing failed depending on the number of existing animations. See [issue #34](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/34#issuecomment-378198776). * **Fixed** bug in Rhubarb for Spine where processing failed depending on the number of existing animations ([issue #34](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/34#issuecomment-378198776)).
## Version 1.7.1 ## Version 1.7.1
* Fixed [issue #34](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/34): Generic error message in Rhubarb for Spine * **Added** more helpful error dialogs for internal errors in Rhubarb Lip Sync for Spine.
* More helpful error dialogs for internal errors in Rhubarb Lip Sync for Spine * **Added**: Internal errors in Rhubarb Lip Sync for Spine are logged to the console (`stderr`).
* Internal errors in Rhubarb Lip Sync for Spine are logged to stderr * **Fixed** generic error message in Rhubarb for Spine ([issue #34](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/34)).
## Version 1.7.0 ## Version 1.7.0
* Integration with Spine animation software * **Added** integration with Spine animation software (Rhubarb Lip Sync for Spine).
* Full Unicode support. File names, dialog files, strings in exported files etc. should now be fully Unicode-compatible. * **Added** full Unicode support: File names, dialog files, strings in exported files etc. should now be fully Unicode-compatible.
* Added `--machineReadable` command-line option to allow for better integration with other applications. * **Added** `--machineReadable` command-line option to allow for better integration with other applications.
* Added `--consoleLevel` command-line option to control how much detail to log to the console (`stderr`). * **Added** `--consoleLevel` command-line option to control how much detail to log to the console (`stderr`).
* Unless specified using `--consoleLevel`, only errors and fatal errors are printed to the console. Previously, warnings were also printed. * **Changed** message output to the console: Unless specified using `--consoleLevel`, only errors and fatal errors are printed to the console. Previously, warnings were also printed.
* Fixed [issue #25](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/25): Segfault with WAVE file containing some initial music before spoken words * **Fixed** segfault with WAVE file containing some initial music before spoken words ([issue #25](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/25))
## Version 1.6.0 ## Version 1.6.0
* Added a script for lip-syncing in Adobe After Effects. * **Added** a script for lip-syncing in Adobe After Effects.
* Added `--output` command-line option. * **Added** `--output` command-line option.
* Dropped the hyphen: Rhubarb Lip-Sync is now Rhubarb Lip Sync. * **Changed** the official spelling of the project: Rhubarb Lip-Sync is now Rhubarb Lip Sync (without the hyphen).
## Version 1.5.0 ## Version 1.5.0
* Improved animation rules for ER and AW sounds * **Added** animation code optimizing animation for words containing "to".
* Optimized animation for words containing "to" * **Improved** animation rules: better animation of ER and AW sounds.
* Fixed [issue #9](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/9): Fails to compile with Boost 1.56.0+ * **Fixed** compilation with Boost 1.56.0+ ([issue #9](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/9)).
## Version 1.4.2 ## Version 1.4.2
* Fixed [issue #7](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/7): Incorrect animation before some pauses * **Fixed** incorrect animation before some pauses ([issue #7](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/7)).
## Version 1.4.1 ## Version 1.4.1
* Fixed [issue #6](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/6): Crash with message "Time range start must not be less than end." * **Fixed** crash with message "Time range start must not be less than end." ([issue #6](https://github.com/DanielSWolf/rhubarb-lip-sync/issues/6))
## Version 1.4.0 ## Version 1.4.0
* **Preventing long static segments** * **Added** animation code preventing long static segments.
Watch yourself in a mirror saying "He seized his keys." Your lips barely moved, right? That's exactly what would happen in previous versions of Rhubarb Lip Sync. Only worse: Because there is only one "clenched teeth" mouth shape, the mouth would stay completely static during phrases like this. Rhubarb Lip Sync 1.4.0 now does what [a professional animator would do](http://animateducated.blogspot.de/2016/10/lip-sync-animation-2.html?showComment=1478861729702#c2940729096183546458): It opens the mouth a bit wider for some syllables, keeping the lips moving. This may be cheating, but it looks much better! Watch yourself in a mirror saying "He seized his keys." Your lips barely moved, right? That's exactly what would happen in previous versions of Rhubarb Lip Sync. Only worse: Because there is only one "clenched teeth" mouth shape, the mouth would stay completely static during phrases like this. Rhubarb Lip Sync 1.4.0 now does what [a professional animator would do](http://animateducated.blogspot.de/2016/10/lip-sync-animation-2.html?showComment=1478861729702#c2940729096183546458): It opens the mouth a bit wider for some syllables, keeping the lips moving. This may be cheating, but it looks much better!
* **Using wide-open mouth shape more often** * **Improved** animation rules to use wide-open mouth shape more often.
Previous versions used mouth shape D (the wide-open mouth) very sparingly. This release uses it more often, which makes the resulting animation more lively and interesting. Previous versions used mouth shape D (the wide-open mouth) very sparingly. This release uses it more often, which makes the resulting animation more lively and interesting.
## Version 1.3.0 ## Version 1.3.0
* **New, bidirectional animation algorithm** * **Improved** animation algorithm: Implemented new, bidirectional animation algorithm.
Since version 1.0.0, Rhubarb Lip Sync has used a predictive animation algorithm. That means that in many situations (usually before a vowel), the mouth *anticipates* the upcoming sound. It moves *ahead of time*, resulting in more natural animation. Since version 1.0.0, Rhubarb Lip Sync has used a predictive animation algorithm. That means that in many situations (usually before a vowel), the mouth *anticipates* the upcoming sound. It moves *ahead of time*, resulting in more natural animation.
For version 1.3.0, this core animation algorithm has been re-written from scratch. The new algorithm still anticipates the *next* vowel, but now also considers the *previous* vowel. The resulting animation is even closer to human speech. For version 1.3.0, this core animation algorithm has been re-written from scratch. The new algorithm still anticipates the *next* vowel, but now also considers the *previous* vowel. The resulting animation is even closer to human speech.
* **Artistic timing** * **Added** artistic timing.
Previous versions of Rhubarb Lip Sync have tried to reproduce the timing of the recording as precisely as possible. For rapid speech, this often resulted in jittery animation that didn't look good: It tried to fit too much information into the available time. Traditional animators have known this problem since the 1930s. Instead of slavishly following the timing of the recording, they focus on important sounds and mouth shapes, showing them earlier (and thus longer) than would be realistic. On the other hand, they often skip unimportant sounds and mouth shapes altogether. Previous versions of Rhubarb Lip Sync have tried to reproduce the timing of the recording as precisely as possible. For rapid speech, this often resulted in jittery animation that didn't look good: It tried to fit too much information into the available time. Traditional animators have known this problem since the 1930s. Instead of slavishly following the timing of the recording, they focus on important sounds and mouth shapes, showing them earlier (and thus longer) than would be realistic. On the other hand, they often skip unimportant sounds and mouth shapes altogether.
Rhubarb Lip Sync 1.3.0 adds a new step in the animation pipeline that emulates this artistic approach. The resulting animation looks much cleaner and smoother. Ironically, it also looks more in-sync than the precise animation created by earlier versions. Rhubarb Lip Sync 1.3.0 adds a new step in the animation pipeline that emulates this artistic approach. The resulting animation looks much cleaner and smoother. Ironically, it also looks more in-sync than the precise animation created by earlier versions.
* **Tweaks to the animation rules and tweening** * **Added** `--extendedShapes` command-line option.
Previous versions of Rhubarb Lip Sync used a fixed set of eight or nine mouth shapes for animation. If users wanted to use fewer mouth shapes, they had to modify the output, for instance by replacing every "X" shape with an "A". This version of Rhubarb Lip Sync introduces the `--extendedShapes` command-line option that allows the user to specify which mouth shapes should be used. This is not only more convenient; knowing which mouth shapes are actually available also allows Rhubarb Lip Sync to create better animation.
* **Added** `--quiet` mode.
A "quiet" mode has been added. In that mode, Rhubarb Lip Sync doesn't create any output except for animation data and error messages. This is helpful when using Rhubarb Lip Sync as part of an automated process.
* **Improved** animation rules and tweening for better animation.
Animation rules define which mouth shapes can be used to represent a specific sound. For this release, there have been many tweaks to the animation rules, making some sounds look much more convincing. In addition, the rules for inbetweens ("tweening") have been improved. As in traditional animation, the mouth now "pops" open without inbetweens, then closes smoothly. Animation rules define which mouth shapes can be used to represent a specific sound. For this release, there have been many tweaks to the animation rules, making some sounds look much more convincing. In addition, the rules for inbetweens ("tweening") have been improved. As in traditional animation, the mouth now "pops" open without inbetweens, then closes smoothly.
* **Improved pause animations** * **Improved** pause animations.
Pauses in speech are tricky to animate. Early version of Rhubarb Lip Sync always closed the mouth, which looks strange for very short pauses. Later versions kept the mouth open for short pauses, which can also look weird if the first mouth shape *after* the pause is identical to the mouth shape *during* the pause: It looks as if somebody just forgot to animate that part. Pauses in speech are tricky to animate. Early version of Rhubarb Lip Sync always closed the mouth, which looks strange for very short pauses. Later versions kept the mouth open for short pauses, which can also look weird if the first mouth shape *after* the pause is identical to the mouth shape *during* the pause: It looks as if somebody just forgot to animate that part.
This version of Rhubarb Lip Sync uses three different strategies for animating pauses, depending on the duration of the pause and the mouth shapes before and after it. This version of Rhubarb Lip Sync uses three different strategies for animating pauses, depending on the duration of the pause and the mouth shapes before and after it.
* **`--extendedShapes` command-line option** * **Fixed** bugs in the grapheme-to-phoneme algorithm.
Previous versions of Rhubarb Lip Sync used a fixed set of eight or nine mouth shapes for animation. If users wanted to use fewer mouth shapes, they had to modify the output, for instance by replacing every "X" shape with an "A". This version of Rhubarb Lip Sync introduces the `--extendedShapes` command-line option that allows the user to specify which mouth shapes should be used. This is not only more convenient; knowing which mouth shapes are actually available also allows Rhubarb Lip Sync to create better animation.
* **`--quiet` mode**
A "quiet" mode has been added. In that mode, Rhubarb Lip Sync doesn't create any output except for animation data and error messages. This is helpful when using Rhubarb Lip Sync as part of an automated process.
* **Fixes to the grapheme-to-phoneme algorithm**
Rhubarb Lip Sync comes with a huge dictionary containing pronunciations for more than 100,000 English words. If the dialog text contains words not found in this dictionary, Rhubarb Lip Sync will try to guess the correct pronunciation. I've fixed several bugs in the G2P algorithm that does this. As a result, using the `--dialogFile` option now results in even better animation. Rhubarb Lip Sync comes with a huge dictionary containing pronunciations for more than 100,000 English words. If the dialog text contains words not found in this dictionary, Rhubarb Lip Sync will try to guess the correct pronunciation. I've fixed several bugs in the G2P algorithm that does this. As a result, using the `--dialogFile` option now results in even better animation.
## Version 1.2.0 ## Version 1.2.0
* **Dialog file needn't be exact** * **Improved** dialog handling to allow for incorrect input dialog.
Since version 1.0.0, Rhubarb Lip Sync can handle situations where the dialog text is specified (using the `-dialogFile` option), but the actual recording omits some words. For instance, the specified dialog text can be "That's all gobbledygook to me," but the recording only says "That's gobbledygook to me," dropping the word "all." Since version 1.0.0, Rhubarb Lip Sync can handle situations where the dialog text is specified (using the `-dialogFile` option), but the actual recording omits some words. For instance, the specified dialog text can be "That's all gobbledygook to me," but the recording only says "That's gobbledygook to me," dropping the word "all."
@ -100,25 +100,25 @@
## Version 1.1.0 ## Version 1.1.0
* **More reliable speech recognition** * **Improved** speech recognition to be more reliable.
The first step in automatic lip sync is speech recognition. The first step in automatic lip sync is speech recognition.
Rhubarb Lip Sync 1.1.0 recognizes spoken dialog more accurately, especially at the beginning of recordings. Rhubarb Lip Sync 1.1.0 recognizes spoken dialog more accurately, especially at the beginning of recordings.
This improves the overall quality of the resulting animation. This improves the overall quality of the resulting animation.
* **More accurate breath detection** * **Improved** breath detection to be more accurate.
Rhubarb Lip Sync animates not only dialog, but also noises such as taking a breath. Rhubarb Lip Sync animates not only dialog, but also noises such as taking a breath.
For this version, the accuracy of breath detection has been improved. For this version, the accuracy of breath detection has been improved.
You shouldn't see actors opening their mouth for no reason any more. You shouldn't see actors opening their mouth for no reason any more.
* **Better animation of short pauses** * **Improved** animation of short pauses.
During short pauses between words or sentences (up to 0.35s), the mouth is kept open. During short pauses between words or sentences (up to 0.35s), the mouth is kept open.
Now, this open mouth shape is chosen based on the previous and following mouth shapes. Now, this open mouth shape is chosen based on the previous and following mouth shapes.
This gives pauses in speech a more natural, less mechanical look. This gives pauses in speech a more natural, less mechanical look.
* **Builds on Linux** * **Added** capability to build on Linux
In addition to Windows and OS X, Rhubarb Lip Sync can now be built on Linux systems. In addition to Windows and OS X, Rhubarb Lip Sync can now be built on Linux systems.
I'm not offering binary distributions for Linux at this time. I'm not offering binary distributions for Linux at this time.
@ -126,23 +126,23 @@
## Version 1.0.0 ## Version 1.0.0
* More realistic animation using new, predictive algorithm * **Improved** animation algoritym: More realistic animation using new, predictive algorithm.
* Smoother animation due to tweening * **Added** tweening for smoother animation.
* Support for non-dialog noises (breathing, smacking, etc.) * **Added** support for non-dialog noises (breathing, smacking, etc.)
* Substantial speed improvement through multithreading * **Improved** processing speed substantially through multithreading.
* More reliable voice recognition * **Improved** reliability of voice recognition.
* Support for long recordings (I've tested a 30-minute file) * **Added** support for long recordings (I've tested a 30-minute file).
* Recording may deviate from specified dialog text * **Added** capability to handle recording that deviate from the specified dialog text.
* Specified dialog text may contain unknown words as well as numbers, abbreviations, etc. * **Added** capability to handle unknown words as well as numbers, abbreviations, etc. in the specified dialog text.
## Version 0.2.0 ## Version 0.2.0
* Multiple output formats: TSV, XML, JSON * **Added** multiple output formats: TSV, XML, JSON.
* Experimental option to supply dialog text * **Added** experimental option to supply dialog text.
* Improved error handling and error messages * **Improved** error handling and error messages.
## Version 0.1.0 ## Version 0.1.0
* Two-pass phone detection using [CMU PocketSphinx](http://cmusphinx.sourceforge.net/) * **Added** two-pass phone detection using [CMU PocketSphinx](http://cmusphinx.sourceforge.net/).
* Fixed set of eight mouth shapes, based on the Hanna-Barbera shapes * **Added** fixed set of eight mouth shapes, based on the Hanna-Barbera shapes.
* Naive (but well-tuned) mapping from phones to mouth shapes * **Added** naive (but well-tuned) mapping from phones to mouth shapes.