Better method of getting subtitles from Netflix

My previous post on ripping Japanese subtitles from Netflix has been quite popular, although the method that I proposed was fairly limited and quite difficult to do. But thanks to user ahlawy who left a comment on my post, a much better method has been discovered, that only requires a web browser!

Update 11/05/2017: Thanks to another user by the name of TITHEN-FIRION, it is EVEN EASIER now.

I have updated my original guide to include this new method. So if you are interested in getting subtitles from Netflix, check it out!

anime-manga.jp Anki Decks

Some time ago, The Japan Foundation created a website to help Japanese students learn the type of Japanese that is often heard in anime and manga. While it’s got some decent content, I’ve rarely ever heard anyone mention the site. That’s probably because they stuck all of the content into a crappy flash application. You can’t view it on mobile, you can’t copy and paste text, you can’t resize it, you can’t do ANYTHING useful.

So, I dumped some of their content into Anki decks so that it would be possible to actually learn something from it. I have made a deck containing phrases, and a deck with grammar points. This is only a portion of the total content from the site, but I felt that these parts would probably be the most useful and work the best in a flashcard format.

The grammar deck in particular is a bit dense with all of the information available, but I thought it best to put too much info rather than too little. You can of course customize which fields appear on your cards, since Anki gives you complete flexibility to display the cards as you like.

One cool aspect about the site was that it has 8 different Japanese character archetypes who all speak differently. I have kept this aspect in the flashcards by indicating which character the card is for. There is also full audio, so you can hear the personal spin that each character puts on the phrases.

After studying the cards, there is still some cool stuff to go back on the website to do. For instance, they have several manga stories that you can read, which utilize all of the phrases and grammar.

Content difficulty is probably Upper Beginner – Intermediate. You should probably have at least a good command of JLPT N5 grammar before tackling these.

Grammar Deck

Phrase Deck (updated 5/3/17 to fix image links)

http://www.anime-manga.jp/

Extracting Subtitles from Netflix

Updated 11/05/2017

Having subtitle scripts from TV shows that you are watching is an excellent study aid. Not to mention that they can be used with Subs2SRS to easily import sentences into Anki! These days, many people tend to watch Netflix more than a lot of the traditional media. I’ve also seen numerous people talking about how the Netflix Original “Terrace House” is great for Japanese listening practice, because it is unscripted and captures natural dialog.

When I originally wrote this post, it was because I had discovered a way of ripping Japanese subtitles from Netflix, which to my knowledge, no one else had figured out how to do at the time. My method was long and clunky though. Eventually, a user named ahlawy posted in the comments section with details for a new method which was far superiod to the one I had come up with. And shortly after that, TITHEN-FIRION posted a tool that he had created which can largely automate the process altogether. So now, it is really quite simple to rip subtitles from Netflix, to the point that just about anyone can do it.

However, there is still one caveat: Netflix stores Japanese subtitles as images rather than text (though English and most other languages with simple character sets are already stored as text). So if you want Japanese subtitles in a text based format, you will have to use OCR to convert them. This process is a bit more technical and complicated, so it might be a little difficult for some people.

Download Subtitles I’ve Already Ripped

All of the Japanese subtitles that I have ripped have been OCR’ed using the Google Cloud Vision API. This is likely the most accurate Japanese OCR technology available at the moment, but the text still does contain a few mistakes here and there. So please keep this in mind if you are using these subtitles to study. If something looks wrong, it probably is. Go watch it on Netflix to see what the correct subtitle would look like.

You can download my Netflix subtitle pack from here [updated 11/05/2017].

It contains subtitles in both English and Japanese for all of the following shows:

  • Atelier (Underwear)
  • Good Morning Call
  • Hibana (Spark)
  • Midnight Diner: Tokyo Stories
  • Mischievous Kiss (Itazura na Kiss)
  • Mischievous Kiss 2 (Itazura na Kiss 2)
  • My Little Lover (Minami Kun No Koibito)
  • Terrace House: Boys and Girls in the City
  • Terrace House: Aloha State (Parts 1+2)
  • Pee Wee’s Big Holiday (Japanese subs for English language movie)
  • Stranger Things (Japanese subs for English language series)
  • Stranger Things 2 (Japanese subs for English language series)

If Netflix has another show that you would like Japanese subtitles for, then you will have to rip it for yourself using the guide below. If you successfuly rip and OCR them, post a link to them in the comments and I will be glad to add them to my package.

How to rip Japanese Subtitles from Netflix

Getting the subtitles from Netflix is quite simple now, due to a tool that does all the hard work for us! 

First, you will need to download an addon for your web browser which allows you to run userscripts. One such addon is called ViolentMonkey, and it works with either Firefox or Chrome. There are several other similar addons as well, such as TamperMonkey and GreaseMonkey. These all mostly do the same thing, so just pick one. A simple Google search for any of those titles should easily lead you to a page that lets you install it in your web browser.

Next, you want to install the Netflix Subtitle Downloader. After installing it, you will notice some new options appear inside the subtitle selection menu on the Netflix website. Simply select the subtitle language that you want, and then click on one of the download buttons. It’s that simple! You might need to give it a moment after clicking the button while it begins downloading.

 

How to OCR using Google Cloud Vision API

Note: the following guide assumes knownledge of how to use the command prompt.

There are several OCR tools out there that can handle Japanese text. Most of them suck and result in a lot of errors. Google’s OCR is by far the most accurate I have seen, and works quite well. Unfortunately, it’s only sort of free. According to their current pricing structure, you can OCR up to 1,000 images per month for free. Since a typical episode is a few hundred images, this is enough for a few episodes each month. However, Google also offers a great trial offer (at least at the time I write this). You can get $300 of free credit when you sign up, and you have no obligation pay anything or continue using the service. I opted for this option, and was able to OCR all of the episodes that you find in the download above while still having a lot of credit left over.  The free credit does expire if you don’t use it within a certain time.

If you sign up for the Google Cloud Platform, then after logging in, you first need to enable the Cloud Vision API. Just click the “Enable API” link at the top of your Dashboard, and then find “Vision API” under the “Google Cloud Machine Learning” heading. After that, you will also need to create an API key. Click “credentials” on the left side menu, and then click “create credentials”, and select “API Key”.

Now, we can use a python script created by “zx573” from the Kanji Koohii forums to actually perform the work of sending the images to Google and generating a text-based subtitle file. You will need a 2.7.x version of python (I don’t think it works on 3.x). You also need to install the packages Pillow and requests. This can be installed from the command line by typing:

pip install pillow
pip install requests

Next, you will need the python script, which you can grab from here. You will then need to open up the file in a text editor and insert your API Key into the line that says AUTH_KEY = “YOUR API KEY HERE”

Now, we can run this python script from the command line, with the path of the folder containing your subtitle images as an argument, like so:

python generate_srt_from_netflix.py “Terrace House – Boys & Girls in the City 01”

If all goes well, you should see it processing the images, and then it will finally spit out an SRT file named “output.srt” for you! However, these srt files will contain some errors which we need to fix up before they can be opened in other applications.

Note: if the script starts working, but throws out an error message before it completes, you may need to edit the python script to change the REQUEST_CHUNK_SIZE from 15 to a smaller value like 10 or even 5. Larger values should use up less of your credit but smaller values have a greater chance of completing sucessfully.

Additional Processing

The srt files will have a problem in that they do not always contain timestamps that include milliseconds, and most applications that edit srt files will expect there to be milliseconds. However, this is an easy fix, using software that lets you do search and replace using regular expressions. I use notepad++.

If you choose the Search > Find in Files menu option, you can search across all of your subtitles at once!

Set the directory to the location where your srt files are, and then if you want, you can set the filters to *.srt to avoid accidentally picking up any other files. Make sure the search mode is set to “regular expression” and the checkbox beside it is not checked.

Then, in the “Find what” field, you want to put: (\d\d:\d\d:\d\d,\d?\d?)(\s)
Replace with: \10\2

Press “replace in files”. Do this twice.

Then change “Find what” to: (\d\d:\d\d:\d\d)(\s)
Replace with: \1,000\2

Finally, press “replace in files” again. We have now corrected the srt files!

Hirogaru – Yet another source of beginner’s reading material!

I can’t believe how much reading material I have been finding recently. I remember my early days in Japanese, struggling to find anything at all that was on my level, but now I keep seeing more and more material becoming available. This latest resource is the newest website from The Japan Foundation. Called ひろがる、it launched in 2016 and seems to have at least 50-60 easy articles on it so far.

The level of the material seems to be aimed at those who have perhaps completed about one year of studying (able to pass JLPT N5, or completed the first Genki textbook), but may still be somewhat challenging for more advanced students as well, due to the diverse range of topics that the articles cover. Topics include:

  • Astronomy
  • Outdoors
  • Martial Arts
  • Tea
  • Sweets
  • Shopping
  • Calligraphy
  • Anime/Manga
  • Books
  • Temples
  • Music
  • Aquarium

Each topic generally contains about 4-5 articles that you can read. I believe that they may be adding new articles from time to time, but it does not seem to be at a very fast pace. Besides just the articles, there is usually a short video about each topic, as well as some short commentary from Japanese people saying what that topic means to them. For some reason, most topics also have a section containing pictures of food. There is also a comment section in each topic, which allows you to write a Japanese response to three different questions.

The articles are really the main attraction of this site, so let’s talk about those for a bit. Each article is fairly short, so that a beginner student could probably read it in 5 or 10 minutes. The articles are broken up into several paragraphs, and each paragraph has audio so you can hear it read aloud. At the end of each article you will find a quiz with a couple of multiple choice questions, to test your comprehension. At the top of the site, there are some controls which can assist you in reading the articles. One is a “Ruby” toggle, which turns furigana on or off for all of the kanji in the article. The other setting is an “English/Japanese” toggle. This seems to be poorly named, because it does not function how you might expect. If you set it to “English”, the articles remain fully in Japanese. The only thing that really changes is the navigation buttons, and also when it is set to English there will be a button under each paragraph that you can press to see a list of the difficult vocabulary. As such, I would recommend keeping it set to “English” at all times so you have access to the vocabulary words.

Overall its a nice site, and certainly worth spending some time on. My only real gripe is that the articles are kinda lame and boring (to me at least), but that’s sort of hard to avoid with these kinds of generic topics. But all in all, it’s a fantastic source of reading material at a level where such material has often been overlooked. Check it out!

Pibo – Even more children’s books on your smart device

So I recently wrote about EhonNavi, which lets you read thousands of Japanese Children’s books for free, but did you know that there is also another service called Pibo which has hundreds more completely different children’s books which can also be read for free?

Pibo is completely a separate service from EhonNavi, and offers some different pros and cons. First of all, while EhonNavi is primarily a site for desktop computers, Pibo is designed primarily for phones and tablets. Upon visiting their website, you will see prominent links to get the app from either the iTunes App store or the Google Play store. There is also no signup procedure–just download the app and you are ready to start using it!

While EhonNavi shows you scans of physical books, the books on Pibo are all digital. As such, the artwork is much more crisp and clear. The books on Pibo are also completely voiced. That’s right, you can follow along as the book is read aloud to you! There is also no limit to how many times a certain book can be read, unlike on EhonNavi, where you only get to read each book once. Also, like EhonNavi, books can be browsed according to their age level (although I feel that many books fall into too large of an age range).

There are also a few downsides to the service as well. For one thing, there is no apparent way to see which books you have read already. So if your goal is to read every book that is offered, you might need to keep a list yourself. The books are also always displayed in a completely random order, which exacerbates the problem further. I have created a list of every book title, which you can grab here (updated Feb 5, 2017). The number of books available is also significantly less than what you could find on EhonNavi. However, with nearly 400 available already (and growing!), that isn’t a huge problem.

So now, it’s worth mentioning how the service operates. When you first install the app, you get a 1 week free trial to read as much as you want. After that free trial is up, you can still read up to 3 books for free every day, which seems quite generous. You can also purchase a subscription for less than $5 per month, which allows you to read all you want. Seems like a pretty fair price to me.

All in all, I think this is a good complement to EhonNavi. You don’t have to choose either-or. They both work great together! When I am at my desktop, I use EhonNavi, and when I am on my phone, I read 3 books on Pibo. I urge everyone to check out both of these free services to try them out and get some reading practice!