PNG2SRT (tool to OCR image subtitles)

Download on Github

This is a tool that can perform OCR (optical character recognition) on XML/PNG subtitles and output the result as an SRT file. This can be used for subtitles obtained from DVD and Blu-ray. The Google Cloud Vision API is used for the OCR, and it has very good accuracy. This program is based on a python script originally posted by zx573 on the kanji koohii forums.

Before using this program, you may need to get your subtitles into the XML/PNG format. For DVD or Blu-ray, I’m not going to write a detailed guide on ripping subtitles from the disc, as there are plenty of other guides out there on the internet. It is assumed that you can figure out how to obtain your subtitles as SUB/IDX or SUP format. From there, I recommend using a Windows program called Subtitle Edit to convert them into XML/PNG format. There may be other software that can do this, but Subtitle Edit is the one I am most familiar with.

Using Subtitle Edit to convert DVD or Blu-ray subs to XML/PNG

The File menu in Subtitle Edit has several options to import your Subtitles that are in SUB/IDX or SUP format. Just choose the appropriate one, and then you will come to an import screen. From here, you just need to right-click on one of the subtitle lines, then select Export > BDN xml/png.

Then on the next screen then comes up, you just want to select “export all lines”, and select a folder to save to.

Now you should have a folder containing a bunch of PNG images and an XML file. The next step is to create an API key on the Google Cloud Platform.

Create an API Key for Google Cloud Vision API

Google’s OCR is by far the most accurate I have seen, and works quite well. It is also free for a limited amount of use each month. According to their current pricing structure, you can OCR up to 1,000 items per month for free. My program can batch several PNG images into a single item, so you should be able to do several episodes or movies in a single month without having to pay anything. Google also offers a great trial offer (at least at the time I write this). You can get $300 of free credit when you sign up, and you have no obligation pay anything or continue using the service.

If you sign up for the Google Cloud Platform, then after logging in, you need to enable the Cloud Vision API and generate an API key.

  1. In the left hand menu, select APIs & Services > Dashboard
  2. Select Enable APIs & Services
  3. In the search box, type “vision”, and then select Google Cloud Vision API.
  4. Select Enable. It may walk you through setting up a billing profile at this point if one has not been created already. Again, there is no obligation to actually pay anything, as you can use this API a certain amount for free each month, and you may get free credits when signing up.
  5. Back at the APIs & Services Dashboard, select Credentials > Create Credentials > API Key.
  6. Once you have generated the API key, be sure to copy it or keep it open in your browser so you can access it later.

Use PNG2SRT to OCR the images

Now, we can use PNG2SRT to send the subtitle images through the Cloud Vision API.

Download

Version 1.0.1 – May 12, 2018

Download on Github

Download the appropriate version for your computer, and then extract the archive.

Next, you need to paste your API Key into a text file named API_KEY.txt located in the same folder as the application (the file should contain ONLY your API key, and no other text).

When you run the application, it should look like this:

First, you need to make sure that your API Key is displayed correctly in the top area. If not, make sure you did the previous step correctly.

Then, you just select a folder containing XML/PNG files, which is what will be converted to SRT.

Note: You may get an error if the folder name contains unicode characters. In that case, please rename the folder to use English characters.

There is also an option to select the language that you want Google to recognize. It defaults to Japanese, because that is what I use, but you can select whichever language you need. You can find a full list of language codes here.

The only other option is the chunk size. The default of 15 is usually fine. If you press the start button, and the program appears to begin working but then gives you an error message part way through, you might need to decrease the chunk size to a smaller value like 10 or even 5.

After you press start, if all goes well, the program should run and it will output an SRT file inside your input folder.

anime-manga.jp Anki Decks

Some time ago, The Japan Foundation created a website to help Japanese students learn the type of Japanese that is often heard in anime and manga. While it’s got some decent content, I’ve rarely ever heard anyone mention the site. That’s probably because they stuck all of the content into a crappy flash application. You can’t view it on mobile, you can’t copy and paste text, you can’t resize it, you can’t do ANYTHING useful.

So, I dumped some of their content into Anki decks so that it would be possible to actually learn something from it. I have made a deck containing phrases, and a deck with grammar points. This is only a portion of the total content from the site, but I felt that these parts would probably be the most useful and work the best in a flashcard format.

The grammar deck in particular is a bit dense with all of the information available, but I thought it best to put too much info rather than too little. You can of course customize which fields appear on your cards, since Anki gives you complete flexibility to display the cards as you like.

One cool aspect about the site was that it has 8 different Japanese character archetypes who all speak differently. I have kept this aspect in the flashcards by indicating which character the card is for. There is also full audio, so you can hear the personal spin that each character puts on the phrases.

After studying the cards, there is still some cool stuff to go back on the website to do. For instance, they have several manga stories that you can read, which utilize all of the phrases and grammar.

Content difficulty is probably Upper Beginner – Intermediate. You should probably have at least a good command of JLPT N5 grammar before tackling these.

Grammar Deck

Phrase Deck (updated 5/3/17 to fix image links)

http://www.anime-manga.jp/

Extracting Subtitles from Netflix with Netflix Subtitle Downloader

Article Updated 1/9/2019

I now recommend using the Subadub extension for studying Japanese on Netflix. The information below is still useful if you would like to batch-download subtitles for an entire series.

Having subtitle scripts from TV shows that you are watching is an excellent study aid. Not to mention that they can be used with Subs2SRS to easily import sentences into Anki! These days, many people tend to watch Netflix more than a lot of the traditional media. I’ve also seen numerous people talking about how the Netflix Original “Terrace House” is great for Japanese listening practice, because it is unscripted and captures natural dialog.

How to rip Japanese Subtitles from Netflix

First, you will need to download an addon for your web browser which allows you to run userscripts. One such addon is called ViolentMonkey, and it works with either Firefox or Chrome (as well as some other browsers). There are several other similar addons as well, such as TamperMonkey and GreaseMonkey. These all mostly do the same thing, so just pick one. A simple Google search for any of those titles should easily lead you to a page that lets you install it in your web browser.

Next, you want to install the Netflix Subtitle Downloader. After installing it, you will notice some new options appear inside the subtitle selection menu on the Netflix website. Simply select the subtitle language that you want, and then click on one of the download buttons. It’s that simple! You might need to give it a moment after clicking the button while it begins downloading.

A recent update of this tool now lets it download subtitles for all available languages at once. Subtitles are downloaded in VTT format, and can be converted to SRT or other formats using SubtitleEdit.

Hirogaru – Yet another source of beginner’s reading material!

I can’t believe how much reading material I have been finding recently. I remember my early days in Japanese, struggling to find anything at all that was on my level, but now I keep seeing more and more material becoming available. This latest resource is the newest website from The Japan Foundation. Called ひろがる、it launched in 2016 and seems to have at least 50-60 easy articles on it so far.

The level of the material seems to be aimed at those who have perhaps completed about one year of studying (able to pass JLPT N5, or completed the first Genki textbook), but may still be somewhat challenging for more advanced students as well, due to the diverse range of topics that the articles cover. Topics include:

  • Astronomy
  • Outdoors
  • Martial Arts
  • Tea
  • Sweets
  • Shopping
  • Calligraphy
  • Anime/Manga
  • Books
  • Temples
  • Music
  • Aquarium

Each topic generally contains about 4-5 articles that you can read. I believe that they may be adding new articles from time to time, but it does not seem to be at a very fast pace. Besides just the articles, there is usually a short video about each topic, as well as some short commentary from Japanese people saying what that topic means to them. For some reason, most topics also have a section containing pictures of food. There is also a comment section in each topic, which allows you to write a Japanese response to three different questions.

The articles are really the main attraction of this site, so let’s talk about those for a bit. Each article is fairly short, so that a beginner student could probably read it in 5 or 10 minutes. The articles are broken up into several paragraphs, and each paragraph has audio so you can hear it read aloud. At the end of each article you will find a quiz with a couple of multiple choice questions, to test your comprehension. At the top of the site, there are some controls which can assist you in reading the articles. One is a “Ruby” toggle, which turns furigana on or off for all of the kanji in the article. The other setting is an “English/Japanese” toggle. This seems to be poorly named, because it does not function how you might expect. If you set it to “English”, the articles remain fully in Japanese. The only thing that really changes is the navigation buttons, and also when it is set to English there will be a button under each paragraph that you can press to see a list of the difficult vocabulary. As such, I would recommend keeping it set to “English” at all times so you have access to the vocabulary words.

Overall its a nice site, and certainly worth spending some time on. My only real gripe is that the articles are kinda lame and boring (to me at least), but that’s sort of hard to avoid with these kinds of generic topics. But all in all, it’s a fantastic source of reading material at a level where such material has often been overlooked. Check it out!

Pibo – Even more children’s books on your smart device

So I recently wrote about EhonNavi, which lets you read thousands of Japanese Children’s books for free, but did you know that there is also another service called Pibo which has hundreds more completely different children’s books which can also be read for free?

Pibo is completely a separate service from EhonNavi, and offers some different pros and cons. First of all, while EhonNavi is primarily a site for desktop computers, Pibo is designed primarily for phones and tablets. Upon visiting their website, you will see prominent links to get the app from either the iTunes App store or the Google Play store. There is also no signup procedure–just download the app and you are ready to start using it!

While EhonNavi shows you scans of physical books, the books on Pibo are all digital. As such, the artwork is much more crisp and clear. The books on Pibo are also completely voiced. That’s right, you can follow along as the book is read aloud to you! There is also no limit to how many times a certain book can be read, unlike on EhonNavi, where you only get to read each book once. Also, like EhonNavi, books can be browsed according to their age level (although I feel that many books fall into too large of an age range).

There are also a few downsides to the service as well. For one thing, there is no apparent way to see which books you have read already. So if your goal is to read every book that is offered, you might need to keep a list yourself. The books are also always displayed in a completely random order, which exacerbates the problem further. I have created a list of every book title, which you can grab here (updated Feb 5, 2017). The number of books available is also significantly less than what you could find on EhonNavi. However, with nearly 400 available already (and growing!), that isn’t a huge problem.

So now, it’s worth mentioning how the service operates. When you first install the app, you get a 1 week free trial to read as much as you want. After that free trial is up, you can still read up to 3 books for free every day, which seems quite generous. You can also purchase a subscription for less than $5 per month, which allows you to read all you want. Seems like a pretty fair price to me.

All in all, I think this is a good complement to EhonNavi. You don’t have to choose either-or. They both work great together! When I am at my desktop, I use EhonNavi, and when I am on my phone, I read 3 books on Pibo. I urge everyone to check out both of these free services to try them out and get some reading practice!