Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Forum for discussing biblicalhumanities.org projects related to biblical Greek.
Post Reply
Jonathan Robie
Posts: 3224
Joined: May 5th, 2011, 5:34 pm
Location: Durham, NC
Contact:

Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Jonathan Robie » December 8th, 2017, 8:33 pm

I mentioned in another thread that I am working on an environment for exploring Greek syntax using the Lowfat trees and simple queries. I will be blogging about this soon, but this Jupyter notebook is a teaser for those who are curious:

Tutorial: Greek Syntax Queries using Lowfat and Jupyter Notebooks

I plan to integrate other resources from our biblicalhumanities.org dashboard into this environment.
ἐξίσταντο δὲ πάντες καὶ διηποροῦντο, ἄλλος πρὸς ἄλλον λέγοντες, τί θέλει τοῦτο εἶναι;
http://jonathanrobie.biblicalhumanities.org/

Jonathan Robie
Posts: 3224
Joined: May 5th, 2011, 5:34 pm
Location: Durham, NC
Contact:

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Jonathan Robie » December 11th, 2017, 12:45 pm

I have now added a blog post to explain what a Jupyter notebook is and how it is used, where it is used for Biblical Hebrew linguistics, etc.

Exploring Greek Syntax with Jupyter Notebooks
ἐξίσταντο δὲ πάντες καὶ διηποροῦντο, ἄλλος πρὸς ἄλλον λέγοντες, τί θέλει τοῦτο εἶναι;
http://jonathanrobie.biblicalhumanities.org/

Jonathan Robie
Posts: 3224
Joined: May 5th, 2011, 5:34 pm
Location: Durham, NC
Contact:

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Jonathan Robie » December 14th, 2017, 8:11 pm

I have now added the PROIEL treebank so that I can compare analyses between Lowfat and PROIEL or use whichever one seems to work best for looking at a given question. To make it easier to compare, I transformed it into constituency while maintaining the ids that represent dependency relations.

Here's the tutorial for using PROIEL:

Tutorial: Greek Syntax Queries using PROIEL and Jupyter Notebooks

I will blog about this soon. I expect to be adding other resources to this package.
ἐξίσταντο δὲ πάντες καὶ διηποροῦντο, ἄλλος πρὸς ἄλλον λέγοντες, τί θέλει τοῦτο εἶναι;
http://jonathanrobie.biblicalhumanities.org/

Kirk Lowery
Posts: 12
Joined: August 27th, 2013, 10:40 am

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Kirk Lowery » December 15th, 2017, 9:15 am

Feature (Documentation) request:

It would be helpful for those of us wanting to install the system to have a recipe for the install so that we can see the notebook working. I assume that the OS-dependent installation is of BaseX and Anaconda. That part for the three major platforms is straight forward for anyone used to installing software for their OS. But then...after that, what to do? I assume that the steps are the same whether your box has Windows, OSX or Linux. Or am I mistaken?

Just sayin', the learning curve for this is very steep if one has never used BaseX/Anaconda before. I'm nose-deep in reading documentation right now...
Kirk E. Lowery

Jonathan Robie
Posts: 3224
Joined: May 5th, 2011, 5:34 pm
Location: Durham, NC
Contact:

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Jonathan Robie » December 15th, 2017, 10:42 am

I hope to set up an environment where people can create Notebooks on the Internet without installing anything - this looks possible, but I haven't investigated everything thoroughly. I'm currently bringing resources into my own environment so I can make them available in that way.

If that fails, I'll probably make it available using Docker, which makes installs easy and OS-independent. I might do that anyway, for people who need to add their own resources or need to work offline. This approach would spare people installing a bunch of stuff and creating their own databases, but they would probably install Jupyter themselves. They could still add resources to their database on their system.

I don't want to worry about installation and deployment until this is just a little more mature, though. I think we're talking a month or two. I need to focus on developing the system I want to make available.

But that doesn't solve your problem right now, so here's a recipe:
  1. Get the Git repo, either using Git or as a zip file: https://github.com/biblicalhumanities/g ... -testament. You will need both syntax trees and the labnotes subdirectory, which contains the tutorials as Jupyter notebooks.
  2. Install BaseX: http://docs.basex.org/wiki/Startup
  3. Start the BaseX GUI, import the resources you need, one per database. If you want my tutorials to work out of the box, then import the Nestle1904 Lowfat Trees as a database named "nestle1904lowfat" and import the PROIEL Lowfat Trees as a database named "proiel-lowfat".
  4. Run the BaseX server, using default settings (that's what I use in the package right now).
  5. Install Jupyter: https://jupyter.org/install.html
ἐξίσταντο δὲ πάντες καὶ διηποροῦντο, ἄλλος πρὸς ἄλλον λέγοντες, τί θέλει τοῦτο εἶναι;
http://jonathanrobie.biblicalhumanities.org/

Jonathan Robie
Posts: 3224
Joined: May 5th, 2011, 5:34 pm
Location: Durham, NC
Contact:

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Jonathan Robie » December 17th, 2017, 3:44 pm

I just added contextualized English glosses from the Berean Interlinear Bible and a method that lets you see the morphology and gloss for each word in a verse or query result.

See this notebook.
ἐξίσταντο δὲ πάντες καὶ διηποροῦντο, ἄλλος πρὸς ἄλλον λέγοντες, τί θέλει τοῦτο εἶναι;
http://jonathanrobie.biblicalhumanities.org/

Kirk Lowery
Posts: 12
Joined: August 27th, 2013, 10:40 am

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Kirk Lowery » December 18th, 2017, 12:11 pm

Following Jonathan's install instructions, I was able to successfully get his Greek trees Jupyter notebook up and running. Attached is a screenshot for the skeptical. :ugeek:

If any of you are needing help with the install, let me know. Or, ask Jonathan. :twisted:

This was done on a Windows 10 box, with BaseX, Anaconda (for the Jupyter notebooks), and Chrome.
Attachments
GNTLowfatJupyter20171218.PNG
GNTLowfatJupyter20171218.PNG (119.27 KiB) Viewed 149 times
Kirk E. Lowery

Jonathan Robie
Posts: 3224
Joined: May 5th, 2011, 5:34 pm
Location: Durham, NC
Contact:

Re: Exploring Syntax with Lowfat Treebanks and Jupyter Notebooks

Post by Jonathan Robie » December 22nd, 2017, 6:13 pm

I added syntax diagrams using Boxwood today. Read this blog post: Showing Syntactic Structure with Boxwood. Or better yet, check out this notebook: Boxwood - Displaying the Syntactic Structure of a Sentence. Each one contains a quote from our own Barry Hofstetter.

This is the same format used in the Lowfat Syntax Tree Browser.
boxwood.png
boxwood.png (70.46 KiB) Viewed 84 times
ἐξίσταντο δὲ πάντες καὶ διηποροῦντο, ἄλλος πρὸς ἄλλον λέγοντες, τί θέλει τοῦτο εἶναι;
http://jonathanrobie.biblicalhumanities.org/

Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest