Notebook

In [1]:

%load_ext autoreload
%autoreload 2

Bug fix in writing tf data.¶

2022-02-02

Node features that have None values are written incorrectly to disk.

They should be written to disk as if the values were absent.

We test the fix.

In [2]:

from tf.app import use
A = use('annotation/banks:clone', checkout='clone', hoist=globals())

TF-app: ~/github/annotation/banks/app

data: ~/github/annotation/banks/tf/0.2

This is Text-Fabric 9.2.3
Api reference : https://annotation.github.io/text-fabric/tf/cheatsheet.html

10 features found and 0 ignored

Text-Fabric: Text-Fabric API 9.2.3, annotation/banks/app v3, Search Reference
Data: BANKS, Character table, Feature docs
Features:

Two quotes from Consider Phlebas by Iain M. Banks

author

str

the author of a book

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

gap

int

1 for words that occur between [ ], which are inserted by the editor

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

letters

str

the letters of a word

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

number

int

number of chapter, or sentence in chapter, or line in sentence

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

otype

str

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

punc

str

the punctuation after a word

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

remark:

a bit more info is needed

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

terminator

str

the last character of a line

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

title

str

the title of a book

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

oslots

none

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

Text-Fabric API: names N F E L T S C TF directly usable

In [9]:

meta = dict(
    valueType="str",
)
absent = {
    1: "aap",
    3: "mies",
}
none = {
    1: "aap",
    2: None,
    3: "mies",
}
absentnr = {
    1: "aap",
    2: "aap",
    5: "mies",
    6: "mies",
}
nonenr = {
    1: "aap",
    2: "aap",
    3: None,
    4: None,
    5: "mies",
    6: "mies",
}


TF.save(
    nodeFeatures=dict(absent=absent, none=none, absentnr=absentnr, nonenr=nonenr),
    metaData=dict(absent=meta, none=meta, absentnr=meta, nonenr=meta),
    location="~/github/annotation/banks/test",
)
A = use('annotation/banks:clone', checkout='clone', mod="annotation/banks/test:clone", hoist=globals())
for feat in ("absentnr", "nonenr"):
    TF.features[feat].save(overwrite=True, nodeRanges=True)

  0.00s Exporting 4 node and 0 edge and 0 config features to ~/github/annotation/banks/test/0.2:
   |     0.00s T absent               to ~/github/annotation/banks/test/0.2
   |     0.00s T absentnr             to ~/github/annotation/banks/test/0.2
   |     0.00s T none                 to ~/github/annotation/banks/test/0.2
   |     0.00s T nonenr               to ~/github/annotation/banks/test/0.2
  0.01s Exported 4 node features and 0 edge features and 0 config features to ~/github/annotation/banks/test/0.2

TF-app: ~/github/annotation/banks/app

data: ~/github/annotation/banks/tf/0.2

data: ~/github/annotation/banks/test/0.2

This is Text-Fabric 9.2.3
Api reference : https://annotation.github.io/text-fabric/tf/cheatsheet.html

14 features found and 0 ignored
   |     0.00s T absent               from ~/github/annotation/banks/test/0.2
   |     0.00s T absentnr             from ~/github/annotation/banks/test/0.2
   |     0.00s T none                 from ~/github/annotation/banks/test/0.2
   |     0.00s T nonenr               from ~/github/annotation/banks/test/0.2

Text-Fabric: Text-Fabric API 9.2.3, annotation/banks/app v3, Search Reference
Data: BANKS, Character table, Feature docs
Features:

annotation/banks/test

absent

str

dateWritten:

2022-02-02T12:49:52Z

writtenBy:

Text-Fabric

absentnr

str

dateWritten:

2022-02-02T12:49:52Z

writtenBy:

Text-Fabric

none

str

dateWritten:

2022-02-02T12:49:52Z

writtenBy:

Text-Fabric

nonenr

str

dateWritten:

2022-02-02T12:49:52Z

writtenBy:

Text-Fabric

Two quotes from Consider Phlebas by Iain M. Banks

author

str

the author of a book

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

gap

int

1 for words that occur between [ ], which are inserted by the editor

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

letters

str

the letters of a word

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

number

int

number of chapter, or sentence in chapter, or line in sentence

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

otype

str

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

punc

str

the punctuation after a word

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

remark:

a bit more info is needed

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

terminator

str

the last character of a line

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

title

str

the title of a book

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

oslots

none

compiler:

Dirk Roorda

dateWritten:

2020-02-13T13:37:47Z

name:

Culture quotes from Iain Banks

purpose:

exposition

source:

Good Reads

status:

with for similarities in a separate module

url:

https://www.goodreads.com/work/quotes/14366-consider-phlebas

version:

0.2

writtenBy:

Text-Fabric

Text-Fabric API: names N F E L T S C TF directly usable

sets={'aap': [1, 2], 'mies': [5, 6]}
   |     0.00s T absentnr             to ~/github/annotation/banks/test/0.2
sets={'aap': [1, 2], 'mies': [5, 6]}
   |     0.00s T nonenr               to ~/github/annotation/banks/test/0.2

In [10]:

F.absent.items()

Out[10]:

dict_items([(1, 'aap'), (3, 'mies')])

In [11]:

F.none.items()

Out[11]:

dict_items([(1, 'aap'), (3, 'mies')])

In [12]:

F.absentnr.items()

Out[12]:

dict_items([(1, 'aap'), (2, 'aap'), (5, 'mies'), (6, 'mies')])

In [13]:

F.nonenr.items()

Out[13]:

dict_items([(1, 'aap'), (2, 'aap'), (5, 'mies'), (6, 'mies')])

In [ ]: