tests package

Submodules

tests.datasourcetoolbox module

Created on 2021-07-29

@author: wf

class tests.datasourcetoolbox.DataSourceTest(methodName='runTest')

Bases: unittest.case.TestCase

test for EventDataSources

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

checkDataSource(eventDataSource: corpus.eventcorpus.EventDataSource, expectedSeries: int, expectedEvents: int, eventSample: Optional[str] = None)

check the given DataSource

Parameters

eventDataSource (EventDataSource) – the event data source to check

static getEventSeries(seriesAcronym: str)

Returns the event series as dict of lod (records are categorized into the different data sources)

Parameters

seriesAcronym – acronym of the series

Returns

dict of lod

inCI()

are we running in a Continuous Integration Environment?

classmethod main()

classmethod optionalDebug(args)

start the remote debugger if the arguments specify so

Parameters

args() – The command line arguments

setUp(debug=False, profile=True, timeLimitPerTest=10.0)

setUp test environment

tearDown()

Hook method for deconstructing the test fixture after testing it.

tests.testConfref module

Created on 2021-08-02

@author: wf

class tests.testConfref.TestConfRef(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test getting events from Confref http://portal.confref.org as a data source

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp()

setUp test environment

testConfRef()

test CrossRef as an event data source

tests.testCorpusLookup module

Created on 2021-07-26

@author: wf

class tests.testCorpusLookup.TestCorpusLookup(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test the event corpus

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

configureCorpusLookup(lookup: corpus.lookup.CorpusLookup)

callback to configure the corpus lookup

setUp(debug=False, profile=True, **kwargs)

setUp test environment

testDataSource4Table()

test getting datasources by table name

testGetDataSourceInfos()

test getting the infos for the datasources

testLookup()

test the lookup

testMultiQuery()

test getting entries for a given query

testViewDDL()

test the view DDL

tests.testCrossRef module

Created on 2021-08-02

@author: wf

class tests.testCrossRef.TestCrossRef(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test getting events from CrossRef https://www.crossref.org/ as a data source

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

prettyJson(d)

pretty print the given jsonStr

setUp()

setUp the test environment

testCrossRef()

test CrossRef as an event data source

testCrossRefEventFromDOI()

test creating CrossRefEvents via API

testCrossref_DOI_Lookup()

test crossref API access see https://github.com/WolfgangFahl/ProceedingsTitleParser/issues/28

testFixUmlauts()

workaround Umlaut issue see https://stackoverflow.com/questions/63486767/how-can-i-get-the-fuseki-api-via-sparqlwrapper-to-properly-report-a-detailed-err

tests.testDblpEvents module

Created on 28.07.2021

@author: wf

class tests.testDblpEvents.TestDblpEvents(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test the dblp data source

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

classmethod configureCorpusLookup(lookup: corpus.lookup.CorpusLookup)

callback to configure the corpus lookup

setUp(**kwargs)

setup

classmethod setUpClass()

Hook method for setting up class fixture before running tests in the class.

testDateRange()

test date Range parsing

testDblp()

test getting the conference series and events from dblp xml dump

testDblpDateFix()

test Dblp DateRange extraction/fixing

tests.testDblpXml module

Created on 2021-01-25

@author: wf

class tests.testDblpXml.TestDblp(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test the dblp xml parser and pylodstorage extraction for it

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

checkConfColumn(sqlDB)

check the conference columns

static getMockedDblp(mock=True, debug=False)

getSqlDB(mock=True, recreate=False)

get the Sql Database

log(msg)

mock = True

setUp(debug: bool = False, profile: bool = True, **kwargs)

setUp the test environment

especially the mocking parameter - if mock is False a multi-Gigabyte download might be activated

tearDown()

Hook method for deconstructing the test fixture after testing it.

testCreateSample()

test creating a sample file

testDblpDownload()

test dblp access

testDblpXmlParser()

test parsing the xml file

testIssue5()

https://github.com/WolfgangFahl/ConferenceCorpus/issues/5

dblp xml parser skips some proceedings titles

testQueries()

test the parameterized query

testSqlLiteDatabaseCreation()

get dict of list of dicts (tables)

testUml()

test generating the uml diagram for the entities

tests.testOpenResearch module

Created on 27.07.2021

@author: wf

class tests.testOpenResearch.TestOREventManager(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

Tests OREventManager

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug=False, profile=True, timeLimitPerTest=10.0)

setUp test environment

test_configure()

tests configuring OREventManager with different loading methods to retrieve the records from the source

test_fromWikiFileManager()

tests fromWikiFileManager

test_fromWikiUser()

tests fromWikiUser

test_getLodFrom()

tests the different loading methods Note: the functionality is tested in depth in TestOrSMW here only te enhancing of the records is tested

test_getPropertyLookup()

tests getPropertyLookup

class tests.testOpenResearch.TestOREventSeriesManager(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

Tests OREventSeriesManager

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug=False, profile=True, timeLimitPerTest=10.0)

setUp test environment

test_configure()

tests configuring OREventManager with different loading methods to retrieve the records from the source

test_fromWikiFileManager()

tests fromWikiFileManager

test_fromWikiUser()

tests fromWikiUser

test_getLodFrom()

tests the different loading methods Note: the functionality is tested in depth in TestOrSMW here only te enhancing of the records is tested

test_getPropertyLookup()

tests getPropertyLookup

class tests.testOpenResearch.TestOpenResearch(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test the access to OpenResearch

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug=False, profile=True, **kwargs)

setUp test environment

testAsCsv()

test csv export of events

testORDataSourceFromWikiFileManager()

tests the getting conferences form wiki markup files

testORDataSourceFromWikiUser()

tests initializing the OREventCorpus from wiki

class tests.testOpenResearch.TestOrSMW(methodName='runTest')

Bases: tests.basetest.BaseTest

tests OrSWM

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug: bool = False, profile: bool = True)

setUp test environment

test_getAskQuery()

tests getAskQuery

test_getAskQueryPageTitles()

tests getAskQueryPageTitles

test_getLodFromWikiApi()

tests getLodFromWikiApi

test_getLodFromWikiFiles()

tests getLodFromWikiFiles

test_getLodFromWikiMarkup()

tests getLodFromWikiMarkup

test_getLodFromWikiMarkup_queryAllEvents()

tests querying all events with getLodFromWikiApi to check if the query division works

test_normalizeProperties()

tests normalizeProperties

tests.testSMW module

class tests.testSMW.TestSMW

Bases: object

tests functionalities of the smw package provides helper functions for other tests

classmethod getSMW_WikiUser(wikiId='or', save=False)

get semantic media wiki users for SemanticMediawiki.org and openresearch.org

classmethod getWikiFileManager(wikiId=None, debug=False)

classmethod getWikiUser(wikiId=None)

static inPublicCI()

are we running in a public Continuous Integration Environment?

wikiId = 'orclone'

tests.testStatistics module

Created on 2021-07-31

@author: wf

class tests.testStatistics.TestStatistics(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test statistics

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug: bool = False, profile: bool = True, **kwargs)

setUp test environment

classmethod setUpClass()

Hook method for setting up class fixture before running tests in the class.

testIssue255()

test issue 255 problem list

testMultiQuery()

test MultiQuery

testStatistics()

test statistics

tests.testWebScrape module

Created on 2021-07-31

@author: wf

class tests.testWebScrape.TestWebScrape(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test getting rdfA based triples from Webpages

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

testCrawlType()

test CrawlType isValid

testWebScrape()

test getting rdfA encoded info from a webpage

tests.testWikiCfp module

Created on 2021-07-31

@author: wf

class tests.testWikiCfp.TestWikiCFP(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test WikiCFP data source

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug: bool = False, profile: bool = True, **kwargs)

setUp test environment

testWikiCFP()

test the WikiCFP lookup

tests.testWikiCfpScrape module

Created on 2020-08-20

@author: wf

class tests.testWikiCfpScrape.TestWikiCFP(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test events from WikiCFP

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

getTempJsonDir() → str

handleError(ex)

handle the given exception

Parameters

ex (Exception) – the exception to handle

printDelimiterCount(names)

print the count of the most common used delimiters in the given name list

setUp(debug: bool = False, profile: bool = True, **kwargs)

setUp test environment

testCrawlEvents()

test crawling a few events and storing the result to a json file

testCrawlEventsViaCommandLine()

test crawling via commandline

testCrawlFilesToJson()

test getting the crawlFiles content

testCrawlType()

test CrawlType enumeration

testCrawledJsonFiles()

get the crawl files

testEventScraping()

test scraping the given event

test “This item has been deleted” WikiCFP items

e.g. http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=3

testGettingEventSeriesForEvent()

test extracting the event series id from th event page

testGettingLatestEvent()

get the latest event Id with a binary search

testInvalidUrl()

make sure only valid urls are accepted

testJsonPickleDateTime()

test the JsonPickle datetime encoding mystery

testWikiCFP()

test event handling from WikiCFP

tests.testWikidata module

Created on 27.07.2021

@author: wf

class tests.testWikidata.TestWikiData(methodName='runTest')

Bases: tests.datasourcetoolbox.DataSourceTest

test wiki data access

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

setUp(debug: bool = False, profile: bool = True, **kwargs)

setUp test environment

testQueryManager()

test named query usage see https://github.com/WolfgangFahl/ConferenceCorpus/issues/45

testRegExp()

test Regexp handling for wikiedit

testWikidata()

test getting the wikiData Event Series

Module contents