eu.slipo.athenarc.triplegeo.utils

Class Assistant

java.lang.Object

eu.slipo.athenarc.triplegeo.utils.Assistant

public class Assistant
extends java.lang.Object

Assistance class with various helper methods used in transformation or reverse transformation.

Version:

2.0

Author:

Kostas Patroumpas

Field Summary

Fields

Modifier and Type	Field and Description
private static Configuration	currentConfig
private java.text.DecimalFormat	decDateFormatter
private static com.vividsolutions.jts.geom.Geometry	extent
private java.text.SimpleDateFormat	gmtDateFormat
private static java.util.Set<java.lang.String>	ISO_LANGUAGES
private com.ibm.icu.text.Transliterator	latinTransliterator
private static Expr	logicalFilter
private static com.vividsolutions.jts.geom.Envelope	mbr
private java.util.concurrent.atomic.AtomicLong	numberGenerator
PGDBDecoder	pgdbDecoder
private java.text.SimpleDateFormat	standardDateFormat
com.vividsolutions.jts.io.WKTReader	wktReader

Constructor Summary

Constructors

Constructor and Description
Assistant() Constructor of the class without explicit declaration of configuration settings.
Assistant(Configuration config) Constructor of the class with explicit declaration of configuration settings.

Method Summary

Modifier and Type	Method and Description
void	addLineString(com.vividsolutions.jts.geom.LineString lineString, com.vividsolutions.jts.operation.polygonize.Polygonizer polygonizer) Add the linestring given to the polygonizer
void	addPolygon(com.vividsolutions.jts.geom.Polygon polygon, com.vividsolutions.jts.operation.polygonize.Polygonizer polygonizer) Add all line strings from the polygon given to the polygonizer
java.lang.Object	applyRuntimeMethod(java.lang.String methodName, java.lang.Object[] args) Applies a function at runtime, based on user-defined YML specifications regarding an attribute.
java.lang.String	blob2WKT(java.sql.Blob blob, org.opengis.referencing.operation.MathTransform transform) Transforms a BLOB representation of a geometry contained in an ESRI personal geodatabase (.mdb) into WKT.
boolean	check_ShapefileFolder(java.lang.String inputFolder) Checks if the the input is correct.
private boolean	check_ShapeFiles(java.lang.String inputFolder) Checks if folder contains the necessary files of Shapefile.
void	cleanupFilesInDir(java.lang.String path) Removes all files from a given directory.
java.lang.String	concatenate(java.lang.String[] values) Built-in function that concatenates an array of multiple string values into a unified one.
java.lang.String	concatenate(java.lang.String val1, java.lang.String val2) Built-in function that concatenates a pair of string values into a new one.
java.lang.String	convertInputStreamToString(java.io.InputStream is) Returns a String with the content of the InputStream
java.io.InputStream	convertStringToInputStream(java.lang.String string) Returns an InputStream with the content of the given string.
java.lang.String	createDirectory(java.lang.String path) Creates a temporary directory under the specified path.
java.lang.String	encodeUTF(java.lang.String s, java.lang.String encoding) Provides a UTF-8 encoding of the given string originally represented in the given encoding
boolean	filterContains(java.lang.String wkt) Specify a topological filter (CONTAINS) against input geometries in order to exclude transformation of those outside a user-specified spatial extent.
boolean	filterThematic(java.util.Map<java.lang.String,java.lang.String> record) Evaluates a thematic filter (logical expression) over an input data record.
java.lang.String	geometry2WKT(com.vividsolutions.jts.geom.Geometry g, java.lang.String geomOntology) Provides the Well-Known Text representation of a geometry for its inclusion as literal in RDF triples.
com.vividsolutions.jts.geom.Geometry	geomFlatTransform(com.vividsolutions.jts.geom.Geometry g, int srid) Projects the given geometry to a flat Cartesian plane
com.vividsolutions.jts.geom.Geometry	geomTransform(com.vividsolutions.jts.geom.Geometry g, org.opengis.referencing.operation.MathTransform transform) Transforms an original geometry into another CRS (reprojection).
com.vividsolutions.jts.geom.Geometry	geomTransformWGS84(java.lang.String wkt, int srid) Reprojects a given geometry into the WGS84 (lon/lat) coordinate reference system
com.vividsolutions.jts.geom.Geometry	geomValidate(com.vividsolutions.jts.geom.Geometry geom) Get / create a valid version of the geometry given.
double	getArea(java.lang.String polygonWKT) Returns the area of a polygon geometry from its the Well-Known Text representation.
double	getArea(java.lang.String polygonWKT, int srid) Built-in function that returns the area of a polygon geometry from its the Well-Known Text representation.
java.lang.String	getDataSource() Built-in function that identifies the provider of the dataset as specified in the configuration settings.
java.lang.String	getFileFromShapefile(java.lang.String extension, java.lang.String inputFolder) Returns the absolute path of the requested file from the shapefile collection.
com.vividsolutions.jts.geom.Geometry	getFilterExtent() Returns the geometry that represents the spatial filter that is being applied to select features from the input dataset.
java.lang.String	getGeoHash(double lon, double lat, int precision) Encode a geographic location into a short string of letters and digits, according to http://geohash.org/
java.lang.String	getGMTime() Get the current time (in the GMT time zone) to be used in user notifications.
java.lang.String	getLanguage(java.lang.String attr, int i) Built-in function that extracts the language tag from an attribute name.
double	getLatitude(com.vividsolutions.jts.geom.Geometry g) Calculate the latitude at the centroid of the geometry
double	getLength(java.lang.String wkt) Returns the length of a linestring or the perimeter of a polygon geometry from its the Well-Known Text representation.
double	getLength(java.lang.String wkt, int srid) Built-in function that returns the length of a linestring or the perimeter of a polygon geometry from its the Well-Known Text representation.
Expr	getLogicalExpression(java.lang.String condition) Returns a logical expression to be evaluated against a record (represented as a Map with key-value pairs); evaluation returns a boolean value.
double	getLongitude(com.vividsolutions.jts.geom.Geometry g) Calculate the longitude at the centroid of the geometry
double[]	getLonLatCoords(java.lang.String wkt, int srid) Built-in function that returns a pair of lon/lat coordinates (in WGS84) of a geometry as calculated from its the Well-Known Text representation.
com.vividsolutions.jts.geom.Envelope	getMBR() Provides the MBR of the geographic dataset that has been transformed.
long	getNextSerial() Provides the next serial number (long) to be used as an intermediate identifier
java.lang.String	getOutputExtension(java.lang.String serialization) Determines the file extension of the output file(s), depending on the RDF serialization.
java.lang.String	getRandomUUID() Built-in function that provides a UUID (Universally Unique Identifier) that represents a 128-bit long value to be used in the URI of a transformed feature.
org.apache.jena.riot.Lang	getRDFLang(java.lang.String serialization) Determines the serialization mode in the output RDF triples.
org.openrdf.rio.RDFFormat	getRDFSerialization(java.lang.String serialization) Determines the serialization mode in the output RDF triples.
java.lang.String	getResourceType(java.lang.String val) Built-in function that assigns a value as the type of a resource.
java.lang.String	getTransliteration(java.lang.String val) Built-in function that provides a transliteration into phonetically equivalent Latin characters of a string literal written in a non-Latin alphabet.
java.lang.String	getUUID(java.lang.String id) Built-in function that provides a UUID (Universally Unique Identifier) that represents a 128-bit long value to be used in the URI of a transformed feature.
java.lang.String	getUUID(java.lang.String featureSource, java.lang.String id) Built-in function that provides a UUID (Universally Unique Identifier) that represents a 128-bit long value to be used in the URI of a transformed feature.
boolean	hasSpatialExtent() Check whether there is a user-specified spatial filter (CONTAINS) against input data.
boolean	hasSQLFilter() Check whether there is a user-specified SQL filter against input data.
boolean	initPGDBDecoder() Instantiates a new PGDBDecoder for geometries from a Personal ESRI geodatabase (MS Access format).
boolean	isNullOrEmpty(java.lang.String text) Examines whether a given string is null or empty (blank).
boolean	isValidISOLanguage(java.lang.String s) Checks if the given string represents a valid ISO 639-1 language code (2 digits)
java.lang.String	keepOriginalID(java.lang.String id) Build-in function that retains the original identifier of a feature in the resulting URI or the transformed resource.
void	mergeFiles(java.util.List<java.lang.String> inputFiles, java.lang.String outputFile) Merges several input files into a single output file.
void	notifyProgress(int numRec) Notifies the user about progress in parsing input records.
void	notifyProgress(int numRec, int partition_index) Notifies the user about progress in parsing input records.
private java.lang.String	printMBR(com.vividsolutions.jts.geom.Envelope mbr) Prints the MBR of the transformed geometries.
java.lang.String	removeDirectory(java.lang.String path) Removes a given directory and all its contents.
void	reportStatistics(long dt, int numRec, int rejectedRec, int numTriples, java.lang.String serialization, java.util.Map<java.lang.String,java.lang.Integer> attrStatistics, com.vividsolutions.jts.geom.Envelope mbr, java.lang.String mode, java.lang.String targetSRID, java.lang.String outputFile) Report statistics upon termination of the reverse transformation process.
void	reportStatistics(long dt, int numRec, int rejectedRec, int numTriples, java.lang.String serialization, java.util.Map<java.lang.String,java.lang.Integer> attrStatistics, com.vividsolutions.jts.geom.Envelope mbr, java.lang.String mode, java.lang.String targetSRID, java.lang.String outputFile, int partition_index) Report statistics upon termination of the transformation process.
void	saxonTransform(java.lang.String sourcePath, java.lang.String xsltPath, java.lang.String resultPath) Simple transformation method using Saxon XSLT 2.0 processor.
java.lang.String	standardizeDate(java.lang.String val, java.lang.String format) Convert a date value from its original format into a standard timestamp value.
java.lang.String	standardizePhoneNumber(java.lang.String phone, java.lang.String country_code) Built-in function that brings phone numbers into a consistent format.
com.vividsolutions.jts.geom.Geometry	toPolygonGeometry(java.util.Collection<com.vividsolutions.jts.geom.Polygon> polygons, com.vividsolutions.jts.geom.GeometryFactory factory) Get a geometry from a collection of polygons.
void	updateMBR(com.vividsolutions.jts.geom.Geometry g) Updates the MBR of the geographic dataset as this is being transformed.
com.vividsolutions.jts.geom.Geometry	WKT2Geometry(java.lang.String wkt) Returns the internal geometry representation according to its Well-Known Text serialization.
com.vividsolutions.jts.geom.Geometry	WKT2GeometryTransform(java.lang.String wkt, org.opengis.referencing.operation.MathTransform transform, com.vividsolutions.jts.io.WKTReader wktReader) Provides the internal geometry representation based on its the Well-Known Text, also applying transformation into another CRS (if required).
java.lang.String	wktTransform(java.lang.String wkt, org.opengis.referencing.operation.MathTransform transform) Transforms a WKT representation of a geometry into another CRS (reprojection).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

pgdbDecoder

public PGDBDecoder pgdbDecoder

wktReader

public com.vividsolutions.jts.io.WKTReader wktReader

mbr

private static com.vividsolutions.jts.geom.Envelope mbr

extent

private static com.vividsolutions.jts.geom.Geometry extent

logicalFilter

private static Expr logicalFilter

currentConfig

private static Configuration currentConfig

ISO_LANGUAGES

private static java.util.Set<java.lang.String> ISO_LANGUAGES

numberGenerator

private java.util.concurrent.atomic.AtomicLong numberGenerator

standardDateFormat

private java.text.SimpleDateFormat standardDateFormat

gmtDateFormat

private java.text.SimpleDateFormat gmtDateFormat

decDateFormatter

private java.text.DecimalFormat decDateFormatter

latinTransliterator

private com.ibm.icu.text.Transliterator latinTransliterator

Constructor Detail

Assistant

public Assistant()

Constructor of the class without explicit declaration of configuration settings.

Assistant

public Assistant(Configuration config)

Constructor of the class with explicit declaration of configuration settings.

Method Detail

getRDFSerialization

public org.openrdf.rio.RDFFormat getRDFSerialization(java.lang.String serialization)

Determines the serialization mode in the output RDF triples. Applicable in the RML transformation mode.

Parameters:

serialization - A string with the user-specified serialization.

Returns:

The RDFFormat to be used in the serialization.

getRDFLang

public org.apache.jena.riot.Lang getRDFLang(java.lang.String serialization)

Determines the serialization mode in the output RDF triples. Applicable in GRAPH/STREAM transformation modes.

Parameters:

serialization - A string with the user-specified serialization.

Returns:

The RIOT language to be used in the serialization.

getOutputExtension

public java.lang.String getOutputExtension(java.lang.String serialization)

Determines the file extension of the output file(s), depending on the RDF serialization.

Parameters:

serialization - A string with the user-specified serialization.

Returns:

isNullOrEmpty

public boolean isNullOrEmpty(java.lang.String text)

Examines whether a given string is null or empty (blank).

Parameters:

text - The input string

Returns:

True if the parameter is null or empty; otherwise, False.

hasSpatialExtent

public boolean hasSpatialExtent()

Check whether there is a user-specified spatial filter (CONTAINS) against input data.

Returns:

True, if spatial filter has been specified; False, otherwise.

hasSQLFilter

public boolean hasSQLFilter()

Check whether there is a user-specified SQL filter against input data. This includes the option of thematic filter against geographical vector files.

Returns:

True, if SQL filter has been specified; False, otherwise.

convertInputStreamToString

public java.lang.String convertInputStreamToString(java.io.InputStream is)
                                            throws java.io.IOException

Returns a String with the content of the InputStream

Parameters:

is - the InputStream.

Returns:

A string with the content of the InputStream.

Throws:

java.io.IOException

convertStringToInputStream

public java.io.InputStream convertStringToInputStream(java.lang.String string)

Returns an InputStream with the content of the given string.

Parameters:

string - A string to be converted.

Returns:

InputStream with the string value.

getGMTime

public java.lang.String getGMTime()

Get the current time (in the GMT time zone) to be used in user notifications.

Returns:

A timestamp value as string.

notifyProgress

public void notifyProgress(int numRec)

Notifies the user about progress in parsing input records.

Parameters:

numRec - The number of records processed so far.

notifyProgress

public void notifyProgress(int numRec,
                           int partition_index)

Notifies the user about progress in parsing input records. This method is used when running over Spark/GeoSpark.

Parameters:

numRec - The number of records processed so far.

partition_index - The index of the partition.

reportStatistics

public void reportStatistics(long dt,
                             int numRec,
                             int rejectedRec,
                             int numTriples,
                             java.lang.String serialization,
                             java.util.Map<java.lang.String,java.lang.Integer> attrStatistics,
                             com.vividsolutions.jts.geom.Envelope mbr,
                             java.lang.String mode,
                             java.lang.String targetSRID,
                             java.lang.String outputFile,
                             int partition_index)

Report statistics upon termination of the transformation process.

Parameters:

dt - The clock time (in milliseconds) elapsed since the start of transformation process.

numRec - The total number of input records that have been processed.

rejectedRec - The total number of input records that were rejected during processing.

numTriples - The number of RDF triples resulted from transformation.

serialization - A string with the user-specified serialization of output triples.

attrStatistics - Statistics collected per attribute during transformation.

mbr - The MBR of transformed geometries (in WGS1984 georeference).

mode - Transformation mode, as specified in the configuration.

targetSRID - Output spatial reference system (CRS).

outputFile - Path to the output file containing the RDF triples.

partition_index - The identifier (index) of the partition in case of Spark execution.

reportStatistics

public void reportStatistics(long dt,
                             int numRec,
                             int rejectedRec,
                             int numTriples,
                             java.lang.String serialization,
                             java.util.Map<java.lang.String,java.lang.Integer> attrStatistics,
                             com.vividsolutions.jts.geom.Envelope mbr,
                             java.lang.String mode,
                             java.lang.String targetSRID,
                             java.lang.String outputFile)

Report statistics upon termination of the reverse transformation process.

Parameters:

dt - The clock time (in milliseconds) elapsed since the start of transformation process.

numRec - The total number of input records that have been processed.

rejectedRec - The total number of input records that were rejected during processing.

numTriples - The number of RDF triples resulted from transformation.

serialization - A string with the user-specified serialization of output triples.

attrStatistics - Statistics collected per attribute during transformation.

mbr - The MBR of transformed geometries (in WGS1984 georeference).

mode - Transformation mode, as specified in the configuration.

targetSRID - Output spatial reference system (CRS).

outputFile - Path to the output file containing the RDF triples.

removeDirectory

public java.lang.String removeDirectory(java.lang.String path)

Removes a given directory and all its contents. Used for removing intermediate files created during transformation.

Parameters:

path - The path to the directory.

Returns:

The path to a temporary directory that holds intermediate files.

cleanupFilesInDir

public void cleanupFilesInDir(java.lang.String path)

Removes all files from a given directory. Used for removing intermediate files created during transformation.

Parameters:

path - The path to the directory.

createDirectory

public java.lang.String createDirectory(java.lang.String path)

Creates a temporary directory under the specified path. Used for holding intermediate files created during transformation.

Parameters:

path - The path to the directory.

Returns:

The path to a temporary directory that holds intermediate files.

saxonTransform

public void saxonTransform(java.lang.String sourcePath,
                           java.lang.String xsltPath,
                           java.lang.String resultPath)

Simple transformation method using Saxon XSLT 2.0 processor.

Parameters:

sourcePath - Absolute path to source GML file.

xsltPath - Absolute path to XSLT file.

resultPath - Absolute path to the resulting RDF file.

updateMBR

public void updateMBR(com.vividsolutions.jts.geom.Geometry g)

Updates the MBR of the geographic dataset as this is being transformed.

Parameters:

g - Geometry that will be checked for possible expansion of the MBR of all features processed thus far

getMBR

public com.vividsolutions.jts.geom.Envelope getMBR()

Provides the MBR of the geographic dataset that has been transformed.

Returns:

The MBR of the transformed geometries.

printMBR

private java.lang.String printMBR(com.vividsolutions.jts.geom.Envelope mbr)

Prints the MBR of the transformed geometries.

Returns:

A string with the coordinates of the two anti-diagonal points defining the MBR.

wktTransform

public java.lang.String wktTransform(java.lang.String wkt,
                                     org.opengis.referencing.operation.MathTransform transform)

Transforms a WKT representation of a geometry into another CRS (reprojection).

Parameters:

wkt - Input geometry in Well-Known Text.

transform - Parameters for the transformation, including source and target CRS.

Returns:

WKT of the transformed geometry.

geomTransform

public com.vividsolutions.jts.geom.Geometry geomTransform(com.vividsolutions.jts.geom.Geometry g,
                                                          org.opengis.referencing.operation.MathTransform transform)

Transforms an original geometry into another CRS (reprojection).

Parameters:

g - Input geometry

transform - Parameters for the transformation, including source and target CRS

Returns:

the transformed geometry

geomTransformWGS84

public com.vividsolutions.jts.geom.Geometry geomTransformWGS84(java.lang.String wkt,
                                                               int srid)

Reprojects a given geometry into the WGS84 (lon/lat) coordinate reference system

Parameters:

wkt - Well-Known Text of the input geometry

srid - EPSG code of the coordinate reference system (CRS) of the geometry

Returns:

Geometry reprojected into WG84 system

geomFlatTransform

public com.vividsolutions.jts.geom.Geometry geomFlatTransform(com.vividsolutions.jts.geom.Geometry g,
                                                              int srid)

Projects the given geometry to a flat Cartesian plane

Parameters:

g - Input geometry

srid - EPSG code of the coordinate reference system (CRS) of the geometry

Returns:

Projected geometry to a flat Cartesian plane

initPGDBDecoder

public boolean initPGDBDecoder()

Instantiates a new PGDBDecoder for geometries from a Personal ESRI geodatabase (MS Access format).

Returns:

True, if a PGDBDecoder instance was created; otherwise, False.

blob2WKT

public java.lang.String blob2WKT(java.sql.Blob blob,
                                 org.opengis.referencing.operation.MathTransform transform)

Transforms a BLOB representation of a geometry contained in an ESRI personal geodatabase (.mdb) into WKT.

Parameters:

blob - Input geometry BLOB

transform - Parameters for the (optional) transformation, including source and target CRS

Returns:

the WKT of the transformed geometry

geomValidate

public com.vividsolutions.jts.geom.Geometry geomValidate(com.vividsolutions.jts.geom.Geometry geom)

Get / create a valid version of the geometry given. If the geometry is a polygon or multi polygon, self intersections / inconsistencies are fixed. Otherwise the geometry is returned.

Parameters:

geom - Input geometry

Returns:

A valid, corrected geometry

addPolygon

public void addPolygon(com.vividsolutions.jts.geom.Polygon polygon,
                       com.vividsolutions.jts.operation.polygonize.Polygonizer polygonizer)

Add all line strings from the polygon given to the polygonizer

Parameters:

polygon - Polygon from which to extract line strings

polygonizer - Polygonizer object

addLineString

public void addLineString(com.vividsolutions.jts.geom.LineString lineString,
                          com.vividsolutions.jts.operation.polygonize.Polygonizer polygonizer)

Add the linestring given to the polygonizer

Parameters:

lineString - Line string

polygonizer - Polygonizer object

toPolygonGeometry

public com.vividsolutions.jts.geom.Geometry toPolygonGeometry(java.util.Collection<com.vividsolutions.jts.geom.Polygon> polygons,
                                                              com.vividsolutions.jts.geom.GeometryFactory factory)

Get a geometry from a collection of polygons.

Parameters:

polygons - Collection of polygons

factory - Factory to generate MultiPolygon if required

Returns:

null if there were no polygons, the polygon if there was only one, or a MultiPolygon containing all polygons otherwise

geometry2WKT

public java.lang.String geometry2WKT(com.vividsolutions.jts.geom.Geometry g,
                                     java.lang.String geomOntology)

Provides the Well-Known Text representation of a geometry for its inclusion as literal in RDF triples.

Parameters:

g - Input geometry $param geomOntology RDF ontology used in geometry representations (GeoSPARQL, Virtuoso geometry RDF, or WGS84 Geoposition RDF vocabulary)

Returns:

WKT of the geometry

WKT2Geometry

public com.vividsolutions.jts.geom.Geometry WKT2Geometry(java.lang.String wkt)

Returns the internal geometry representation according to its Well-Known Text serialization.

Parameters:

wkt - WKT of the geometry

Returns:

A geometry object

getArea

public double getArea(java.lang.String polygonWKT)

Returns the area of a polygon geometry from its the Well-Known Text representation.

Parameters:

polygonWKT - WKT of the polygon

Returns:

calculated area (in the same units as the CRS of the geometry)

getArea

public double getArea(java.lang.String polygonWKT,
                      int srid)

Built-in function that returns the area of a polygon geometry from its the Well-Known Text representation.

Parameters:

polygonWKT - WKT of the polygon

srid - EPSG code of the coordinate reference system (CRS) of the geometry

Returns:

calculated area in square meters (NOT in the units of the CRS of the geometry)

getLength

public double getLength(java.lang.String wkt)

Returns the length of a linestring or the perimeter of a polygon geometry from its the Well-Known Text representation.

Parameters:

wkt - WKT of the linestring or polygon

Returns:

calculated length/perimeter (in the same units as the CRS of the geometry)

getLength

public double getLength(java.lang.String wkt,
                        int srid)

Built-in function that returns the length of a linestring or the perimeter of a polygon geometry from its the Well-Known Text representation.

Parameters:

wkt - WKT of the linestring or polygon

srid - EPSG code of the coordinate reference system (CRS) of the geometry

Returns:

calculated length/perimeter in meters (NOT in the units of the CRS of the geometry)

getLonLatCoords

public double[] getLonLatCoords(java.lang.String wkt,
                                int srid)

Built-in function that returns a pair of lon/lat coordinates (in WGS84) of a geometry as calculated from its the Well-Known Text representation.

Parameters:

wkt - WKT of the geometry

srid - the EPSG code of the CRS of this geometry

Returns:

An array with the pair of lon/lat coordinates

getLongitude

public double getLongitude(com.vividsolutions.jts.geom.Geometry g)

Calculate the longitude at the centroid of the geometry

Parameters:

g - Input geometry

Returns:

Longitude (in WGS84) of the centroid of the geometry

getLatitude

public double getLatitude(com.vividsolutions.jts.geom.Geometry g)

Calculate the latitude at the centroid of the geometry

Parameters:

g - Input geometry

Returns:

Latitude (in WGS84) of the centroid of the geometry

WKT2GeometryTransform

public com.vividsolutions.jts.geom.Geometry WKT2GeometryTransform(java.lang.String wkt,
                                                                  org.opengis.referencing.operation.MathTransform transform,
                                                                  com.vividsolutions.jts.io.WKTReader wktReader)

Provides the internal geometry representation based on its the Well-Known Text, also applying transformation into another CRS (if required).

Parameters:

wkt - WKT of the geometry

transform - Parameters for the transformation, including source and target CRS

wktReader - Parser of WKT geometry representations

Returns:

The transformed geometry

getGeoHash

public java.lang.String getGeoHash(double lon,
                                   double lat,
                                   int precision)

Encode a geographic location into a short string of letters and digits, according to http://geohash.org/

Parameters:

lon - Longitude of the location

lat - Latitude of the location

precision - The length of the geohash string

Returns:

A string with the GeoHash encoding of the geometry.

filterContains

public boolean filterContains(java.lang.String wkt)

Specify a topological filter (CONTAINS) against input geometries in order to exclude transformation of those outside a user-specified spatial extent.

Parameters:

wkt - Input geometry as WKT

Returns:

True if geometry qualifies; False if geometry should be excluded from transformation.

getFilterExtent

public com.vividsolutions.jts.geom.Geometry getFilterExtent()

Returns the geometry that represents the spatial filter that is being applied to select features from the input dataset.

Returns:

Geometry representing the spatial filter.

filterThematic

public boolean filterThematic(java.util.Map<java.lang.String,java.lang.String> record)

Evaluates a thematic filter (logical expression) over an input data record.

Parameters:

record - Input data record (including all thematic attributes available in the original feature)

Returns:

False if data record qualifies; True if record should be excluded from transformation.

mergeFiles

public void mergeFiles(java.util.List<java.lang.String> inputFiles,
                       java.lang.String outputFile)

Merges several input files into a single output file.

Parameters:

inputFiles - List of the paths to the input files $param outputFile Path to merged output file

getTransliteration

public java.lang.String getTransliteration(java.lang.String val)

Built-in function that provides a transliteration into phonetically equivalent Latin characters of a string literal written in a non-Latin alphabet.

Parameters:

val - The original string literal (may contain Latin characters).

Returns:

The transliterated sting.

standardizeDate

public java.lang.String standardizeDate(java.lang.String val,
                                        java.lang.String format)

Convert a date value from its original format into a standard timestamp value.

Parameters:

val - Input date value (given as a string)

format - Original format of date values as specified in the mappings.

Returns:

Standard formatted date value (as string)

standardizePhoneNumber

public java.lang.String standardizePhoneNumber(java.lang.String phone,
                                               java.lang.String country_code)

Built-in function that brings phone numbers into a consistent format.

Parameters:

phone - The original string literal representing a phone number

country_code - The international country code of this phone number (e.g., 49 for Germany, 30 for Greece, etc.)

Returns:

The formatted phone number, stripped from non-numeric characters.

getNextSerial

public long getNextSerial()

Provides the next serial number (long) to be used as an intermediate identifier

Returns:

A long number.

getUUID

public java.lang.String getUUID(java.lang.String featureSource,
                                java.lang.String id)

Built-in function that provides a UUID (Universally Unique Identifier) that represents a 128-bit long value to be used in the URI of a transformed feature. Also known as GUID (Globally Unique Identifier).

Parameters:

featureSource - The name of the feature source, to be used as suffix of the identifier.

id - A unique identifier of the feature.

Returns:

The auto-generated UUID based on the concatenation of the feature source and the identifier.

getUUID

public java.lang.String getUUID(java.lang.String id)

Built-in function that provides a UUID (Universally Unique Identifier) that represents a 128-bit long value to be used in the URI of a transformed feature. This UUID is generated by hashing over the original identifier. Also known as GUID (Globally Unique Identifier).

Parameters:

id - A unique identifier of the feature.

Returns:

The auto-generated UUID.

getRandomUUID

public java.lang.String getRandomUUID()

Built-in function that provides a UUID (Universally Unique Identifier) that represents a 128-bit long value to be used in the URI of a transformed feature. This is a secure random UUID with minimal chance of collisions with existing ones. Also known as GUID (Globally Unique Identifier).

Returns:

The auto-generated UUID.

keepOriginalID

public java.lang.String keepOriginalID(java.lang.String id)

Build-in function that retains the original identifier of a feature in the resulting URI or the transformed resource.

Parameters:

id - A unique identifier of the feature.

Returns:

The identifier to be used for the transformed resource.

encodeUTF

public java.lang.String encodeUTF(java.lang.String s,
                                  java.lang.String encoding)

Provides a UTF-8 encoding of the given string originally represented in the given encoding

Parameters:

s - input string value

encoding - name of the character encoding

Returns:

output encoded string

isValidISOLanguage

public boolean isValidISOLanguage(java.lang.String s)

Checks if the given string represents a valid ISO 639-1 language code (2 digits)

Parameters:

s - An input string value

Returns:

True is this is a valid ISO 639-1 language code; otherwise, False.

getLanguage

public java.lang.String getLanguage(java.lang.String attr,
                                    int i)

Built-in function that extracts the language tag from an attribute name. This tag will be attached to all values obtained for this attribute. ASSUMPTION: The tag is composed from the suffix after the i-th character in the attribute name.

Parameters:

attr - The attribute name.

i - Index of the i-th character in the attribute name.

Returns:

The language tag to be applied in string literals created for values from this attribute.

getResourceType

public java.lang.String getResourceType(java.lang.String val)

Built-in function that assigns a value as the type of a resource.

Parameters:

val - The value to be assigned as the type of the resource.

Returns:

The assigned value.

getDataSource

public java.lang.String getDataSource()

Built-in function that identifies the provider of the dataset as specified in the configuration settings.

Returns:

The name of the data provider.

concatenate

public java.lang.String concatenate(java.lang.String val1,
                                    java.lang.String val2)

Built-in function that concatenates a pair of string values into a new one.

Parameters:

val1 - The first value.

val2 - The second value.

Returns:

The concatenated value.

concatenate

public java.lang.String concatenate(java.lang.String[] values)

Built-in function that concatenates an array of multiple string values into a unified one.

Parameters:

values - The array of string values.

Returns:

The concatenated value.

getLogicalExpression

public Expr getLogicalExpression(java.lang.String condition)

Returns a logical expression to be evaluated against a record (represented as a Map with key-value pairs); evaluation returns a boolean value.

Parameters:

condition - An SQL condition involving equality, possibly combining several subexpressions with AND, OR

Returns:

A logical expression to be evaluated

applyRuntimeMethod

public java.lang.Object applyRuntimeMethod(java.lang.String methodName,
                                           java.lang.Object[] args)

Applies a function at runtime, based on user-defined YML specifications regarding an attribute. This is carried out thanks to the Java Reflection API.

Parameters:

methodName - The name of the method to invoke (e.g., getLanguage).

args - The necessary arguments for the method to run (may be multiple).

Returns:

A string value resulting from the invocation (e.g., language tag extracted from the attribute name).

check_ShapefileFolder

public boolean check_ShapefileFolder(java.lang.String inputFolder)

Checks if the the input is correct. The input must be a directory that contains all the necessary shapefiles.

Parameters:

inputFolder - the path to the input folder.

Returns:

true or false if the input is correct.

check_ShapeFiles

private boolean check_ShapeFiles(java.lang.String inputFolder)

Checks if folder contains the necessary files of Shapefile. The files must have the same name with the folder.

Parameters:

inputFolder - the path to the input folder.

Returns:

true or false if the folder contains the necessary files.

getFileFromShapefile

public java.lang.String getFileFromShapefile(java.lang.String extension,
                                             java.lang.String inputFolder)

Returns the absolute path of the requested file from the shapefile collection.

Parameters:

extension: - the extension of the file that will search for in the collection.

inputFolder - the path to the input folder.

Returns:

the absolute path of the requested file