eu.slipo.athenarc.triplegeo.partitioning

Class ShpPartitioner

java.lang.Object

eu.slipo.athenarc.triplegeo.partitioning.ShpPartitioner

All Implemented Interfaces:

Partitioner

public class ShpPartitioner
extends java.lang.Object
implements Partitioner

Partitions a ESRI shapefile into several (equi-sized) parts in order to be concurrently transformed into RDF.

Version:

2.0

Author:

Kostas Patroumpas

Field Summary

Fields

Modifier and Type	Field and Description
(package private) java.lang.String	encoding
(package private) java.lang.String	fileExtension
(package private) java.util.List<java.lang.String>	outputFiles

Constructor Summary

Constructors

Constructor and Description
ShpPartitioner()

Method Summary

Modifier and Type	Method and Description
private org.geotools.data.FeatureWriter<org.opengis.feature.simple.SimpleFeatureType,org.opengis.feature.simple.SimpleFeature>	createWriter(java.lang.String inputFileName, java.lang.String tmpDir, org.opengis.feature.simple.SimpleFeatureType schema, int part) Creates a writer to be used in copying the features for a specific partition of the input shapefile
java.lang.String[]	split(java.lang.String filePath, java.lang.String tmpDir, int numParts) Splits an input .CSV file into a specified number of partitions.
java.lang.String[]	split(java.lang.String filePath, java.lang.String tmpDir, int numParts, java.lang.String encoding) Splits an input shapefile into a specified number of partitions.
private void	writeToShapefile(org.opengis.feature.simple.SimpleFeature f, org.geotools.data.FeatureWriter<org.opengis.feature.simple.SimpleFeatureType,org.opengis.feature.simple.SimpleFeature> writer) Writes a given feature into a shapefile using a dedicated writer.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

encoding

java.lang.String encoding

fileExtension

java.lang.String fileExtension

outputFiles

java.util.List<java.lang.String> outputFiles

Constructor Detail

ShpPartitioner

public ShpPartitioner()

Method Detail

split

public java.lang.String[] split(java.lang.String filePath,
                                java.lang.String tmpDir,
                                int numParts,
                                java.lang.String encoding)
                         throws java.io.IOException

Splits an input shapefile into a specified number of partitions.

Specified by:

split in interface Partitioner

Parameters:

filePath - Path to the input shapefile

tmpDir - Folder to hold the output partitions (i.e., files with the same extension)

numParts - Number of partitions to be created

Returns:

Array holding the absolute path to each of the resulting partitions

Throws:

java.io.IOException

createWriter

private org.geotools.data.FeatureWriter<org.opengis.feature.simple.SimpleFeatureType,org.opengis.feature.simple.SimpleFeature> createWriter(java.lang.String inputFileName,
                                                                                                                                            java.lang.String tmpDir,
                                                                                                                                            org.opengis.feature.simple.SimpleFeatureType schema,
                                                                                                                                            int part)

Creates a writer to be used in copying the features for a specific partition of the input shapefile

Parameters:

inputFileName - The name of the shapefile containing all the input data

tmpDir - Folder to hold the output shapefile partitions (with the same extension)

schema - Attribute schema of input shapefile, also to be retained in the resulting partition

part - Serial number of this partition

Returns:

A writer to be used in copying data into the partition shapefile

writeToShapefile

private void writeToShapefile(org.opengis.feature.simple.SimpleFeature f,
                              org.geotools.data.FeatureWriter<org.opengis.feature.simple.SimpleFeatureType,org.opengis.feature.simple.SimpleFeature> writer)
                       throws java.io.IOException

Writes a given feature into a shapefile using a dedicated writer.

Parameters:

f - A feature to be written into the shapefile

writer - A writer that undertakes storing of features into a given shapefile partition

Throws:

java.io.IOException

split

public java.lang.String[] split(java.lang.String filePath,
                                java.lang.String tmpDir,
                                int numParts)
                         throws java.io.IOException

Description copied from interface: Partitioner

Splits an input .CSV file into a specified number of partitions.

Specified by:

split in interface Partitioner

Parameters:

filePath - Path to the input .CSV file

tmpDir - Folder to hold the output partitions (i.e., files with the same extension)

numParts - Number of partitions to be created

Returns:

Array holding the absolute path to each of the resulting partitions

Throws:

java.io.IOException