eu.slipo.athenarc.triplegeo.partitioning

Class CsvPartitioner

java.lang.Object

eu.slipo.athenarc.triplegeo.partitioning.CsvPartitioner

All Implemented Interfaces:

Partitioner

public class CsvPartitioner
extends java.lang.Object
implements Partitioner

Splits a CSV text file into several parts in order to be concurrently transformed into RDF. LIMITATIONS: Currently handling only .CSV files with a header.

Version:

2.0

Author:

Kostas Patroumpas

Field Summary

Fields

Modifier and Type	Field and Description
(package private) java.lang.String	fileExtension
(package private) java.util.List<java.lang.String>	outputFiles

Constructor Summary

Constructors

Constructor and Description
CsvPartitioner()

Method Summary

Modifier and Type	Method and Description
private java.io.BufferedWriter	createWriter(java.io.File inputFile, java.lang.String tmpDir, int part) Creates a buffered writer to be used in copying the contents for a specific partition of the input file
java.lang.String[]	split(java.lang.String filePath, java.lang.String tmpDir, int numParts) Splits an input file into a specified number of partitions.
java.lang.String[]	split(java.lang.String filePath, java.lang.String tmpDir, int numParts, java.lang.String encoding) Splits an input shapefile into a specified number of partitions.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

fileExtension

java.lang.String fileExtension

outputFiles

java.util.List<java.lang.String> outputFiles

Constructor Detail

CsvPartitioner

public CsvPartitioner()

Method Detail

split

public java.lang.String[] split(java.lang.String filePath,
                                java.lang.String tmpDir,
                                int numParts)
                         throws java.io.IOException

Splits an input file into a specified number of partitions.

Specified by:

split in interface Partitioner

Parameters:

filePath - Path to the input file

tmpDir - Folder to hold the output partitions (i.e., files with the same extension)

numParts - Number of partitions to be created

Returns:

Array holding the absolute path to each of the resulting partitions

Throws:

java.io.IOException

createWriter

private java.io.BufferedWriter createWriter(java.io.File inputFile,
                                            java.lang.String tmpDir,
                                            int part)

Creates a buffered writer to be used in copying the contents for a specific partition of the input file

Parameters:

inputFile - The file containing all the input data

tmpDir - Folder to hold the output file partitions (with the same extension)

part - Serial number of this partition

Returns:

A buffered writer to be used in copying data into the partition file

split

public java.lang.String[] split(java.lang.String filePath,
                                java.lang.String tmpDir,
                                int numParts,
                                java.lang.String encoding)
                         throws java.io.IOException

Description copied from interface: Partitioner

Splits an input shapefile into a specified number of partitions.

Specified by:

split in interface Partitioner

Parameters:

filePath - Path to the input shapefile

tmpDir - Folder to hold the output partitions (i.e., files with the same extension)

numParts - Number of partitions to be created

Returns:

Array holding the absolute path to each of the resulting partitions

Throws:

java.io.IOException