这里我有一个代码块,它将插入一个名为Earnings的表中,并将为csv的每一行使用4个整数的预处理语句,并将它们添加到批处理中,并在读取所有行时执行批处理。为什么这会在csv文件的2009行开始插入,换句话说它似乎不稳定,只会将部分csv导入到mysql表中,如何使用6530行csv使批处理执行更高效?另外,我如何处理不存在的预准备语句,例如,在preparedstatement的参数索引4处存在int的可能性或者可能为空。
statement.executeUpdate("CREATE TABLE Earnings("
+ "tournament INT references Tournaments( tournament_id ), "
+ "player INT references Players( player_id ), "
+ "prize_money INT, "
+ "position INT, "
+ "PRIMARY KEY(tournament, player))");
Statement statement = conn.createStatement();
try{
String insertTableSQL2 = "INSERT INTO Earnings"
+ "(tournament, player, prize_money, position) VALUES"
+ "(?,?,?,?)";
PreparedStatement preparedStatement2 = conn.prepareStatement(insertTableSQL2);
BufferedReader reader2 = new BufferedReader(new FileReader("earnings.csv"));
String line = null; //line read from csv
Scanner scanner = null; //scanned line
while ((line = reader2.readLine()) != null) {
scanner = new Scanner(line);
scanner.useDelimiter(",");
while (scanner.hasNext()) {
String str = scanner.next();
preparedStatement2.setInt(1, Integer.parseInt(str));
String str2 = scanner.next();
preparedStatement2.setInt(2, Integer.parseInt(str2));
String str3 = scanner.next();
preparedStatement2.setInt(3, Integer.parseInt(str3));
String str4 = scanner.next();
preparedStatement2.setInt(4, Integer.parseInt(str4));
preparedStatement2.addBatch();
}
}
preparedStatement2.executeBatch();
preparedStatement2.close();
scanner.close();
reader2.close(); //closing CSV reader
}
catch(Exception e){
e.printStackTrace();
}
System.out.println("earnings.csv imported");
csv的格式如下:
19367,26,677,1
19367,112,271,2
19372,51,134,1
19382,213,150,1
19382,243,50,2
18446,34,2976,1
18446,111,1082,2
19452,28,135,1
使用LOAD DATA INFILE语法。如果您使用它,那么也将更快,也不需要编写所有这些代码行。
检查here
您可以使用库com.opencsv.CSVReader作为CSV读取器/写入器。编写简单的代码,逐行读取CSV文件并构造SQL查询,然后执行查询。
public void loadCSVfile() {
try (CSVReader reader = new CSVReader(new FileReader("earnings.csv"), ',');
Connection connection = DBConnection.getConnection();) {
String insertQuery = "Insert into Earnings (tournament, player, prize_money, position) values (null,?,?,?)";
PreparedStatement pstmt = connection.prepareStatement(insertQuery);
String[] rowData = null;
int i = 0;
while ((rowData = reader.readNext()) != null) {
for (String data : rowData) {
pstmt.setString(i++, data);
pstmt.addBatch();
pstmt.executeBatch();
}
i = 0;
}
} catch (Exception e) {
e.printStackTrace();
}
}
或者如果可能的话加载MySQL命令:
public void loadCSV()
{
try (Connection connection = DBConnection.getConnection()) {
String sqlQuery = "LOAD DATA LOCAL INFILE '" + "earnings.csv" + "' INTO TABLE Earnings FIELDS TERMINATED BY ','" + " LINES TERMINATED BY '\n' (tournament, player, prize_money, position) ";
Statement stmt = connection.createStatement();
stmt.execute(sqlQuery);
}
catch (Exception e) {
e.printStackTrace();
}
}