对,伙计们,我有这个代码
for line in npp_test_file.csv
awk -F, '
BEGIN { FPAT = "([^,]+)|(\"[^\"]+\")" }
NF!=17 { print "incorrect amount of fields"; exit }
!($1~/^("[A-Z0-9]{1,25}")$/) {print "1st field invalid";}
!($2~/("[[:digit:]]{1,3}")$/) {print "2nd field invalid";}
!($3~/^("[A-Z0-9]{1,8}")$/) {print "3rd field invalid";}
!($4~/^("[A-Z0-9]{0,1}")$/) {print "4th field invalid";}
!($5~/^("[A-Z0-9]{0,11}")$/) {print "5th field invalid";}
!($6~/^("")$/) {print "6th field invalid";}
!($7~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/B) {print "7th field invalid";}
!($8~/^("[1-5]{1}")$/) {print "8th field invalid";}
!($9~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "9th field invalid";}
!($10~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "10th field invalid";}
!($11~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "11th field invalid";}
!($12~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "12th field invalid";}
!($13~/^("[A-Za-z0-9]{0,70}")|""$/) {print "13th field invalid";}
!($14~/^("[A-Za-z0-9]{1}")|""$/) {print "14th field invalid";}
!($15~/^("[0-9]{0,3}")$/) {print "15th field invalid";}
!($16~/^(".+")$/) {print "16th field invalid";}
!($17~/^(".+")|""$/) {print "17th field invalid";}
{print "you have 17 fields";
exit}' $line
done
现在,此代码用于获取npp_test_file.csv中保存的数据,然后将其拆分为17个字段,然后将每个字段分配给变量,以便它可以测试每个字段是否满足一组给定条件。
但是由于文件具有多于一组的17个字段,因此在一个文件中它们可以具有大约100个左右的字段。我需要一种方法让程序循环返回每一行我虽然我的代码for line
可以工作,但它没有。
csv文件中的数据示例
"AAA0002","112","BA001000","","HG55USW","","2018-06-21","1","2018-06-21","2018-06-21","11:26:30","11:26:30","colchester","2","003","some form of string",""
"ABC0004","a009","BAV01000","A","HG43FHG","","2018-06-21","1","2018-06-21","2018-06-21","11:26:30","11:26:30","bridgend","1","112","a second form of string ",""
"aADF0005","s012","BA0Q1000","1","CV63LTG","","2018-06-21","1","2018-06-21","2018-06-21","11:26:30","11:26:30","london","1","112","another form of string","none"
这应该打印到屏幕“字段1无效,字段2无效”
你可以尝试下面(因为样品不存在所以没有测试它)。
awk '
BEGIN { FPAT = "([^,]+)|(\"[^\"]+\")" }
NF!=17 { print "incorrect amount of fields"; next}
!($1~/^("[A-Z0-9]{1,25}")$/) {print "1st field invalid";}
!($2~/("[[:digit:]]{1,3}")$/) {print "2nd field invalid";}
!($3~/^("[A-Z0-9]{1,8}")$/) {print "3rd field invalid";}
!($4~/^("[A-Z0-9]{0,1}")$/) {print "4th field invalid";}
!($5~/^("[A-Z0-9]{0,11}")$/) {print "5th field invalid";}
!($6~/^("")$/) {print "6th field invalid";}
!($7~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/B) {print "7th field invalid";}
!($8~/^("[1-5]{1}")$/) {print "8th field invalid";}
!($9~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "9th field invalid";}
!($10~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "10th field invalid";}
!($11~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "11th field invalid";}
!($12~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "12th field invalid";}
!($13~/^("[A-Za-z0-9]{0,70}")|""$/) {print "13th field invalid";}
!($14~/^("[A-Za-z0-9]{1}")|""$/) {print "14th field invalid";}
!($15~/^("[0-9]{0,3}")$/) {print "15th field invalid";}
!($16~/^(".+")$/) {print "16th field invalid";}
!($17~/^(".+")|""$/) {print "17th field invalid";}
{print "you have 17 fields"}' npp_test_file.csv
以下是OP尝试中的更正:
1-删除了for
循环,因为awk
可以读取Input_file本身,而且OP看起来只读取1个Input_file。
2-从exit
的条件中删除NF
检查否则它不会检查所有条件。
3-当您给-F
时,从您的代码中删除FPAT
然后不需要它恕我直言。
4-当找到17个字段时,从exit
命令中移除了第二个print
。
编辑:如果您想要在任何字段无效(甚至是单个字段)时移动到下一行,那么您可以将next
添加到条件中。
awk '
BEGIN { FPAT = "([^,]+)|(\"[^\"]+\")" }
NF!=17 { print "incorrect amount of fields"; next}
!($1~/^("[A-Z0-9]{1,25}")$/) {print "1st field invalid"; next}
!($2~/("[[:digit:]]{1,3}")$/) {print "2nd field invalid"; next}
!($3~/^("[A-Z0-9]{1,8}")$/) {print "3rd field invalid"; next}
!($4~/^("[A-Z0-9]{0,1}")$/) {print "4th field invalid"; next}
!($5~/^("[A-Z0-9]{0,11}")$/) {print "5th field invalid"; next}
!($6~/^("")$/) {print "6th field invalid"; next}
!($7~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/B) {print "7th field invalid"; next}
!($8~/^("[1-5]{1}")$/) {print "8th field invalid"; next}
!($9~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "9th field invalid"; next}
!($10~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "10th field invalid"; next}
!($11~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "11th field invalid"; next}
!($12~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "12th field invalid"; next}
!($13~/^("[A-Za-z0-9]{0,70}")|""$/) {print "13th field invalid"; next}
!($14~/^("[A-Za-z0-9]{1}")|""$/) {print "14th field invalid"; next}
!($15~/^("[0-9]{0,3}")$/) {print "15th field invalid"; next}
!($16~/^(".+")$/) {print "16th field invalid"; next}
!($17~/^(".+")|""$/) {print "17th field invalid"; next}
{print "you have 17 fields"}' npp_test_file.csv
EDIT2:从@ NeronLeVelu的解决方案中获取灵感。修改他的解决方案以从REGEX制作自动数组(将用于不同的字段检查)。虽然我没有测试过,因为之前没有提到适当的样品。
awk '
BEGIN{
FPAT = "([^,]+)|(\"[^\"]+\")"
Fld = 0
num=split("^(\"[A-Z0-9]{1,25}\")$,(\"[[:digit:]]{1,3}\")$,^(\"[A-Z0-9]{1,8}\")$,^(\"[A-Z0-9]{0,1}\")$,^(\"[A-Z0-9]{0,11}\")$,^(\"\")$,^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$,^(\"[1-5]{1}\")$,^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$,^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$,^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$,^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$,^(\"[A-Za-z0-9]{0,70}\")|\"\"$,^(\"[A-Za-z0-9]{1}\")|\"\"$,^(\"[0-9]{0,3}\")$,^(\".+\")$,^(\".+\")|\"\"$", array",")
for(i=1;i<=num;i++){
regex[i]=array[i]
}
NF != 17 {
printf( "Line %3d : incorrect amount of fields\n", NR )
next
}
{
for (Idx=1; Idx<=num; Idx++ ) {
if ( $Idx !~ regex[Idx] ) {
printf( "Line %3d : %2dth field is invalid\n", NR, Idx )
}
}
}' Input_file
一个更通用的版本,你把所有模式检查放在一个数组'更容易适应其他字段数,我使用Fld var自动递增但你可以直接索引,如果你愿意):
awk -F ',' '
BEGIN{
FPAT = "([^,]+)|(\"[^\"]+\")"
Fld = 0
Pat[++Fld]="^(\"[A-Z0-9]{1,25}\")$"
Pat[++Fld]="(\"[[:digit:]]{1,3}\")$"
Pat[++Fld]="^(\"[A-Z0-9]{1,8}\")$"
Pat[++Fld]="^(\"[A-Z0-9]{0,1}\")$"
Pat[++Fld]="^(\"[A-Z0-9]{0,11}\")$"
Pat[++Fld]="^(\"\")$"
Pat[++Fld]="^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$"
Pat[++Fld]="^(\"[1-5]{1}\")$"
Pat[++Fld]="^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$"
Pat[++Fld]="^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$"
Pat[++Fld]="^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$"
Pat[++Fld]="^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$"
Pat[++Fld]="^(\"[A-Za-z0-9]{0,70}\")|\"\"$"
Pat[++Fld]="^(\"[A-Za-z0-9]{1}\")|\"\"$"
Pat[++Fld]="^(\"[0-9]{0,3}\")$"
Pat[++Fld]="^(\".+\")$"
Pat[++Fld]="^(\".+\")|\"\"$"
}
NF != 17 {
printf( "Line %3d : incorrect amount of fields\n", NR )
next
}
{
for (Idx=1; Idx<=Fld; Idx++ ) {
if ( $Idx !~ Pat[Idx] ) {
printf( "Line %3d : %2dth field is invalid\n", NR, Idx )
}
}
}
{ printf( "Line %3d : you have 17 fields\n", NR ) }
' npp_test_file.csv
如果你从最后一个块移除exit
(当你在它时,删除那个-F,
,你不需要它和FPAT
):
...
{print "you have 17 fields";
exit}
变
...
{
print "you have 17 fields"
}
输出将是
you have 17 fields
2nd field invalid
you have 17 fields
1st field invalid
2nd field invalid
you have 17 fields
这是你正在寻找的字段一是无效的,字段二是无效的“?