for循环不会遍历csv验证器中的每组行

问题描述 投票:1回答:3

对,伙计们,我有这个代码

for line in npp_test_file.csv
awk -F, '
BEGIN { FPAT = "([^,]+)|(\"[^\"]+\")" } 
NF!=17 { print "incorrect   amount    of fields"; exit }
!($1~/^("[A-Z0-9]{1,25}")$/) {print "1st field invalid";}
!($2~/("[[:digit:]]{1,3}")$/) {print "2nd field invalid";}
!($3~/^("[A-Z0-9]{1,8}")$/) {print "3rd field invalid";}
!($4~/^("[A-Z0-9]{0,1}")$/) {print "4th field invalid";}
!($5~/^("[A-Z0-9]{0,11}")$/) {print "5th field invalid";}
!($6~/^("")$/) {print "6th field invalid";}
!($7~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/B) {print "7th field invalid";}
!($8~/^("[1-5]{1}")$/) {print "8th field invalid";}
!($9~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "9th field invalid";}
!($10~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "10th field invalid";}
!($11~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "11th field invalid";}
!($12~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "12th field invalid";}
!($13~/^("[A-Za-z0-9]{0,70}")|""$/) {print "13th field invalid";}
!($14~/^("[A-Za-z0-9]{1}")|""$/) {print "14th field invalid";}
!($15~/^("[0-9]{0,3}")$/) {print "15th field invalid";}
!($16~/^(".+")$/) {print "16th field invalid";}
!($17~/^(".+")|""$/) {print "17th field invalid";}
{print "you have 17 fields";
exit}' $line
done

现在,此代码用于获取npp_test_file.csv中保存的数据,然后将其拆分为17个字段,然后将每个字段分配给变量,以便它可以测试每个字段是否满足一组给定条件。

但是由于文件具有多于一组的17个字段,因此在一个文件中它们可以具有大约100个左右的字段。我需要一种方法让程序循环返回每一行我虽然我的代码for line可以工作,但它没有。

csv文件中的数据示例

"AAA0002","112","BA001000","","HG55USW","","2018-06-21","1","2018-06-21","2018-06-21","11:26:30","11:26:30","colchester","2","003","some form of string",""
"ABC0004","a009","BAV01000","A","HG43FHG","","2018-06-21","1","2018-06-21","2018-06-21","11:26:30","11:26:30","bridgend","1","112","a second form of string ",""
"aADF0005","s012","BA0Q1000","1","CV63LTG","","2018-06-21","1","2018-06-21","2018-06-21","11:26:30","11:26:30","london","1","112","another form of string","none"

这应该打印到屏幕“字段1无效,字段2无效”

awk
3个回答
0
投票

你可以尝试下面(因为样品不存在所以没有测试它)。

awk '
BEGIN { FPAT = "([^,]+)|(\"[^\"]+\")" } 
NF!=17 { print "incorrect   amount    of fields"; next}
!($1~/^("[A-Z0-9]{1,25}")$/) {print "1st field invalid";}
!($2~/("[[:digit:]]{1,3}")$/) {print "2nd field invalid";}
!($3~/^("[A-Z0-9]{1,8}")$/) {print "3rd field invalid";}
!($4~/^("[A-Z0-9]{0,1}")$/) {print "4th field invalid";}
!($5~/^("[A-Z0-9]{0,11}")$/) {print "5th field invalid";}
!($6~/^("")$/) {print "6th field invalid";}
!($7~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/B) {print "7th field invalid";}
!($8~/^("[1-5]{1}")$/) {print "8th field invalid";}
!($9~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "9th field invalid";}
!($10~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "10th field invalid";}
!($11~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "11th field invalid";}
!($12~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "12th field invalid";}
!($13~/^("[A-Za-z0-9]{0,70}")|""$/) {print "13th field invalid";}
!($14~/^("[A-Za-z0-9]{1}")|""$/) {print "14th field invalid";}
!($15~/^("[0-9]{0,3}")$/) {print "15th field invalid";}
!($16~/^(".+")$/) {print "16th field invalid";}
!($17~/^(".+")|""$/) {print "17th field invalid";}
{print "you have 17 fields"}' npp_test_file.csv

以下是OP尝试中的更正:

1-删除了for循环,因为awk可以读取Input_file本身,而且OP看起来只读取1个Input_file。

2-从exit的条件中删除NF检查否则它不会检查所有条件。

3-当您给-F时,从您的代码中删除FPAT然后不需要它恕我直言。

4-当找到17个字段时,从exit命令中移除了第二个print



编辑:如果您想要在任何字段无效(甚至是单个字段)时移动到下一行,那么您可以将next添加到条件中。

awk '
BEGIN { FPAT = "([^,]+)|(\"[^\"]+\")" } 
NF!=17 { print "incorrect   amount    of fields"; next}
!($1~/^("[A-Z0-9]{1,25}")$/) {print "1st field invalid"; next}
!($2~/("[[:digit:]]{1,3}")$/) {print "2nd field invalid"; next}
!($3~/^("[A-Z0-9]{1,8}")$/) {print "3rd field invalid"; next}
!($4~/^("[A-Z0-9]{0,1}")$/) {print "4th field invalid"; next}
!($5~/^("[A-Z0-9]{0,11}")$/) {print "5th field invalid"; next}
!($6~/^("")$/) {print "6th field invalid"; next}
!($7~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/B) {print "7th field invalid"; next}
!($8~/^("[1-5]{1}")$/) {print "8th field invalid"; next}
!($9~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "9th field invalid"; next}
!($10~/^("[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}")$/) {print "10th field invalid"; next}
!($11~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "11th field invalid"; next}
!($12~/^("([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]")|""$/) {print "12th field invalid"; next}
!($13~/^("[A-Za-z0-9]{0,70}")|""$/) {print "13th field invalid"; next}
!($14~/^("[A-Za-z0-9]{1}")|""$/) {print "14th field invalid"; next}
!($15~/^("[0-9]{0,3}")$/) {print "15th field invalid"; next}
!($16~/^(".+")$/) {print "16th field invalid"; next}
!($17~/^(".+")|""$/) {print "17th field invalid"; next}
{print "you have 17 fields"}' npp_test_file.csv


EDIT2:从@ NeronLeVelu的解决方案中获取灵感。修改他的解决方案以从REGEX制作自动数组(将用于不同的字段检查)。虽然我没有测试过,因为之前没有提到适当的样品。

awk '
   BEGIN{
      FPAT = "([^,]+)|(\"[^\"]+\")"
      Fld = 0
      num=split("^(\"[A-Z0-9]{1,25}\")$,(\"[[:digit:]]{1,3}\")$,^(\"[A-Z0-9]{1,8}\")$,^(\"[A-Z0-9]{0,1}\")$,^(\"[A-Z0-9]{0,11}\")$,^(\"\")$,^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$,^(\"[1-5]{1}\")$,^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$,^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$,^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$,^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$,^(\"[A-Za-z0-9]{0,70}\")|\"\"$,^(\"[A-Za-z0-9]{1}\")|\"\"$,^(\"[0-9]{0,3}\")$,^(\".+\")$,^(\".+\")|\"\"$", array",")
      for(i=1;i<=num;i++){
         regex[i]=array[i]
      }

    NF != 17 { 
       printf( "Line %3d : incorrect amount of fields\n", NR )
       next
       }

    {
    for (Idx=1; Idx<=num; Idx++ ) {
       if ( $Idx !~ regex[Idx] ) {
          printf( "Line %3d : %2dth field is invalid\n", NR, Idx )
          }
       }
    }'  Input_file

2
投票

一个更通用的版本,你把所有模式检查放在一个数组'更容易适应其他字段数,我使用Fld var自动递增但你可以直接索引,如果你愿意):

awk -F ',' '
   BEGIN{
      FPAT = "([^,]+)|(\"[^\"]+\")"
      Fld = 0

      Pat[++Fld]="^(\"[A-Z0-9]{1,25}\")$"
      Pat[++Fld]="(\"[[:digit:]]{1,3}\")$"
      Pat[++Fld]="^(\"[A-Z0-9]{1,8}\")$"
      Pat[++Fld]="^(\"[A-Z0-9]{0,1}\")$"
      Pat[++Fld]="^(\"[A-Z0-9]{0,11}\")$"
      Pat[++Fld]="^(\"\")$"
      Pat[++Fld]="^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$"
      Pat[++Fld]="^(\"[1-5]{1}\")$"
      Pat[++Fld]="^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$"
      Pat[++Fld]="^(\"[0-9]{4}[-/][0-9]{2}[-/][0-9]{2}\")$"
      Pat[++Fld]="^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$"
      Pat[++Fld]="^(\"([01]?[0-9]|2[0-3]):[0-5][0-9]:[0-5][0-9]\")|\"\"$"
      Pat[++Fld]="^(\"[A-Za-z0-9]{0,70}\")|\"\"$"
      Pat[++Fld]="^(\"[A-Za-z0-9]{1}\")|\"\"$"
      Pat[++Fld]="^(\"[0-9]{0,3}\")$"
      Pat[++Fld]="^(\".+\")$"
      Pat[++Fld]="^(\".+\")|\"\"$"
      }

    NF != 17 { 
       printf( "Line %3d : incorrect amount of fields\n", NR )
       next
       }

    {
    for (Idx=1; Idx<=Fld; Idx++ ) {
       if ( $Idx !~ Pat[Idx] ) {
          printf( "Line %3d : %2dth field is invalid\n", NR, Idx )
          }
       }
    }

    { printf( "Line %3d : you have 17 fields\n", NR ) }
    ' npp_test_file.csv

1
投票

如果你从最后一个块移除exit(当你在它时,删除那个-F,,你不需要它和FPAT):

...
{print "you have 17 fields";
exit}

...
{
    print "you have 17 fields"
}

输出将是

you have 17 fields
2nd field invalid
you have 17 fields
1st field invalid
2nd field invalid
you have 17 fields

这是你正在寻找的字段一是无效的,字段二是无效的“?

© www.soinside.com 2019 - 2024. All rights reserved.