Need Help : mask / scrabble fields in a file ?

dradhzn

hi, anyone can give me some advices ?
   i want to mask or scrabble certain fields(replace it as **** for example) in a log file , requirement is :
parttern one is " pin=12345664, " , the pin number is not fixed length . parttern two is " ENCRYPTED_PIN_BLOCK=12rtdsfqweweweee23w," the encrypt field length is not a fixed one as well , this two field can be appear any line in a file . can be in a same line or different line .

another problem is the log file could be huge in size . 300 M . advisable using a shell script to achieved it ?

i have attached a sample file "sample.gif"

icesummit

sed 's/pin=[0-9]\{1,\}/***/' file

I cannot see your attached picture and don't quite understand your second patten.

icesummit

Or:
sed 's/pin=[0-9]\{1,\}/pin=***/' file

dradhzn

thanks a lot , pls ignore the gif file .
the second pattern is "ENCRYPTED_PIN_BLOCK=****," , THE **** field could be number and alphabet , for example "229A8F53BF8DE2D771D80DD8F4E488081BD69957980" , the length is not fixed .


example line 1
[ 2001-13-14 ] *** REQUESTED *** pin=123455, Cotroller: :getResult:Request: ONWER=master tech , ENCRYPT_PIN_BLOCK=229A8F53BF8DE2D771D80DD8F4E488081BD69957980, KEY=3444

or one pattern in only one line ,

icesummit

OK, try this one.

sed 's/pin=[0-9]\{1,\}/pin=***/;s/ENCRYPT_PIN_BLOCK=[0-9A-Z]*,./ENCRYPT_PIN_BLOCK=****/'

icesummit

sed 's/pin=[0-9]\{1,\}/pin=***/;s/ENCRYPT_PIN_BLOCK=[0-9A-Z]*,./ENCRYPT_PIN_BLOCK=****/' file

dradhzn

tested with 350M file with following time statistics :

real 225.03
user 45.58
sys  16.08

thank you so much .