【求助】三個文本處理的問題

ICrazyBox

本人初學(xué)這門課，遇到很多問題搞不懂，希望各位大神給與解答～～

【Q1】如何實現(xiàn)文本中刪除指定的字符？
例如：
        xxx -c aeiou xx.txt #刪除txt中所有的a,e,i,o,u

【Q2】uniq刪除的都是比較單純的重復(fù)行或者是忽略幾個字符

但是如何把：
        in what I said! "Twaddle!", you say? I'll have you know
        "Twaddle!", you say? I'll have you know
        there's a deep truth
        in what I said! there's a deep truth
變成：
        "Twaddle!", you say? I'll have you know
        in what I said! there's a deep truth
菜鳥表示完全沒有思路、、

【Q3】在忽略大小寫的情況下如何檢查并輸出拼寫錯誤的詞匯
我記得unix下有個online-dictionary但是真不知道怎麼用、
例’：        Im not
        certin
        mouses
        or
        catsll
        pass
        fael

輸出：
        Im certin
        mouses catsll
        fael

cao627

q1

1. $ echo "xxx -c aeiou xx.txt" | tr -d 'uoiea'
   
2. xxx -c  xx.txt

復(fù)制代碼

q2 沒看懂

Q3 首先要有字典，對文件中的每個單詞在字典中檢索，檢索不到輸出。

ICrazyBox

【Q1】
如果要求必須按照: sh xxx -c aeiou filename 這種形式來執(zhí)行，那么在shell script xxx中應(yīng)該怎麼寫呢？

【Q2】
是我自己突發(fā)奇想，我也不知道能不能實現(xiàn)。
大意：第n行是第m行的一部分，那么就保留m行，刪除第n行

【Q3】
字典是個什么樣的文件？如果我找到了應(yīng)該怎麼調(diào)用呢？

非常感謝之前的解答回復(fù) 2# cao627


   

spiraspera

回復(fù) 2# cao627
第二題應(yīng)該是這樣的，刪除第一次匹配的行，匹配到 in what I said! 和  there's a deep truth


   

ICrazyBox

我看到了一個題目要求去除重復(fù)
in what I said!
"Twaddle!", you say? I'll have you know
"Twaddle!", you say? I'll have you know
there's a deep truth
in what I said!
there's a deep truth

執(zhí)行后：
"Twaddle!", you say? I'll have you know
in what I said!
there's a deep truth

為什麼我執(zhí)行后是?
in what I said!
there's a deep truth
"Twaddle!", you say? I'll have you know

我用的：  cat filename | sort -d -u

spiraspera 發(fā)表于 2013-08-14 19:09
回復(fù) 2# cao627
第二題應(yīng)該是這樣的，刪除第一次匹配的行，匹配到 in what I said! 和  there's a deep t ...

cao627

【Q2】
是我自己突發(fā)奇想，我也不知道能不能實現(xiàn)。
大意：第n行是第m行的一部分，那么就保留m行，刪除第n行

但是如何把：
        in what I said! "Twaddle!", you say? I'll have you know
        "Twaddle!", you say? I'll have you know
        there's a deep truth
        in what I said! there's a deep truth
變成：
        "Twaddle!", you say? I'll have you know
        in what I said! there's a deep truth
菜鳥表示完全沒有思路、

"Twaddle!", you say? I'll have you know 怎么沒有刪除？ 它不是in what I said! "Twaddle!", you say? I'll have you know的一部分嗎？

1. $ awk '{a[NR]=$0;b[NR]=$0}END{for(i=1;i<=NR;i++)for(j=1;j<=NR;j++)if(i!=j && index(b[j],a[i])){delete a[i];break};for(i in a)print a[i]}' file
   
2. in what I said! there's a deep truth
   
3. in what I said! "Twaddle!", you say? I'll have you know
   

復(fù)制代碼

【Q3】
字典是個什么樣的文件？如果我找到了應(yīng)該怎麼調(diào)用呢？

字典就是你要求的所有合法單詞的集合。

ICrazyBox

我看到了一個題目要求去除重復(fù)
in what I said!
"Twaddle!", you say? I'll have you know
"Twaddle!", you say? I'll have you know
there's a deep truth
in what I said!
there's a deep truth

執(zhí)行后：
"Twaddle!", you say? I'll have you know
in what I said!
there's a deep truth

為什麼我執(zhí)行后是?
in what I said!
there's a deep truth
"Twaddle!", you say? I'll have you know

我用的：  cat filename | sort -d -u
回復(fù) 6# cao627


   

Shell_HAT

回復(fù) 7# ICrazyBox


因為那個題目的作者用了一種比較愚蠢的方法：

1. awk '{a[$0]++}END{for(i in a)if(a[i]>1)print i}' urfile

復(fù)制代碼