Clash Royale CLAN TAG#URR8PPP

extract value from the last row in table in shell script [closed]

I have a file (data.txt) with below content. It has multiple rows in it separated by sequence of -. It looks like a graphical table put in a file. In the below file, first row has all the column names and all other rows are the actual data for all those columns.

-

Connecting to the ControlService endpoint

Found 3 rows.
Requests List:
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Client ID | Client Type | Service Type | Status | Trust Domain | Data Instance Name | Data Version | Creation Time | Last Update | Scheduled Time |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
REFRESH_ROUTINGTIER_ARTIFACTS_1465901168866 | ROUTINGTIER_ARTIFACTS | SYSTEM | COMPLETED | RRA Bulk Client | soa_server1 | 18.2.2.0.0 | 2016-06-14 03:49:55 -07:00 | 2016-06-14 03:49:57 -07:00 | --- |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
500333443 | CREATE | [FA_GSI] | COMPLETED | holder | soa_server1 | 18.3.2.0.0 | 2018-08-07 11:59:57 -07:00 | 2018-08-07 12:04:37 -07:00 | --- |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
500333446 | CREATE | [FA_GSI] | COMPLETED | holder-test | soa_server1 | 18.3.2.0.0 | 2018-08-07 12:04:48 -07:00 | 2018-08-07 12:08:52 -07:00 | --- |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------


Now I want to parse the above file and extract value from the last row. I want to extract value of "Client ID" and "Trust Domain" column in the last row which is:

Client ID: 500333446
Trust Domain: holder-test


Is this possible to do in shell script or perl or python?

Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

4 Answers
4

The solution by @paragbaxi is fine I would only add an condition to filter out the lines containing only "------". Like so:

import csv

lines_to_skip = 4
with open('data.csv', 'r') as f:
reader = csv.reader(f, delimiter='|')
for i in range(lines_to_skip):
next(reader) #Skipping lines

data =
for line in reader:
if line[0].find("---") != 0: #Check what position has symbol "---" if 0 then skip
print(line)
data.append(line)


print("Last row:n".format(data[-1]))
print("Client ID: Domain:".format(data[-1][0].replace(" ",""),data[-1][4].replace(" ",""))) #replace() just removes unnecessary spaces


Output:

[' Client ID ', ' Client Type ', ' Service Type ', ' Status ', ' Trust Domain ', ' Data Instance Name ', ' Data Version ', ' Creation Time ', ' Last Update ', ' Scheduled Time ', ' ']
[' REFRESH_ROUTINGTIER_ARTIFACTS_1465901168866 ', ' ROUTINGTIER_ARTIFACTS ', ' SYSTEM ', ' COMPLETED ', ' RRA Bulk Client ', ' soa_server1 ', ' 18.2.2.0.0 ', ' 2016-06-14 03:49:55 -07:00 ', ' 2016-06-14 03:49:57 -07:00 ', ' --- ', ' ']
[' 500333443 ', ' CREATE ', ' [FA_GSI] ', ' COMPLETED ', ' holder ', ' soa_server1 ', ' 18.3.2.0.0 ', ' 2018-08-07 11:59:57 -07:00 ', ' 2018-08-07 12:04:37 -07:00 ', ' --- ', ' ']
[' 500333446 ', ' CREATE ', ' [FA_GSI] ', ' COMPLETED ', ' holder-test ', ' soa_server1 ', ' 18.3.2.0.0 ', ' 2018-08-07 12:04:48 -07:00 ', ' 2018-08-07 12:08:52 -07:00 ', ' --- ', ' ']
Last row:
[' 500333446 ', ' CREATE ', ' [FA_GSI] ', ' COMPLETED ', ' holder-test ', ' soa_server1 ', ' 18.3.2.0.0 ', ' 2018-08-07 12:04:48 -07:00 ', ' 2018-08-07 12:08:52 -07:00 ', ' --- ', ' ']
Client ID:500333446 Domain:holder-test

Process finished with exit code 0


Client ID

Trust Domain

500333446

holder-test

.replace(" ","")

print("".format(data[-1][4].replace(" ","")))

holder-test

print("".format(data[-1][4].replace(" ","")))

Yes, it's possible to do in python. I suggest csv module and customize delimiter to '|'.

import csv
with open('s', 'r') as f:
reader = csv.reader(f, delimiter='|')
for row in reader:
print(row)


Gives the following list:

['Connecting to the ControlService endpoint']

['Found 3 rows.']
['Requests List:']
['-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------']
[' Client ID ', ' Client Type ', ' Service Type ', ' Status ', ' Trust Domain ', ' Data Instance Name ', ' Data Version ', ' Creation Time ', ' Last Update ', ' Scheduled Time ', ' ']
['-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------']
[' REFRESH_ROUTINGTIER_ARTIFACTS_1465901168866 ', ' ROUTINGTIER_ARTIFACTS ', ' SYSTEM ', ' COMPLETED ', ' RRA Bulk Client ', ' soa_server1 ', ' 18.2.2.0.0 ', ' 2016-06-14 03:49:55 -07:00 ', ' 2016-06-14 03:49:57 -07:00 ', ' --- ', ' ']
['-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------']
[' 500333443 ', ' CREATE ', ' [FA_GSI] ', ' COMPLETED ', ' holder ', ' soa_server1 ', ' 18.3.2.0.0 ', ' 2018-08-07 11:59:57 -07:00 ', ' 2018-08-07 12:04:37 -07:00 ', ' --- ', ' ']
['-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------']
[' 500333446 ', ' CREATE ', ' [FA_GSI] ', ' COMPLETED ', ' holder-test ', ' soa_server1 ', ' 18.3.2.0.0 ', ' 2018-08-07 12:04:48 -07:00 ', ' 2018-08-07 12:08:52 -07:00 ', ' --- ', ' ']
['-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------']


You could easily skip the first 4 rows in the resulting list.

>>> import csv
... from itertools import islice
...
... with open('infile', 'r') as f:
... reader = csv.DictReader(islice(f, 5, None, 2), delimiter='|')
... result = [
... k.strip(): v.strip() for k, v in line.items() for line in reader
... ]
...
>>> last_row = result[-1]
>>> import json; print(json.dumps(last_row, indent=2))

"Client ID": "500333446",
"Client Type": "CREATE",
"Service Type": "[FA_GSI]",
"Status": "COMPLETED",
"Trust Domain": "holder-test",
"Data Instance Name": "soa_server1",
"Data Version": "18.3.2.0.0",
"Creation Time": "2018-08-07 12:04:48 -07:00",
"Last Update": "2018-08-07 12:08:52 -07:00",
"Scheduled Time": "---",
"": ""

>>> last_row['Client ID']
'500333446'
>>> last_row['Trust Domain']
'holder-test'


One in awk:

awk 'BEGIN"!/^-+/c=$1;t=$5ENDprint "Client ID:" c ORS "Trust Domain:" t' file


Explained:

$ awk '
BEGIN " # pipe-separator
!/^-+/ # process if doesnt start with dashes
c=$1 # client value
t=$5 # trust domain value

END # in the end
print "Client ID:" c ORS "Trust Domain:" t # output the last value pair
' file


Output:

Client ID: 500333446
Trust Domain: holder-test