Data manipulation
to access, collect, process anything
All that is data handling
Developed automatic and semi-automatic data senders, receivers, collectors, pre-, post processors,
converters and recombinators to meet my clients' needs.
Contact: info(at)omnizer.eu
converters and recombinators to meet my clients' needs.
Contact: info(at)omnizer.eu
Skills
HTTP related data collection
Parsing HTML pages or using API calls to collect data to build database or timeseries.
Python3
Using Xlsxwriter, Pandas, Beautiful Soup, SciPy, Numpy, PyTorch, etc, modules.
Data formats to read and write:
- XML
- CSV or TXT files with other kind of delimiters
- json
- xls / xlsx
- html
- images, etc.
Scripting
Develop Windows powershell and Linux Bash scripts complemented by Sed, Awk and Regular Expressions.
SQL
Various database engines to store data like:
- Oracle,
- MsSQL Server,
- PostgeSQL,
- MySQL,
- BariaDB,
- MongoDB, etc.
Ancient databases
Extract data from various ancient databases, like:
- Dataflex,
- dBase III,
- Clipper,
- FoxPro, etc.
Ancient Code Pages
Recode data from various ancient character codepages, like:
- PETSCII,
- 7 bit ASCII,
- IBMxxx,
- ISO-8859-x,
- DOS, etc.
Projects
Multilateral data collector
Recombine Active Directory, Symantec Antivirus, McAfee Antivirus, Domain Name Servers, Syslog Storage Box, InsigthVM, RedCloak, Excel list, ServiceNow CMDB originated queries to compute the Key Performance Indicator on the basis of expectations and write all data and the processed KPIs to an xlsx file in a given format.
Data Sender solution
Custom developed solution to collect linux health data and send to Zabbix by ZabbixSender on a system where is not possible to install anything.
Custom hardware communication
Developed a data collector and preprocessor solution to a custom developed hardware equipment what is communicating via RS-232 connection by a proprietary protocol to an analogue wending machine.
Data collection from live websites
Developed a data collector and preprocessor solution to collect a time series from a living website by parsing the webpage.
Multi file analysis
Developed a custom tailored comparer, what analysed multi xlsx files (like a time series) to uncovering hidden correlations.