Bookmarks
3294 shaares
60 results
tagged
analysis
VADER (Valence Aware Dictionary and sEntiment Reasoner) is a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media. It is fully open-sourced under the MIT License]. Incorporated into NLTK.
Open source machine learning and data visualization for novice and expert. Interactive data analysis workflows with a large toolbox. Perform simple data analysis with clever data visualization. Explore statistical distributions, box plots and scatter plots, or dive deeper with decision trees, hierarchical clustering, heatmaps, MDS and linear projections. Interactive data exploration. Add-ons available.
Visualization and exploration software for all kinds of graphs and networks. Map and explore data points and entities. Trace links between entities. Analyze graph data for patterns. Can be extended with plugins (https://gephi.org/plugins/).
Aleph is a tool for indexing large amounts of both documents (PDF, Word, HTML) and structured (CSV, XLS, SQL) data for easy browsing and search. It is built with investigative reporting as a primary use case. Aleph allows cross-referencing mentions of well-known entities (such as people and companies) against watchlists, e.g. from prior research or public datasets. Web-based search. Processing includes optical character recognition, language and encoding detection and named entity extraction. Load structured entity graph data from databases and CSV files. This allows navigation of complex datasets like companies registries, sanctions lists or procurement data.
Snips NLU (Natural Language Understanding) is a Python library that allows to parse sentences written in natural language and extracts structured information. Behind every chatbot and voice assistant lies a common piece of technology: Natural Language Understanding (NLU). Anytime a user interacts with an AI using natural language, their words need to be translated into a machine-readable description of what they meant. The NLU engine first detects what the intention of the user is (a.k.a. intent), then extracts the parameters (called slots) of the query. The developer can then use this to determine the appropriate action or response.
A text-based signal and spectrum analyzer for RTL-SDR radios. Everything is done in ASCII in realtime. Allows you to tune the radio as well as watch it.
This source code is an implementation of the TextRank algorithm (Automatic summarization) on PHP7 strict mode. It can summarize a text, article for example to a short paragraph. Before it would start the summarizing it removes the junk words what are defined in the Stopwords namespace. It is possible to extend it with another languages.
Datasette provides an instant, read-only JSON API for any SQLite database, even those applications on your system maintain. It also provides tools for packaging the database up as a Docker container and deploying that container to hosting providers such as Zeit Now. Got CSV data? Use csvs-to-sqlite to convert them to SQLite. Runs its own webserver on localhost:8001 so you don't need to write code to use it, just point it at a .sqlite3 file.
Requires Python 3.
Requires Python 3.
Enter your zipcode to catch up on the candid thoughts of individuals who represent you.
Online service for doing textual analysis of documents (sent to and online). Realtime analysis. Offers SDKs, so the REST API is probably in there somewhere. Sentiment analysis (general and domain-specific). Classification and categorization. Entity and concept detection and extraction. Hashtag suggestion.
3 hits/second
1000 hits/day for free
By looking around in here you can tell what the API rails are and how to use them:
https://github.com/AYLIEN/aylien_textapi_python/blob/master/aylienapiclient/textapi.py#L84
extract, classify, concepts, entities, hashtags, language, related, sentiment, summarize, microformats, image-tags, classify/unsupervised (picks the most semantically relevant class label or tag), combined (runs multiple analysis operations in one API call).
headers = {
'Accept': 'application/json',
'Content-type': 'application/x-www-form-urlencoded',
'X-AYLIEN-TextAPI-Application-ID': application ID,
'X-AYLIEN-TextAPI-Application-Key': application key,
'User-Agent': "Aylien Text API Python " + aylienapiclient.__version__ (0.6.0 as of right now)
}
3 hits/second
1000 hits/day for free
By looking around in here you can tell what the API rails are and how to use them:
https://github.com/AYLIEN/aylien_textapi_python/blob/master/aylienapiclient/textapi.py#L84
extract, classify, concepts, entities, hashtags, language, related, sentiment, summarize, microformats, image-tags, classify/unsupervised (picks the most semantically relevant class label or tag), combined (runs multiple analysis operations in one API call).
headers = {
'Accept': 'application/json',
'Content-type': 'application/x-www-form-urlencoded',
'X-AYLIEN-TextAPI-Application-ID': application ID,
'X-AYLIEN-TextAPI-Application-Key': application key,
'User-Agent': "Aylien Text API Python " + aylienapiclient.__version__ (0.6.0 as of right now)
}
Pyre is a fast, scalable type checker for large python codebases, designed to help improve code quality and development speed by flagging type errors interactively in your terminal or favorite editor. We follow the typing standards introduced in PEP484 and PEP526.
https://github.com/facebook/pyre-check
https://github.com/facebook/pyre-check
A nonprofit DNA and genealogy research website. You have to upload your DNA sequencing report to be allowed to search the database. Requires registration.
A tool which digs up OSINT on a target. Domain names, usernames, phones, credentials API keys, and correlates them. Performs active scans to collect data. Generates HTML, JSON, plain text reports.
Redash is a web console for interfacing with databases, building queries and reports, and visualizing results. Includes SQLite, MySQL, Postgres, and even JSON documents. Snippets can be saved. Caches results, can autoupdate. Can join across different databases. Dashboards can be shared via unique links. Of course, has an API.
Github repo: https://github.com/getredash/redash
Github repo: https://github.com/getredash/redash
tcpxtract is a tool for extracting files from network traffic based on file signatures.
Host-based IDS software - the famous *Sentry line of system monitors.
analysis cracking linux monitoring network opensource server software tools unix security
analysis cracking linux monitoring network opensource server software tools unix security
A website that can extract many different sorts of information pertaining to IP addresses and networks, least of all querying several dozen blacklists to see if an address has been flagged as a spammer's.
A Perl script that aids in the analysis of firewall rules. Right now, it only supports the Cisco PIX.
perl script utility security firewalll cisco pix rules auditing analysis
perl script utility security firewalll cisco pix rules auditing analysis