All the data you need.

Tag: Software Development

Software metric outliers
Goodhart’s law says “When a measure becomes a target, it ceases to be a good measure.” That is, when people are rewarded on the basis of some metric, they’ll learn how to improve that metric, but not necessarily in a way that increases what you’re after. Here are three examples …
Computational survivalist
Some programmers and systems engineers try to do everything they can with basic command line tools on the grounds that someday they may be in an environment where that’s all they have. I think of this as a sort of computational survivalism. I’m not much of a computational survivalist, but …
New Software Development Initiatives Lead To Second Stage Of Big Data
The big data market is expected to be worth $189 billion by the end of this year. This is over a 50% increase in just four years. A number of factors are driving growth in big data. Demand for big data is part of the reason for the growth, but …
The hopeless task of the Unicode Consortium
Randall Monroe, author of xkcd, discussing Unicode on the Triangulation podcast: I am endlessly delighted by the hopeless task that the Unicode Consortium has created for themselves. … They started out just trying to unify a couple different character sets. And before they quite realized what was happening, they were …
Regular expressions and special characters
Special characters make text processing more complicated because you have to pay close attention to context. If you’re looking at Python code containing a regular expression, you have to think about what you see, what Python sees, and what the regular expression engine sees. A character may be special to …
Contributing to open source projects
David Heinemeier Hansson presents a very gracious view of open source software in his keynote address at RailsConf 2019. And by gracious, I mean gracious in the theological sense. He says at one point “If I were a Christian …” implying that he is not, but his philosophy of software …
What is the real difference between Data Science and Software Engineering Teams?
Although there are lots of similarities across Software Development and Data Science , they also have three main differences: processes, tooling and behavior. Find out. In my previous article, I talked about model governance and holistic model management. I received great response, along with some questions about the differences between …
Traditional Vs Machine Learning For Software Development Paradigms
Most of the practitioners agree upon the neural nets proceeds while representing a shift in coding as currently, the industry has first interest in artificial intelligence which is entirely focused on data-driven AI. Is machine learning helpful to speed up traditional software development? We all know how AI is becoming …
3 Important Things To Know About Cloud Automation
DevOps has become the go-to methodology that technology companies use to streamline the process of developing and releasing their apps and services. Old methodologies like the waterfall approach don’t deploy fast enough and at the scale you need these days. But to take full advantage of the speed, agility, convenience, …
Introducing a simple and intuitive Python API for UCI machine learning repository
Introducing a simple and intuitive API for UCI machine learning portal, where users can easily look up a data set description, search for a particular data set they are interested, and even download datasets categorized by size or machine learning task.
Format-preserving encryption (FPE) for privacy
The idea of format-preserving encryption is to encrypt data while keeping its form, a sort of encryption in kind. An encrypted credit card number would look like a credit card number, a string of text would be replaced with a string of text, etc. Format preserving encryption (FPE) is useful …
Software quality: better in practice than in theory
C. A. R. Hoare wrote an article How Did Software Get So Reliable Without Proof? in 1996 that still sounds contemporary for the most part. In the 1980’s many believed that programs could not get much bigger unless we started using formal proof methods. The argument was that bugs are …
The right level of abstraction
Mark Dominus wrote a blog post yesterday entitled Why I never finish my Haskell programs (part 1 of ∞). In a nutshell, there’s always another layer of abstraction. “Instead of just adding lists of numbers, I can do addition-like operations on list-like containers of number-like things!” Is this a waste …