Using web-scrapping and WebGL to melt any webpage for fun.

What It Does

So I created a website which ‘melts’ other webpages.

Ok let’s be frank: this does not melt webpages. Basically, it finds all ‘greyish’ pixels and then moves them slowly down the page. So you put in any domain name you want and then press the submit button, the submitted webpage is then rendered and when the user clicks a button or scrolls down the page the webpage seems to ‘melt’.

The best way of describing this is with an example.

An example of PageMelt working on the StackOverflow website. Source: Image by Author.

Another example is shown below demonstrating how…

A quick literature review and example MNIST fits

Introduction

I’ve wanted to learn more about neural nets and in particular TensorFlow for a while now. I recently had a bit more time to dedicate to it, so began to write about what I had learned and some of the basic examples I had ran through.

Even though this information has been covered before, I decided to post it since it could help other beginners like myself. I’ve focused on parts which I thought were essential; hopefully making the subject matter as clear as possible without losing substance.

Concepts

The usual picture of a neural net as a bunch of nodes…

An outline of how I automated the deployment of my personal site.

Introduction

A while back I set up a personal website for myself. It was left for a while and recently I made some improvements to it. As I was doing the improvements I decided to write up how it was built since there were certain aspects of the work I found interesting.

There are similar stories out there like this one or this one. However, their setup is a bit different or does not go into some details I cover. Plus it never hurts to have additional resources when you are building something.

When I first started, all I needed was…

Logging for production nodeJS applications

Collecting some logs is easier than others…

Introduction

This post focuses on logging for node applications within a micro-services architecture. Correlation of logs using request ids from API Gateway (APIGW) and an Application Load Balancer (ALB) is highlighted. These apps are managed containers or lambdas.

If you are looking for more information on amalgamation of data, analysis, visualisation or storage then check our my elasticsearch post which follows loosely on from this.

Creating Logs

First you will need to create a cloudwatch group. Some services will do this but need the correct permissions specified by an IAM role. The role should also allow for you to create streams within that…

An introduction to the new container orchestration service from AWS

Problem

AWS diagrams, as usual, hiding the complexity of your final setup

The diagram above is concerned only with Fargate and container orchestration. If you are build anything of moderate size you will need to consider much more beyond that.

You will need to consider what type of application you are deploying.

  • Are they under different domains and APIs?
  • How quick will you need to redeploy aspects of you infrastructure? Minutes, hours, days?
  • What is the security consideration of each app?
  • Do you need to secure some APIs and not others?
  • How will you deal with logging and monitoring?
  • Is it behind a load balancer?

We also need to consider CI/CD pipelines…

A quick introduction to setting up AWS managed elasticsearch, kibana, cognito and cloudwatch subscription filters

Introduction

Overview of some of the places you will receive logs in AWS directed at an ES cluster. ©JasonPoley

Logging and monitoring your infrastructure sounds easier than it is.

The first issue is all the different services you will need to pay attention to. The diagram above only covers some AWS services, you will usually be using other external services like databases outside of your AWS infrastructure as well.

The next issue is for each component you will need to consider how you get you data securely to elasticsearch or whatever stash your are using.

Lastly, all your logs will need some processing since some of the components will inherently produce different formats even if your applications use a…

Alexander Morton

A DevOps engineer specialised in cloud infrastructure with a background in theoretical and experimental physics.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store