All about data, data mining and new technologies experiments http://zachmoshe.com/ Fri, 06 May 2022 11:59:32 +0300 Fri, 06 May 2022 11:59:32 +0300 Jekyll v3.9.2 How to implement a sum of gaussians model as a layer in Keras using the new TF 2.0 API. Thu, 01 Aug 2019 00:00:00 +0300 http://zachmoshe.com/2019/08/01/sum-of-gaussians-layer-with-keras-2.0.html http://zachmoshe.com/2019/08/01/sum-of-gaussians-layer-with-keras-2.0.html keras2.0 tensorflow2.0 gaussians Some useful tips for using Keras pretrained models (keras.applications) in your own Tensorflow graphs. Sat, 11 Nov 2017 00:00:00 +0200 http://zachmoshe.com/2017/11/11/use-keras-models-with-tf.html http://zachmoshe.com/2017/11/11/use-keras-models-with-tf.html keras tensorflow vgg A summary of my CS231n course project - A Convolutional Neural Network that detects the main four Simpsons characters. Wed, 03 May 2017 00:00:00 +0300 http://zachmoshe.com/2017/05/03/simpsons-detector.html http://zachmoshe.com/2017/05/03/simpsons-detector.html simpsons deep-learning python transfer-learning training-set-augmentation A short post on how to serialize Keras Model objects with python's Pickle library Mon, 03 Apr 2017 00:00:00 +0300 http://zachmoshe.com/2017/04/03/pickling-keras-models.html http://zachmoshe.com/2017/04/03/pickling-keras-models.html python deep-learning keras pickle How to efficiently join two Spark DataFrames on a range condition? The naive approach will end up with a full Cartesian Product and a filter, and while the generic solution to the problem is not very easy, a very popular use-case is to have join records based on timestamp difference (e.g. join every event to all measurements that were taken in the hour before its timestamp). This allows a quick win with a more efficient way to do the join as demonstrated in the post. Mon, 26 Sep 2016 00:00:00 +0300 http://zachmoshe.com/2016/09/26/efficient-range-joins-with-spark.html http://zachmoshe.com/2016/09/26/efficient-range-joins-with-spark.html spark spark-sql range-join How to launch the cheapest single-node Docker cluster? This post will compare fully managed docker clusters from Google (Google Container Engine) and Amazon (AWS Container Service). Since both products are similar in capabilities (or at least, cover my basic needs), the effort will be to try and get the cheapest node possible. That does the work for me mainly as a playground or for very tiny jobs/APIs. Thu, 28 Apr 2016 00:00:00 +0300 http://zachmoshe.com/2016/04/28/cheapest-single-node-docker-cluster.html http://zachmoshe.com/2016/04/28/cheapest-single-node-docker-cluster.html ecs docker cluster How to generate many non-overlapping random polygons on a plane? While doing so, we'll also look on random-grids (i.e. grids in which every boundary between two cells is probabilistic) and estimate the average block size by the size of the grid and the probability. Wed, 11 Nov 2015 00:00:00 +0200 http://zachmoshe.com/2015/11/11/random-polygons.html http://zachmoshe.com/2015/11/11/random-polygons.html polygons random-grid connected-components How to design and build a serverless architecture website, using various AWS products to cut down costs and avoid monthly payments. The webapp is based on AngularJS for the frontend (backed by S3 to host it), SNS and SQS to manage messages and work queues, AWS Lambda to manage the spot instances (workers) and my original python code to actually solve the boards. Wed, 29 Jul 2015 00:00:00 +0300 http://zachmoshe.com/2015/07/29/griddlers-ninja-serverless-architecture.html http://zachmoshe.com/2015/07/29/griddlers-ninja-serverless-architecture.html architecture serverless griddlers-ninja Trying to look at Israel's latest elections results and form homogeneous clusters of ballots. Will we get the "state of TLV" in the data as well? Tue, 24 Mar 2015 00:00:00 +0200 http://zachmoshe.com/2015/03/24/israel-elections-part-1.html http://zachmoshe.com/2015/03/24/israel-elections-part-1.html elections clustering How to use ruby gems in a script that goes to Hadoop Streaming? Dealing with dependency management, packaging and deploying the archive to the cloud. Mon, 23 Feb 2015 00:00:00 +0200 http://zachmoshe.com/2015/02/23/use-ruby-gems-with-hadoop-streaming.html http://zachmoshe.com/2015/02/23/use-ruby-gems-with-hadoop-streaming.html hadoop ruby