Lambda Function to Resize EBS Volumes of EMR Nodes
I have to start by saying that you should not use EMR as a persistent Hadoop cluster. The power of EMR lies in its elasticity. You should launch an EMR cluster, process the data, write the data to S3...
View ArticleHow to Use AWS S3 bucket for Spark History Server
Since EMR Version 5.25, it’s possible to debug and monitor your Apache Spark jobs by logging directly into the off-cluster, persistent, Apache Spark History Server using the EMR Console. You do not...
View ArticleHow to Use IAM authentication for RDS PostgreSQL with Glue ETL Jobs
Amazon RDS enables you to use AWS Identity and Access Management (IAM) to manage database access for Amazon RDS for PostgreSQL DB instances. It’s possible use the IAM authentication with Glue...
View ArticleUse Snowflake and Zepl to Analyse Covid-19 (coronavirus) Data
Coronavirus changed our life, most of us are stuck at home. We are trying to follow everything about the pandemic. So I wanted to write a blog post which will guide to configure an environment that you...
View ArticleAdvanced examples
MathJaxYou can enable MathJax by setting mathjax: true on a page or globally in the _config.yml. Some examples:Euler’s formula relates the complex exponential function to the trigonometric functions....
View ArticleMarkdown examples
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut...
View ArticleWelcome to Jekyll
You’ll find this post in your _posts directory. Go ahead and edit it and re-build the site to see your changes. You can rebuild the site in many different ways, but the most common way is to run jekyll...
View ArticleSample AWS Lambda Function to Monitor Oracle Databases
I wrote a very simple AWS Lambda function to demonstrate how to connect an Oracle database, gather the tablespace usage information, and send these metrics to CloudWatch. First, I wrote this lambda...
View ArticleAmazon QLDB and the Missing Command Line Client
Amazon Quantum Ledger Database is is a fully managed ledger database which tracks all changes of user data and maintains a verifiable history of changes over time. It was announced at AWS re:Invent...
View ArticleFocusing on Snowflake
As I moved to github pages, I will not publish my old posts about AWS, Oracle and other stuff. Although my posts are old, I still get questions about AWS, Oracle DB and Oracle Enterprise Manager but I...
View ArticlePySpark Examples
This post contains some sample PySpark scripts. During my presentation about “Spark with Python”, I told that I will share example codes (with detailed explanations). I posted them seperately, and now...
View ArticleHow To Find Storage Occupied by Each Internal Stage in Snowflake?
The account usage view has two views related to stages: STAGES and STAGE_STORAGE_USAGE_HISTORY. The STAGES view helps list all the stages defined in your account but does not show how much storage each...
View ArticleHow to Disable Caching in Snowflake for Testing Query Performance?
It’s a common question to ask how to disable caching in Snowflake for testing. Although it’s a very straightforward question, the answer is a bit complicated, and we need to understand the cache layers...
View ArticleBBED Block Browser Editor For Oracle 11g
BBED (Block Browser Editor) is a tool for Oracle internal use, and it helps you to read and manipulate data at the Oracle Database block level. No need to say that it’s very powerful and extremely...
View ArticleHow To Retrieve Passwords From The Named Credentials in EM12c?
The username, password, and role name of the named credentials are stored in the em_nc_cred_columns table. When we examine it, we can see that there’s one-to-many relation with em_nc_creds using the...
View ArticleHow To Recover The Weblogic Administrator Password Of The Enterprise Manager?
As you know, Weblogic is a part of the Enterprise Manager Cloud Control environment, and it’s automatically installed and configured by the EM installer. The Enterprise Manager asks you to enter a...
View ArticleOracle Enterprise Manager Cloud Control: Write Powerful Scripts With EMCLI
Last week, I attended the Oracle Open World and gave a presentation about writing scripts with EMCLI. If you’re unfamiliar with EMCLI, it’s the command line interface for Oracle Enterprise Manager...
View ArticleHow to Build A Cassandra Cluster On Docker?
In this blog post, I’ll show how to build a three-node Cassandra cluster on Docker for testing. I’ll use official Cassandra images instead of creating my images, so all processes will take only a few...
View ArticlePySpark Examples
This post contains some sample PySpark scripts. During my “Spark with Python” presentation, I said I would share example codes (with detailed explanations). I posted them separately earlier but decided...
View ArticleBoosting Performance in Snowflake: The Power of Automatic Clustering
One of the features that sets Snowflake apart is its automatic clustering capabilities. But what exactly is clustering, and how can it help improve performance?Clustering is a way to group similar data...
View Article