(Expected time: 30-45 mins)
Recommended OS: Ubuntu 16.04/18.04
Recommended resources:
sudo apt-get install software-properties-common
sudo apt install openjdk-8-jdk
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 9DA31620334BD75D9DCB49F368818C72E52529D4
echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu "$(lsb_release -sc)"/mongodb-org/4.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-4.0.list
sudo apt-get update
sudo apt-get install -y mongodb-org=4.0.10 mongodb-org-server=4.0.10 mongodb-org-shell=4.0.10 mongodb-org-mongos=4.0.10 mongodb-org-tools=4.0.10
/etc/mongod.conf
(set a reasonable cacheSizeGB
, recommended to 50% of available RAM, ref) ...
wiredTiger:
engineConfig:
cacheSizeGB: 5
journalCompressor: none
collectionConfig:
blockCompressor: snappy
/etc/security/limits.d/mongodb.conf
(if you are using Red Hat Enterprise Linux or CentOS read this)mongodb soft nofile 1625538
mongodb hard nofile 1625538
mongodb soft nopro 64000
mongodb hard nopro 64000
mongodb soft memlock unlimited
mongodb hard memlock unlimited
mongodb soft fsize unlimited
mongodb hard fsize unlimited
mongodb soft cpu unlimited
mongodb hard cpu unlimited
mongodb soft as unlimited
mongodb hard as unlimited
To force your new limits to be loaded log out of all your current sessions and log back in.
If your Linux distribution uses systemd to manage services, create the following file /etc/systemd/system/mongod.service.d/ulimit.conf
[Service]
LimitNOFILE=1625538
LimitNPROC=64000
LimitFSIZE=infinity
LimitCPU=infinity
LimitAS=infinity
systemd
sudo systemctl daemon-reload
sudo service mongod start
To check if everything works as expected see the log file /var/log/mongodb/mongod.log
.
Recommendation: For convenient DB exploration and query execution install Robomongo (Robo3T) UI client.
Optionally set up users with authentication as described here.
For tuning tips go to here.
sudo apt-get update
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.10.deb
sudo dpkg -i elasticsearch-5.6.10.deb
sudo systemctl enable elasticsearch.service
/etc/elasticsearch/elasticsearch.yml
cluster.name: ada-cluster (if not changed "elasticsearch" is used by default)
bootstrap.memory_lock: true
network.host: x.x.x.x (set to a non-localhost ip address if the db should be accessible within a network)
thread_pool:
index:
queue_size: 8000
search:
queue_size: 8000
bulk:
queue_size: 500
indices.query.bool.max_clause_count: 4096
path.data: /your_custom_path
(Note that you need to make your_custom_path
writeable for the elasticsearch
user)
/etc/security/limits.d/elasticsearch.conf
elasticsearch soft nofile 1625538
elasticsearch hard nofile 1625538
elasticsearch soft memlock unlimited
elasticsearch hard memlock unlimited
To force your new limits to be loaded log out of all your current sessions and log back in.
/etc/init.d/elasticsearch
(and/or /etc/default/elasticsearch
)
MAX_OPEN_FILES=1625538
MAX_LOCKED_MEMORY=unlimited
/usr/lib/systemd/system/elasticsearch.service
LimitNOFILE=1625538
LimitMEMLOCK=infinity
/etc/elasticsearch/jvm.options
, e.g.
-Xms5g
-Xmx5g
systemd
sudo systemctl daemon-reload
sudo service elasticsearch start
To check if everything works as expected see the log file(s) at /var/log/elasticsearch/
and/or curl the server info by curl -XGET localhost:9200
.
sudo wget https://github.com/lmenezes/cerebro/releases/download/v0.8.3/cerebro-0.8.3.zip
sudo unzip cerebro-0.8.3.zip
conf/application.conf
and add the host and name of your Elastic server to the hosts
section, e.g.,
{
host = "http://x.x.x.x:9200"
name = "ada-cluster"
}
sudo ./bin/cerebro -Dhttp.port=9209
(Cerebro web client is then accessible at http://localhost:9209)
echo "deb https://artifacts.elastic.co/packages/5.x/apt stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-5.x.list
sudo apt-get update
sudo apt-get install kibana
sudo /bin/systemctl daemon-reload
sudo /bin/systemctl enable kibana.service
sudo service start kibana
wget https://webdav-r3lab.uni.lu/public/ada-artifacts/ada-web-0.8.1.zip
sudo apt-get install unzip
unzip ada-web-$VERSION.zip
cd ada-web-$VERSION/bin
mkdir ada_temp
Set the path and memory constraint variables ADA_TEMP
and ADA_MEM
in runme
script (Ada’s bin
folder).
Configure DB connections in set_env.sh
(bin
folder)
1 . Mongo
if not password-protected (default) set ADA_MONGO_DB_URI
export ADA_MONGO_DB_URI="mongodb://localhost:27017/ada?rm.nbChannelsPerNode=20"
if password-protected set the following variables
export ADA_MONGO_DB_HOST=x.x.x.x:27017
export ADA_MONGO_DB_NAME="ada"
export ADA_MONGO_DB_USERNAME="xxx_user"
export ADA_MONGO_DB_PASSWORD="XXX"
2 . Elastic Search
if non-localhost server is used set ADA_ELASTIC_DB_HOST
export ADA_ELASTIC_DB_HOST=x.x.x.x:9200
Also set the custom ES cluster name if it was configured in Section 3 (see /etc/elasticsearch/elasticsearch.yml
)
export ADA_ELASTIC_DB_CLUSTER_NAME="ada-cluster"
3 . General Setting
project
, ldap
(to enable access without authentication), and datasetimport
in custom.conf
(Ada conf
folder)project {
name = "Ultimate"
url = "https://ada-discovery.org"
logo = "images/logos/ada_logo_v4.png"
}
ldap {
mode = "local"
port = "65505"
debugusers = true
}
datasetimport.import.folder = "/custom_path"
custom.conf
assets.external_paths = ["/folder_in_classpath"]
(Warning: Never set any of the folders to “/” since this would make all the classpath files, including common configuration files, accessible from outside as application assets. An example: https://localhost:8080/assets/application.conf)
Now you can use the logo images placed in your folder_in_classpath
by adapting custom.conf
for instance as
project {
....
logo = "syscid_large.png"
}
footer.logos = [
{url: "https://www.aetionomy.eu", logo: "aetionomy.png", height: 150},
{url: "https://www.efpia.eu", logo: "efpia_logo.png"}
]
(Note an optional height
attribute)
./runme
(if cannot be executed chmod +x runme
might be needed)
To check if everything works as expected see the log file at $ADA_ROOT/bin/logs/application.log
You can now access Ada at
http://localhost:8080
http://localhost:8080/loginAdmin
Homepage
, Contact
, and Links
in Admin → HTML Snippets → [+]Homepage
example:
<p>
Ada provides key infrastructure for secured integration, visualization,
and analysis of heterogeneous clinical and experimental data generated
during the <a href="http://www.project_url_to_set.com">My TODO project</a>.
</p>
<p>
My TODO research project focuses on improving ...
</p>
<button type="button" class="btn btn-default btn-sm" data-toggle="collapse" data-target="#more-info">Read More</button>
<div id="more-info" class="collapse">
<blockquote>
<h4>The platform currently ...</h4>
</blockquote>
</div>
<br/>
Contact
example:
<strong>Dr. John Snow</strong></br>
Winterfell Team</br>
Westeros Centre For Systems Biomedicine (WCSB)</br>
University of Seven Kingdoms</br></br>
<i class="glyphicon glyphicon-envelope"></i>
<a href="mailto:john.snow@north.edu?Subject=Ada Question">john.snow@north.edu</a><br>
<i class="glyphicon glyphicon-chevron-right"></i>
<a target="_blank" href="http://www.north.edu/wcsb">www.north.edu/wcsb</a><br>
Links
example:
<li><a href="https://www.project-redcap.org">RedCap</a></li>
<li><a href="https://www.synapse.org">Synapse</a></li>
<li role="separator" class="divider"></li>
<li><a href="https://uni.lu/lcsb">LCSB Home</a></li>
If your Ada is accessible from outside/the internet or having two users (admin: /loginAdmin
and basic /loginBasic
) without authentication is not sufficient you must configure LDAP users with authentication
Configure LDAP in set_env.sh
export ADA_LDAP_HOST="XXX"
export ADA_LDAP_BIND_PASSWORD="XXX"
custom.conf
and remove mode
(default: remote) and port
(default: 389) and configure the LDAP groups, example:ldap {
dit = "cn=users,cn=accounts,dc=north,dc=edu"
groups = ["cn=my-group-name,cn=groups,cn=accounts,dc=north,dc=edu"]
bindDN = "uid=my-ldap-reader-xxx,cn=users,cn=accounts,dc=north,dc=edu"
debugusers = true
}
./stopme
and
./runme
Log in to Ada
Import LDAP users by clicking Admin → User Actions → Import from LDAP
Assign admin role to at least one user (yourself)
Admin → Users → double click on a user → Roles → [+] → write admin
→ Update
Disable debugusers
by removing it from custom.conf
or setting it to false
Restart Ada
Check if debugusers
have been disabled by trying to access http://localhost:8080/loginAdmin
(must not allow you in)
Login using your LDAP username and password
Start by importing your first data set in Admin → Data Set Imports → [+]
Have fun!