Dependability Analysis of Deep Reinforcement Learning based Robotics and Autonomous Systems. While Deep Reinforcement Learning (DRL) provides transformational capabilities to the control of Robotics and Autonomous Systems (RAS), the black box nature of DRL and uncertain deployment environments of RAS pose new challenges on its dependability. Although there are many existing works imposing constraints on the DRL policy to ensure a successful completion of the mission, it is far from adequate in terms of assessing the DRL driven RAS in a holistic way considering all dependability properties. In this paper, we formally define a set of dependability properties in temporal logic and construct a Discrete Time Markov Chain (DTMC) to model the dynamics of risk failures of a DRL driven RAS interacting with the stochastic environment. We then do Probabilistic Model Checking based on the designed DTMC to verify those properties. Our experimental results show that the proposed method is effective as a holistic assessment framework, while uncovers conflicts between the properties that may need trade offs in the training. Moreover, we find the standard DRL training cannot improve dependability properties, thus requiring bespoke optimisation objectives concerning them. Finally, our method offers a novel dependability analysis to the Sim to Real challenge of DRL.


Belief function based semi supervised learning for brain tumor segmentation. Precise segmentation of a lesion area is important for optimizing its treatment. Deep learning makes it possible to detect and segment a lesion field using annotated data. However, obtaining precisely annotated data is very challenging in the medical domain. Moreover, labeling uncertainty and imprecision make segmentation results unreliable. In this paper, we address the uncertain boundary problem by a new evidential neural network with an information fusion strategy, and the scarcity of annotated data by semi supervised learning. Experimental results show that our proposal has better performance than state of the art methods.


Two Point Boundary Value Problems on Diffeomorphism Groups. We consider a variety of geodesic equations on Sobolev diffeomorphism groups, including the equations of ideal hydrodynamics. We prove that solutions of the corresponding two point boundary value problems are precisely as smooth as their boundary conditions. We further utilise this regularity property to construct continuously differentiable exponential maps in the Frech 'et setting.


A Sidelink Aided Approach for Secure Multicast Service Delivery from Human Oriented Multimedia Traffic to Machine Type Communications. To date, group oriented communications have been mainly exploited for delivering multimedia services in human oriented communications while, in future fifth generation (5G) cellular networks, objects will be the main target. Internet of Things (IoT) will undoubtedly play a key role in 5G networks, wherein massive machine type communications (mMTC) feature a use case as crucial as challenging since cellular IoT connections are predicted to grow heavily in the next future. To boost capacity and energy efficiency, the 5G network can leverage device to device (D2D) communications which are recognized as an effective offloading technique. This is achieved thanks to the fact that, in legacy D2D communications, data are directly sent from one device to another, avoiding the crossing of the network. Obviously, the distributed nature of such a communication paradigm and the inherent broadcast nature of the wireless channel make it necessary to think how to secure the so called "sidelink" transmissions. This work proposes a protocol for the efficient and reliable management of multicast services in a 5G oriented IoT scenario, in which security is a crucial requirement to be met. The proposed protocol is tailored to Narrowband IoT (NB IoT) and makes use of D2D communications with the aim of improving network efficiency and optimizing network resource utilization. In addition, cyber security and social trustworthiness mechanisms are exploited to secure D2D communications.


Spectra of three peg Hanoi towers graphs. We consider the relationship between the Laplacians on two sequences of planar graphs, one from the theory of self similar groups and one from analysis on fractals. By establishing a spectral decimation map between these sequences we give an elementary calculation of the spectrum of the former, which was first computed by Grigorchuk and v S uni ' c . Our method also gives a full description of the eigenfunctions.


The theorems on freedom for relatively free groups with a relations. In this paper we prove the theorem on freedom for relatively free groups with a single relation (analogous with the well known result of Magnus) and a generalized Freiheitssatz for relatively free groups (analogous with the well known result of Romanovski)


Application Checkpoint and Power Study on Large Scale Systems. Power efficiency is critical in high performance computing (HPC) systems. To achieve high power efficiency on application level, it is vital importance to efficiently distribute power used by application checkpoints. In this study, we analyze the relation of application checkpoints and their power consumption. The observations could guide the design of power management.


6 DOF Feature based LIDAR SLAM using ORB Features from Rasterized Images of 3D LIDAR Point Cloud. An accurate and computationally efficient SLAM algorithm is vital for modern autonomous vehicles. To make a lightweight the algorithm, most SLAM systems rely on feature detection from images for vision SLAM or point cloud for laser based methods. Feature detection through a 3D point cloud becomes a computationally challenging task. In this paper, we propose a feature detection method by projecting a 3D point cloud to form an image and apply the vision based feature detection technique. The proposed method gives repeatable and stable features in a variety of environments. Based on such features, we build a 6 DOF SLAM system consisting of tracking, mapping, and loop closure threads. For loop detection, we employ a 2 step approach i.e. nearest key frames detection and loop candidate verification by matching features extracted from rasterized LIDAR images. Furthermore, we utilize a key frame structure to achieve a lightweight SLAM system. The proposed system is evaluated with implementation on the KITTI dataset and the University of Michigan Ford Campus dataset. Through experimental results, we show that the algorithm presented in this paper can substantially reduce the computational cost of feature detection from the point cloud and the whole SLAM system while giving accurate results.


On approximation of hypersingular integral operators by bounded ones. We solve the Stechkin problem about approximation of generally speaking unbounded hypersingular integral operators by bounded ones. As a part of the proof, we also solve several related and interesting on their own problems. In particular, we obtain sharp Landau Kolmogorov type inequalities in both additive and multiplicative forms for hypersingular integral operators and prove a sharp Ostrowski type inequality for multivatiate Sobolev classes. We also give some applications of the obtained results, in particular study the modulus of continuity of the hypersingular integral operators, and solve the problem of optimal recovery of the value of a hypersingular integral operator based on the argument known with an error.


Experimental demonstration of a mmWave passive access point extender based on a binary reconfigurable intelligent surface. As data rates demands are exploding, 5G will soon rely on mmWaves that offer much higher bandwidths. Yet at these frequencies, attenuation and diffraction of waves require point to point communications with beamforming base stations that are complex and power greedy. Furthermore, since any obstacle at these frequencies completely blocks the waves, the networks must be extremely dense, resulting in dramatic increase of its cost. One way to avoid this problem is to redirect beams coming from base stations at many locations with Reconfigurable Intelligent Surfaces, in order to increase their coverage even in cluttered environments. Here we describe and experimentally demonstrate a binary tunable metasurface operating at 28 GHz, based on standard PCB and off the shelves PIN diodes. We show that it can be used as a Reconfigurable Intelligent Surface that beamforms an incoming plane wave at a given angle to one or several outgoing plane waves at angles reconfigurable in real time. Most importantly we use this 20 cm times 20 cm reconfigurable Intelligent Surface alongside software defined radio and up down converters at 28 GHz, and demonstrate a wireless link between an emitter and a receiver 10 meters away, in a non line of sight configuration, hence proving the validity of the approach.


Truncated Euler Maruyama method for time changed stochastic differential equations with super linear state variables and H "older's continuous time variables. An explicit numerical method is developed for a class of non autonomous time changed stochastic differential equations, whose coefficients obey H "older's continuity in terms of the time variables and are allowed to grow super linearly in terms of the state variables. The strong convergence of the method in the finite time interval is proved and the convergence rate is obtained. Numerical simulations are provided.


The Bessel Line Ensemble. In this paper we construct the Bessel line ensemble mathcal B j, j in mathbb N , a collection of continuous random curves mathcal B j mathbb R rightarrow mathbb R . This line ensemble is stationary under horizontal shifts with the Bessel point process as its one time marginal. Furthermore the finite dimensional distribution of it is given by the extended Bessel kernel and it enjoys a novel resampling invariance with respect to non intersecting squared Bessel bridges. The construction of mathcal B is through extracting the hard edge scaling limit of a collection of independent squared Bessel processes starting at the origin and conditioned never to intersect. This process is also known as the Dyson Bessel process with beta 2 and arises as the evolution of the eigenvalues of the Laguerre unitary ensemble with i.i.d complex Brownian entries.


Real time Updating of Dynamic Social Networks for COVID 19 Vaccination Strategies. Vaccination strategy is crucial in fighting against the COVID 19 pandemic. Since the supply is limited, contact network based interventions can be most powerful to set an optimal strategy by identifying high risk individuals or communities. However, due to the high dimension, only partial and noisy network information can be available in practice, especially for dynamical systems where the contact networks are highly time variant. Furthermore, numerous mutations of SARS CoV 2 impact considerably the current infectious probability, requiring real time network updating algorithms. In this study, we propose a sequential network updating approach based on data assimilation techniques to combine different sources of temporal information. We then prioritise the individuals with high degree or high centrality, obtained from the assimilated networks, for vaccination. The assimilation based approach is compared with the standard method (based on partially observed networks) and a random selection strategy in terms of vaccination effectiveness in a SIR model. The numerical comparison is first carried out using real world face to face dynamical networks collected in a high school, following by sequential multi layer networks, generated relying on the Barabasi Albert model emulating the department of Computing at Imperial College London in the UK as an example.


Orientation instability of settling spheroids in a linearly density stratified fluid. Much work has been done to understand the settling dynamics of spherical particles in a homogeneous and a stratified fluid. However, the effects of shape anisotropy on the settling dynamics of a particle in a stratified fluid are not completely understood. To this end, we perform numerical simulations for settling oblate and prolate spheroids in a stratified fluid. We present the results for the Reynolds number, Re , in the range 80 250 and the Richardson number, Ri , in the range 0 10 . We find that both the oblate and prolate spheroids reorient to the edge wise and partially edge wise orientations, respectively, as they settle in a stratified fluid completely different from the steady state broad side on orientation observed in a homogeneous fluid. We observe that reorientation instabilities emerge when the velocity magnitude of the spheroids fall below a particular threshold. We also report the enhancement of the drag on the particle from stratification. The torque due to buoyancy effects tries to orient the spheroid in an edge wise orientation while the hydrodynamic torque tries to orient it to a broad side on orientation. Below the velocity threshold, the buoyancy torque dominates resulting in the onset of reorientation instability. Finally, the asymmetry in the distribution of the baroclinic vorticity generation term around the spheroids explains the onset of the reorientation instability.


Deep Learning based Extreme Heatwave Forecast. Because of the impact of extreme heat waves and heat domes on society and biodiversity, their study is a key challenge. We specifically study long lasting extreme heat waves, which are among the most important for climate impacts. Physics driven weather forecast systems or climate models can be used to forecast their occurrence or predict their probability. The present work explores the use of deep learning architectures, trained using outputs of a climate model, as an alternative strategy to forecast the occurrence of extreme long lasting heatwaves. This new approach will be useful for several key scientific goals which include the study of climate model statistics, building a quantitative proxy for resampling rare events in climate models, study the impact of climate change, and should eventually be useful for forecasting. Fulfilling these important goals implies addressing issues such as class size imbalance that is intrinsically associated with rare event prediction, assessing the potential benefits of transfer learning to address the nested nature of extreme events (naturally included in less extreme ones). We train a Convolutional Neural Network, using 1000 years of climate model outputs, with large class undersampling and transfer learning. From the observed snapshots of the surface temperature and the 500 hPa geopotential height fields, the trained network achieves significant performance in forecasting the occurrence of long lasting extreme heatwaves. We are able to predict them at three different levels of intensity, and as early as 15 days ahead of the start of the event (30 days ahead of the end of the event).


Learning to Relate Depth and Semantics for Unsupervised Domain Adaptation. We present an approach for encoding visual task relationships to improve model performance in an Unsupervised Domain Adaptation (UDA) setting. Semantic segmentation and monocular depth estimation are shown to be complementary tasks in a multi task learning setting, a proper encoding of their relationships can further improve performance on both tasks. Motivated by this observation, we propose a novel Cross Task Relation Layer (CTRL), which encodes task dependencies between the semantic and depth predictions. To capture the cross task relationships, we propose a neural network architecture that contains task specific and cross task refinement heads. Furthermore, we propose an Iterative Self Learning (ISL) training scheme, which exploits semantic pseudo labels to provide extra supervision on the target domain. We experimentally observe improvements in both tasks' performance because the complementary information present in these tasks is better captured. Specifically, we show that (1) our approach improves performance on all tasks when they are complementary and mutually dependent (2) the CTRL helps to improve both semantic segmentation and depth estimation tasks performance in the challenging UDA setting (3) the proposed ISL training scheme further improves the semantic segmentation performance. The implementation is available at https github.com susaha ctrl uda.


Reaction front development from ignition spots in n heptane air mixtures low temperature chemistry effects induced by ultrafine water droplet evaporation. Effects of low temperature chemistry induced by ultrafine water droplet evaporation on reaction front development from an ignition spot with temperature gradient are studied in this work. The Eulerian Eulerian method is used to simulate the gas liquid two phase reactive flows and the physical model is one dimensional spherical reactor with stoichiometric gaseous n heptane air mixture and ultrafine monodisperse water droplets (initial diameter 5 micrometres). Homogeneous ignitions of two phase mixtures are first simulated. The water droplets can complete evaporation in the reactor prior to ignition, and hence pronouncedly reduce gas temperature, which may induce the low chemistry reactions. It is found that the turnover temperature for negative temperature coefficient range increases with droplet volume fraction. Three stage ignitions are present when the volume fraction is beyond a critical value, i.e., low temperature, intermediate temperature, and high temperature ignitions. The chemical explosive mode analysis also confirms the low chemistry reactions induced by the evaporation of ultrafine water droplets. Then reaction front development from an ignition spot with temperature gradient in two phase mixtures is analysed based on one dimensional simulations. Different modes for reaction front origin in the spot are identified, based on the initial gas temperature and lower turnover temperature. Specifically, the reaction front can be initiated at the left and right ends of the ignition spot, and inside it. Detailed reaction front developments corresponding to the above three modes are discussed. Besides, the pressure wave from high temperature ignition is important, compared to those from low and intermediate chemistries.


Exploring the Potential of Parallel Biasing in Flat Histogram Methods. Metadynamics, a member of the flat histogram' class of advanced sampling algorithms, has been widely used in molecular simulations to drive the exploration of states separated by high free energy barriers and promote comprehensive sampling of free energy landscapes defined on collective variables (CVs) which characterize the state of the system. Typically, the methods encounter severe limitations when exploring large numbers of CVs. A recently proposed variant, parallel bias metadynamics (PBMetaD), promises to aid in exploring free energy landscapes along with multiple important collective variables by exchanging the n dimensional free energy landscape required by standard methods for n one dimensional marginal free energy landscapes. In this study, we systematically examine how parallel biasing affects the convergence of free energy landscapes along with each variable relative to standard methods and the effectiveness of the parallel biasing strategy for addressing common bottlenecks in the use of advanced sampling to calculate free energies.


Phishing in Organizations Findings from a Large Scale and Long Term Study. In this paper, we present findings from a large scale and long term phishing experiment that we conducted in collaboration with a partner company. Our experiment ran for 15 months during which time more than 14,000 study participants (employees of the company) received different simulated phishing emails in their normal working context. We also deployed a reporting button to the company's email client which allowed the participants to report suspicious emails they received. We measured click rates for phishing emails, dangerous actions such as submitting credentials, and reported suspicious emails. The results of our experiment provide three types of contributions. First, some of our findings support previous literature with improved ecological validity. One example of such results is good effectiveness of warnings on emails. Second, some of our results contradict prior literature and common industry practices. Surprisingly, we find that embedded training during simulated phishing exercises, as commonly deployed in the industry today, does not make employees more resilient to phishing, but instead it can have unexpected side effects that can make employees even more susceptible to phishing. And third, we report new findings. In particular, we are the first to demonstrate that using the employees as a collective phishing detection mechanism is practical in large organizations. Our results show that such crowd sourcing allows fast detection of new phishing campaigns, the operational load for the organization is acceptable, and the employees remain active over long periods of time.


Entropy of Mersenne Twisters. The Mersenne Twister is one of the most popular generators of uniform pseudo random numbers. It is used in many numerical libraries and software. In this paper, we look at the Komolgorov entropy of the original Mersenne Twister, as well as of more modern variations such as the 64 bit Mersenne Twisters, the Well generators, and the Melg generators.


On the fine regularity of the singular set in the nonlinear obstacle problem. We revisit and sharpen the results from our previous work, where we investigated the regularity of the singular set of the free boundary in the nonlinear obstacle problem. As in the work of Figalli Serra on the classical obstacle problem, we show that each stratum can be further decomposed into a good' part and an anomalous' part, where the former is covered by C 1,1 manifolds, and the latter is of lower dimension.


Estimation Radius Regression in PLIC VOF Method for Droplet Evaporation. Naviers Stokes and energy equations of hydrocarbon liquid droplet in evaporation in natural convection are solved numerically using PLIC VOF method. Our new technique allows us to observe clearly the droplet radius regression in each cell of the mesh. This regression is not affected by the changing of the droplet shape and temperature.


Design and testing of an sTGC ASIC interface board for the ATLAS New Small Wheel upgrade. The ATLAS experiment will replace the present Small Wheel (SW) detector with a New Small Wheel detector (NSW) aiming to improve the performance of muon triggering and precision tracking in the endcap region at the High Luminosity LHC. Small strip Thin Gap Chamber (sTGC) is one of the two new detector technologies used in this upgrade. A few custom designed ASICs are needed for the sTGC detector. We designed an sTGC ASIC interface board to test ASIC to ASIC communication and validate the functionality of the entire system. A test platform with the final readout system is set up and the whole sTGC readout chain is demonstrated for the first time. Key parameters in the readout chain are discussed and the results are shown.


Depth aware Object Segmentation and Grasp Detection for Robotic Picking Tasks. In this paper, we present a novel deep neural network architecture for joint class agnostic object segmentation and grasp detection for robotic picking tasks using a parallel plate gripper. We introduce depth aware Coordinate Convolution (CoordConv), a method to increase accuracy for point proposal based object instance segmentation in complex scenes without adding any additional network parameters or computation complexity. Depth aware CoordConv uses depth data to extract prior information about the location of an object to achieve highly accurate object instance segmentation. These resulting segmentation masks, combined with predicted grasp candidates, lead to a complete scene description for grasping using a parallel plate gripper. We evaluate the accuracy of grasp detection and instance segmentation on challenging robotic picking datasets, namely Sil 'eane and OCID grasp, and show the benefit of joint grasp detection and segmentation on a real world robotic picking task.


Fuzzy AHP approach using Normalized Decision Matrix on Tourism Trend Ranking based on Social Media. This research discusses multi criteria decision making (MCDM) using Fuzzy AHP methods of tourism. The fuzzy AHP process will rank tourism trends based on data from social media. Social media is one of the channels with the largest source of data input in determining tourism development. The development uses social media interactions based on the facilities visited, including reviews, stories, likes, forums, blogs, and feedback. This experiment aims to prioritize facilities that are the trend of tourism. The priority ranking uses weight criteria and the ranking process. The highest rank is in the attractions of the Park Picnic Area, with the final weight calculation value of 0.6361. Fuzzy AHP can rank optimally with an MSE value of approx 0.0002.


RL GRIT Reinforcement Learning for Grammar Inference. When working to understand usage of a data format, examples of the data format are often more representative than the format's specification. For example, two different applications might use very different JSON representations, or two PDF writing applications might make use of very different areas of the PDF specification to realize the same rendered content. The complexity arising from these distinct origins can lead to large, difficult to understand attack surfaces, presenting a security concern when considering both exfiltration and data schizophrenia. Grammar inference can aid in describing the practical language generator behind examples of a data format. However, most grammar inference research focuses on natural language, not data formats, and fails to support crucial features such as type recursion. We propose a novel set of mechanisms for grammar inference, RL GRIT, and apply them to understanding de facto data formats. After reviewing existing grammar inference solutions, it was determined that a new, more flexible scaffold could be found in Reinforcement Learning (RL). Within this work, we lay out the many algorithmic changes required to adapt RL from its traditional, sequential time environment to the highly interdependent environment of parsing. The result is an algorithm which can demonstrably learn recursive control structures in simple data formats, and can extract meaningful structure from fragments of the PDF format. Whereas prior work in grammar inference focused on either regular languages or constituency parsing, we show that RL can be used to surpass the expressiveness of both classes, and offers a clear path to learning context sensitive languages. The proposed algorithm can serve as a building block for understanding the ecosystems of de facto data formats.


The Matter of Time A General and Efficient System for Precise Sensor Synchronization in Robotic Computing. Time synchronization is a critical task in robotic computing such as autonomous driving. In the past few years, as we developed advanced robotic applications, our synchronization system has evolved as well. In this paper, we first introduce the time synchronization problem and explain the challenges of time synchronization, especially in robotic workloads. Summarizing these challenges, we then present a general hardware synchronization system for robotic computing, which delivers high synchronization accuracy while maintaining low energy and resource consumption. The proposed hardware synchronization system is a key building block in our future robotic products.


Approximation of functions with one bit neural networks. This paper examines the approximation capabilities of coarsely quantized neural networks those whose parameters are selected from a small set of allowable values. We show that any smooth multivariate function can be arbitrarily well approximated by an appropriate coarsely quantized neural network and provide a quantitative approximation rate. For the quadratic activation, this can be done with only a one bit alphabet for the ReLU activation, we use a three bit alphabet. The main theorems rely on important properties of Bernstein polynomials. We prove new results on approximation of functions with Bernstein polynomials, noise shaping quantization on the Bernstein basis, and implementation of the Bernstein polynomials by coarsely quantized neural networks.


Counting Discrete, Level 1 , Quaternionic Automorphic Representations on G 2 . Quaternionic automorphic representations are one attempt to generalize to other groups the special place holomorphic modular forms have among automorphic representations of mathrm GL 2 . Here, we study quaternionic automorphic representations on the exceptional group G 2 . Using "hyperendoscopy" techniques from arXiv 1910.10800, we develop for quaternionic, G 2 representations an analog of the Eichler Selberg trace formula for classical modular forms. We then use this together with some techniques of Chenevier, Renard, and Ta "ibi to compute dimensions of spaces of level 1 quaternionic representations. On the way, we prove a Jacquet Langlands style result describing them in terms of classical modular forms and automorphic representations on the compact at infinity form G 2 c . The main technical difficulty is that the quaternionic discrete series that quaternionic autmorphic representations are defined in terms of do not satisfy a condition of being "regular". Using some computations from arXiv 2010.02712, we show that this miraculously does not matter for specifically the case of quaternionic discrete series on G 2 . We hope that this project serves as a guiding example for anyone interested in computing exact information about discrete at infinity automorphic representations on arbitrary reductive groups instead of just classical ones.


Hardness and Approximation of Submodular Minimum Linear Ordering Problems. The minimum linear ordering problem (MLOP) seeks to minimize an aggregated cost f( cdot) due to an ordering sigma of the items (say n ), i.e., min sigma sum i in n f(E i, sigma ) , where E i, sigma is the set of items that are mapped by sigma to indices at most i . This problem has been studied in the literature for various special cases of the cost function f , and in a general setting for a submodular or supermodular cost f ITT2012 . Though MLOP was known to be NP hard for general submodular functions, it was unknown whether the special case of graphic matroid MLOP (with f being the matroid rank function of a graph) was polynomial time solvable. Following this motivation, we explore related classes of linear ordering problems, including symmetric submodular MLOP, minimum latency vertex cover, and minimum sum vertex cover. We show that the most special cases of our problem, graphic matroid MLOP and minimum latency vertex cover, are both NP hard. We further expand the toolkit for approximating MLOP variants using the theory of principal partitions, we show a 2 frac 1 ell f 1 E approximation to monotone submodular MLOP, where ell f frac f(E) max x in E f( x ) satisfies 1 leq ell f leq E . Thus our result improves upon the best known bound of 2 frac 2 1 E by Iwata, Tetali, and Tripathi ITT2012 . This leads to a 2 frac 1 r(E) 1 E approximation for the matroid MLOP, corresponding to the case when r is the rank function of a given matroid. Finally, we show that MLVC can be 4 3 approximated, matching the integrality gap of its vanilla LP relaxation.


High speed hyperspectral four wave mixing microscopy with frequency combs. A four wave mixing, frequency comb based, hyperspectral imaging technique that is spectrally precise, potentially rapid, and can in principle be applied to any material, is demonstrated in a near diffraction limited microscopy application.


Il progetto Lab2Go per la diffusione della pratica laboratoriale nelle Scuole Secondarie di II grado. Even if laboratory practice is essential for all scientific branches of knowledge, it is often neglected at High School, due to lack of time and or resources. To establish a closer contact between school and experimental sciences, the University Sapienza of Roma and the Istituto Nazionale di Fisica Nucleare (INFN) launched the Lab2Go project, with the goal of spreading laboratory practice among students and teachers in high schools.


VOGUE Answer Verbalization through Multi Task Learning. In recent years, there have been significant developments in Question Answering over Knowledge Graphs (KGQA). Despite all the notable advancements, current KGQA systems only focus on answer generation techniques and not on answer verbalization. However, in real world scenarios (e.g., voice assistants such as Alexa, Siri, etc.), users prefer verbalized answers instead of a generated response. This paper addresses the task of answer verbalization for (complex) question answering over knowledge graphs. In this context, we propose a multi task based answer verbalization framework VOGUE (Verbalization thrOuGh mUlti task lEarning). The VOGUE framework attempts to generate a verbalized answer using a hybrid approach through a multi task learning paradigm. Our framework can generate results based on using questions and queries as inputs concurrently. VOGUE comprises four modules that are trained simultaneously through multi task learning. We evaluate our framework on existing datasets for answer verbalization, and it outperforms all current baselines on both BLEU and METEOR scores.


How Can Human Values Be Addressed in Agile Methods? A Case Study on SAFe. Agile methods are predominantly focused on delivering business values. But can Agile methods be adapted to effectively address and deliver human values such as social justice, privacy, and sustainability in the software they produce? Human values are what an individual or a society considers important in life. Ignoring these human values in software can pose difficulties or risks for all stakeholders (e.g., user dissatisfaction, reputation damage, financial loss). To answer this question, we selected the Scaled Agile Framework (SAFe), one of the most commonly used Agile methods in the industry, and conducted a qualitative case study to identify possible intervention points within SAFe that are the most natural to address and integrate human values in software. We present five high level empirically justified sets of interventions in SAFe artefacts, roles, ceremonies, practices, and culture. We elaborate how some current Agile artefacts (e.g., user story), roles (e.g., product owner), ceremonies (e.g., stand up meeting), and practices (e.g., business facing testing) in SAFe can be modified to support the inclusion of human values in software. Further, our study suggests new and exclusive values based artefacts (e.g., legislative requirement), ceremonies (e.g., values conversation), roles (e.g., values champion), and cultural practices (e.g., induction and hiring) to be introduced in SAFe for this purpose. Guided by our findings, we argue that existing Agile methods can account for human values in software delivery with some evolutionary adaptations.


E learning model for art education Case study in Iran. According to the characteristics of art, art education according to Bloom's classification, should take place at high and close to the level of creativity. E learning related to the subject of art is different from ordinary E learning. In this paper, a general circular model for E learning for art education is presented, a case study which has been done in Iran among students and artists. Art in the general sense, in addition to the same and Comprehensive features, has characteristics specific to different countries and cultures, and consequently there are differences in art education.


DSPoint Dual scale Point Cloud Recognition with High frequency Fusion. Point cloud processing is a challenging task due to its sparsity and irregularity. Prior works introduce delicate designs on either local feature aggregator or global geometric architecture, but few combine both advantages. We propose Dual Scale Point Cloud Recognition with High frequency Fusion (DSPoint) to extract local global features by concurrently operating on voxels and points. We reverse the conventional design of applying convolution on voxels and attention to points. Specifically, we disentangle point features through channel dimension for dual scale processing one by point wise convolution for fine grained geometry parsing, the other by voxel wise global attention for long range structural exploration. We design a co attention fusion module for feature alignment to blend local global modalities, which conducts inter scale cross modality interaction by communicating high frequency coordinates information. Experiments and ablations on widely adopted ModelNet40, ShapeNet, and S3DIS demonstrate the state of the art performance of our DSPoint.


Retrieval Augmentation Reduces Hallucination in Conversation. Despite showing increasingly human like conversational abilities, state of the art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of neural retrieval in the loop architectures recently shown to be effective in open domain QA (Lewis et al., 2020b Izacard and Grave, 2020) for knowledge grounded dialogue, a task that is arguably more challenging as it requires querying based on complex multi turn dialogue context and generating conversationally coherent responses. We study various types of architectures with multiple components retrievers, rankers, and encoder decoders with the goal of maximizing knowledgeability while retaining conversational ability. We demonstrate that our best models obtain state of the art performance on two knowledge grounded conversational tasks. The models exhibit open domain conversational capabilities, generalize effectively to scenarios not within the training data, and, as verified by human evaluations, substantially reduce the well known problem of knowledge hallucination in state of the art chatbots.


RLAD Time Series Anomaly Detection through Reinforcement Learning and Active Learning. We introduce a new semi supervised, time series anomaly detection algorithm that uses deep reinforcement learning (DRL) and active learning to efficiently learn and adapt to anomalies in real world time series data. Our model called RLAD makes no assumption about the underlying mechanism that produces the observation sequence and continuously adapts the detection model based on experience with anomalous patterns. In addition, it requires no manual tuning of parameters and outperforms all state of art methods we compare with, both unsupervised and semi supervised, across several figures of merit. More specifically, we outperform the best unsupervised approach by a factor of 1.58 on the F1 score, with only 1 of labels and up to around 4.4x on another real world dataset with only 0.1 of labels. We compare RLAD with seven deep learning based algorithms across two common anomaly detection datasets with up to around 3M data points and between 0.28 to 2.65 anomalies.We outperform all of them across several important performance metrics.


Integration of vector fields on cell complexes and Morse theory. In this paper, we investigate vector fields on polyhedral complexes and their associated trajectories. We study vector fields which are analogue of the gradient vector field of a function in the smooth case. Our goal is to define a nice theory of trajectories of such vector fields, so that the set of them captures the topology of the polyhedral complex, as in classical Morse theory. Since we do not assume the polyhedral complex to be a manifold, the definition of vector fields on it is very different from the smooth case. Nevertheless, we will show that there exist nice classes of functions and metrics which give gradient vector fields with desired properties. Our construction relies on Forman's discrete Morse theory. In particular, the class of functions we use is an improvement of Forman's discrete Morse functions. A notable feature of our theory is that our gradient vector fields are defined purely from functions and metrics as in the smooth case, contrary to the case of discrete Morse theory where we need the data of dimension of cells. This allows us to implement several useful constructions which were not available in the discrete case.


New results in Branching processes using Stochastic Approximation. We consider continuous time two type population size dependent Markov Branching process (CTPM BP). The offspring distribution is assumed to depend on both the current population (i.e., offsprings alive at given time t) and the total population (i.e., offsprings alive or dead at given time t). We derive the time asymptotic proportion of the two populations using a novel technique of stochastic approximation. Further, we analyse two new variants of CTPM BP, in particular, branching process with attack and proportion dependent branching process, and derive limit proportions for the two processes.


Convergence of solutions of a rescaled evolution nonlocal cross diffusion problem to its local diffusion counterpart. We prove that, under a suitable rescaling of the integrable kernel defining the nonlocal diffusion terms, the corresponding sequence of solutions of the Shigesada Kawasaki Teramoto nonlocal cross diffusion problem converges to a solution of the usual problem with local diffusion. In particular, the result may be regarded as a new proof of existence of solutions for the local diffusion problem.


AGMI Attention Guided Multi omics Integration for Drug Response Prediction with Graph Neural Networks. Accurate drug response prediction (DRP) is a crucial yet challenging task in precision medicine. This paper presents a novel Attention Guided Multi omics Integration (AGMI) approach for DRP, which first constructs a Multi edge Graph (MeG) for each cell line, and then aggregates multi omics features to predict drug response using a novel structure, called Graph edge aware Network (GeNet). For the first time, our AGMI approach explores gene constraint based multi omics integration for DRP with the whole genome using GNNs. Empirical experiments on the CCLE and GDSC datasets show that our AGMI largely outperforms state of the art DRP methods by 8.3 34.2 on four metrics. Our data and code are available at https github.com yivan WYYGDSG AGMI.


Behavior Self Organization Supports Task Inference for Continual Robot Learning. Recent advances in robot learning have enabled robots to become increasingly better at mastering a predefined set of tasks. On the other hand, as humans, we have the ability to learn a growing set of tasks over our lifetime. Continual robot learning is an emerging research direction with the goal of endowing robots with this ability. In order to learn new tasks over time, the robot first needs to infer the task at hand. Task inference, however, has received little attention in the multi task learning literature. In this paper, we propose a novel approach to continual learning of robotic control tasks. Our approach performs unsupervised learning of behavior embeddings by incrementally self organizing demonstrated behaviors. Task inference is made by finding the nearest behavior embedding to a demonstrated behavior, which is used together with the environment state as input to a multi task policy trained with reinforcement learning to optimize performance over tasks. Unlike previous approaches, our approach makes no assumptions about task distribution and requires no task exploration to infer tasks. We evaluate our approach in experiments with concurrently and sequentially presented tasks and show that it outperforms other multi task learning approaches in terms of generalization performance and convergence speed, particularly in the continual learning setting.


Predicting Clinical Deterioration in Hospitals. Responding rapidly to a patient who is demonstrating signs of imminent clinical deterioration is a basic tenet of patient care. This gave rise to a patient safety intervention philosophy known as a Rapid Response System (RRS), whereby a patient who meets a pre determined set of criteria for imminent clinical deterioration is immediately assessed and treated, with the goal of mitigating the deterioration and preventing intensive care unit (ICU) transfer, cardiac arrest, or death. While RRSs have been widely adopted, multiple systematic reviews have failed to find evidence of their effectiveness. Typically, RRS criteria are simple, expert (consensus) defined rules that identify significant physiologic abnormalities or are based on clinical observation. If one can find a pattern in the patient's data earlier than the onset of the physiologic derangement manifest in the current criteria, intervention strategies might be more effective. In this paper, we apply machine learning to electronic medical records (EMR) to infer if patients are at risk for clinical deterioration. Our models are more sensitive and offer greater advance prediction time compared with existing rule based methods that are currently utilized in hospitals. Our results warrant further testing in the field if successful, hospitals can integrate our approach into their existing IT systems and use the alerts generated by the model to prevent ICU transfer, cardiac arrest, or death, or to reduce the ICU length of stay.


Does mutation testing improve testing practices?. Various proxy metrics for test quality have been defined in order to guide developers when writing tests. Code coverage is particularly well established in practice, even though the question of how coverage relates to test quality is a matter of ongoing debate. Mutation testing offers a promising alternative Artificial defects can identify holes in a test suite, and thus provide concrete suggestions for additional tests. Despite the obvious advantages of mutation testing, it is not yet well established in practice. Until recently, mutation testing tools and techniques simply did not scale to complex systems. Although they now do scale, a remaining obstacle is lack of evidence that writing tests for mutants actually improves test quality. In this paper we aim to fill this gap By analyzing a large dataset of almost 15 million mutants, we investigate how these mutants influenced developers over time, and how these mutants relate to real faults. Our analyses suggest that developers using mutation testing write more tests, and actively improve their test suites with high quality tests such that fewer mutants remain. By analyzing a dataset of past fixes of real high priority faults, our analyses further provide evidence that mutants are indeed coupled with real faults. In other words, had mutation testing been used for the changes introducing the faults, it would have reported a live mutant that could have prevented the bug.


Gradient Descent for Randomized Controllers under Partial Observability. Randomization is a powerful technique to create robust controllers, in particular in partially observable settings. The degrees of randomization have a significant impact on the system performance, yet they are intricate to get right. The use of synthesis algorithms for parametric Markov chains (pMCs) is a promising direction to support the design process of such controllers. This paper shows how to define and evaluate gradients of pMCs. Furthermore, it investigates varieties of gradient descent techniques from the machine learning community to synthesize the probabilities in a pMC. The resulting method scales to significantly larger pMCs than before and empirically outperforms the state of the art, often by at least one order of magnitude.


Entropy Maximization for Partially Observable Markov Decision Processes. We study the problem of synthesizing a controller that maximizes the entropy of a partially observable Markov decision process (POMDP) subject to a constraint on the expected total reward. Such a controller minimizes the predictability of an agent's trajectories to an outside observer while guaranteeing the completion of a task expressed by a reward function. We first prove that an agent with partial observations can achieve an entropy at most as well as an agent with perfect observations. Then, focusing on finite state controllers (FSCs) with deterministic memory transitions, we show that the maximum entropy of a POMDP is lower bounded by the maximum entropy of the parametric Markov chain (pMC) induced by such FSCs. This relationship allows us to recast the entropy maximization problem as a so called parameter synthesis problem for the induced pMC. We then present an algorithm to synthesize an FSC that locally maximizes the entropy of a POMDP over FSCs with the same number of memory states. In numerical examples, we illustrate the relationship between the maximum entropy, the number of memory states in the FSC, and the expected reward.


Towards General Purpose Vision Systems. Computer vision systems today are primarily N purpose systems, designed and trained for a predefined set of tasks. Adapting such systems to new tasks is challenging and often requires non trivial modifications to the network architecture (e.g. adding new output heads) or training process (e.g. adding new losses). To reduce the time and expertise required to develop new applications, we would like to create general purpose vision systems that can learn and perform a range of tasks without any modification to the architecture or learning process. In this paper, we propose GPV 1, a task agnostic vision language architecture that can learn and perform tasks that involve receiving an image and producing text and or bounding boxes, including classification, localization, visual question answering, captioning, and more. We also propose evaluations of generality of architecture, skill concept transfer, and learning efficiency that may inform future work on general purpose vision. Our experiments indicate GPV 1 is effective at multiple tasks, reuses some concept knowledge across tasks, can perform the Referring Expressions task zero shot, and further improves upon the zero shot performance using a few training samples.


(Thesis) Reservoir Computing With Dynamical Systems. A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained. In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and stochastic processes. We focus mostly on a special type of reservoir computer called an Echo State Network (ESN). In the deterministic case, we prove (under some assumptions) that if a reservoir computer has the Echo State Property (ESP), then there is a C1 generalised synchronisation between the input dynamical system and the dynamics in the reservoir space. Furthermore, we prove that a reservoir computer with the local ESP in several disjoint subsets of the reservoir space will admit several distinct generalised synchronisations. In the special case that the reservoir map is linear, and has the ESP, we prove that the generalised synchronisation is generically an embedding. This result admits Takens' embedding Theorem as a special case. We go to show that ESNs trained on scalar observations of an ergodic dynamical system can approximate an arbitrary target function, including the next step map used in time series forecasting. This universal approximation property holds despite the training process being entirely linear. We prove analogous results for ESNs trained on observations of a stochastic process, which are not be Markovian in general. We use these results to develop supervised learning, and reinforcement learning algorithms supported by an ESN. In the penultimate chapter of this thesis, we use a reservoir computer to numerically solve linear PDEs. In the final chapter, we conclude and discuss directions for future work.


Physical Activity Recognition Based on a Parallel Approach for an Ensemble of Machine Learning and Deep Learning Classifiers. Human activity recognition (HAR) by wearable sensor devices embedded in the Internet of things (IOT) can play a significant role in remote health monitoring and emergency notification, to provide healthcare of higher standards. The purpose of this study is to investigate a human activity recognition method of accrued decision accuracy and speed of execution to be applicable in healthcare. This method classifies wearable sensor acceleration time series data of human movement using efficient classifier combination of feature engineering based and feature learning based data representation. Leave one subject out cross validation of the method with data acquired from 44 subjects wearing a single waist worn accelerometer on a smart textile, and engaged in a variety of 10 activities, yields an average recognition rate of 90 , performing significantly better than individual classifiers. The method easily accommodates functional and computational parallelization to bring execution time significantly down.


Inferring the Localization of White Matter Tracts using Diffusion Driven Label Fusion. Inferring which pathways are affected by a brain lesion is key for both pre and post treatment planning. However, many disruptive lesions cause changes in the tissue that interrupt tractography algorithms. In such cases, aggregating information from healthy subjects can provide a solution to inferring the affected pathways. In this paper, we introduce a novel label fusion technique that leverages diffusion information to locate brain pathways. Through simulations and experiments in publicly available data we show that our method is able to correctly reconstruct brain pathways, even if they are affected by a focal lesion.


Accelerating Communication for Parallel Programming Models on GPU Systems. As an increasing number of leadership class systems embrace GPU accelerators in the race towards exascale, efficient communication of GPU data is becoming one of the most critical components of high performance computing. For developers of parallel programming models, implementing support for GPU aware communication using native APIs for GPUs such as CUDA can be a daunting task as it requires considerable effort with little guarantee of performance. In this work, we demonstrate the capability of the Unified Communication X (UCX) framework to compose a GPU aware communication layer that serves multiple parallel programming models of the Charm ecosystem Charm , Adaptive MPI (AMPI), and Charm4py. We demonstrate the performance impact of our designs with microbenchmarks adapted from the OSU benchmark suite, obtaining improvements in latency of up to 10.1x in Charm , 11.7x in AMPI, and 17.4x in Charm4py. We also observe increases in bandwidth of up to 10.1x in Charm , 10x in AMPI, and 10.5x in Charm4py. We show the potential impact of our designs on real world applications by evaluating a proxy application for the Jacobi iterative method, improving the communication performance by up to 12.4x in Charm , 12.8x in AMPI, and 19.7x in Charm4py.


A Novel Surrogate assisted Evolutionary Algorithm Applied to Partition based Ensemble Learning. We propose a novel surrogate assisted Evolutionary Algorithm for solving expensive combinatorial optimization problems. We integrate a surrogate model, which is used for fitness value estimation, into a state of the art P3 like variant of the Gene Pool Optimal Mixing Algorithm (GOMEA) and adapt the resulting algorithm for solving non binary combinatorial problems. We test the proposed algorithm on an ensemble learning problem. Ensembling several models is a common Machine Learning technique to achieve better performance. We consider ensembles of several models trained on disjoint subsets of a dataset. Finding the best dataset partitioning is naturally a combinatorial non binary optimization problem. Fitness function evaluations can be extremely expensive if complex models, such as Deep Neural Networks, are used as learners in an ensemble. Therefore, the number of fitness function evaluations is typically limited, necessitating expensive optimization techniques. In our experiments we use five classification datasets from the OpenML CC18 benchmark and Support vector Machines as learners in an ensemble. The proposed algorithm demonstrates better performance than alternative approaches, including Bayesian optimization algorithms. It manages to find better solutions using just several thousand fitness function evaluations for an ensemble learning problem with up to 500 variables.


Visual Question Answering based on Local Scene Aware Referring Expression Generation. Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept such as the relationships between various objects. The limited use of object categories combined with their relationships or simple question embedding is insufficient for representing complex scenes and explaining decisions. To address this limitation, we propose the use of text expressions generated for images, because such expressions have few structural constraints and can provide richer descriptions of images. The generated expressions can be incorporated with visual features and question embedding to obtain the question relevant answer. A joint embedding multi head attention network is also proposed to model three different information modalities with co attention. We quantitatively and qualitatively evaluated the proposed method on the VQA v2 dataset and compared it with state of the art methods in terms of answer prediction. The quality of the generated expressions was also evaluated on the RefCOCO, RefCOCO , and RefCOCOg datasets. Experimental results demonstrate the effectiveness of the proposed method and reveal that it outperformed all of the competing methods in terms of both quantitative and qualitative results.


What do abelian categories form?. This is mostly an overview. Given finitely presentable abelian categories A and B , we sketch the construction of an abelian category of continuous functors from A to B that has nice 2 categorical behaviour and gives an explicit model for the stable category of stable functors between the derived categories of A and B . The construction is absolute, thus allows one to recover not only Hochschild but also Mac Lane Cohomology.


A fast accurate fine grain object detection model based on YOLOv4 deep neural network. Early identification and prevention of various plant diseases in commercial farms and orchards is a key feature of precision agriculture technology. This paper presents a high performance real time fine grain object detection framework that addresses several obstacles in plant disease detection that hinder the performance of traditional methods, such as, dense distribution, irregular morphology, multi scale object classes, textural similarity, etc. The proposed model is built on an improved version of the You Only Look Once (YOLOv4) algorithm. The modified network architecture maximizes both detection accuracy and speed by including the DenseNet in the back bone to optimize feature transfer and reuse, two new residual blocks in the backbone and neck enhance feature extraction and reduce computing cost the Spatial Pyramid Pooling (SPP) enhances receptive field, and a modified Path Aggregation Network (PANet) preserves fine grain localized information and improve feature fusion. Additionally, the use of the Hard Swish function as the primary activation improved the model's accuracy due to better nonlinear feature extraction. The proposed model is tested in detecting four different diseases in tomato plants under various challenging environments. The model outperforms the existing state of the art detection models in detection accuracy and speed. At a detection rate of 70.19 FPS, the proposed model obtained a precision value of 90.33 , F1 score of 93.64 , and a mean average precision ( mAP ) value of 96.29 . Current work provides an effective and efficient method for detecting different plant diseases in complex scenarios that can be extended to different fruit and crop detection, generic disease detection, and various automated agricultural detection processes.


CdtGRN Construction of qualitative time delayed gene regulatory networks with a deep learning method. Background Gene regulations often change over time rather than being constant. But many of gene regulatory networks extracted from databases are static. The tumor suppressor gene P53 is involved in the pathogenesis of many tumors, and its inhibition effects occur after a certain period. Therefore, it is of great significance to elucidate the regulation mechanism over time points. Result A qualitative method for representing dynamic gene regulatory network is developed, called CdtGRN. It adopts the combination of convolutional neural networks(CNN) and fully connected networks(DNN) as the core mechanism of prediction. The ionizing radiation Affymetrix dataset (E MEXP 549) was obtained at ArrayExpress, by microarray gene expression levels predicting relations between regulation. CdtGRN is tested against a time delayed gene regulatory network with 22,284 genes related to P53 . The accuracy of CdtGRN reaches 92.07 on the classification of conservative verification set, and a kappa coefficient reaches 0.84 and an average AUC accuracy is 94.25 . This resulted in the construction of. Conclusion The algorithm and program we developed in our study would be useful for identifying dynamic gene regulatory networks, and objectively analyze the delay of the regulatory relationship by analyzing the gene expression levels at different time points. The time delayed gene regulatory network of P53 is also inferred and represented qualitatively, which is helpful to understand the pathological mechanism of tumors.


Counting lattice paths by crossings and major index I the corner flipping bijections. We solve two problems regarding the enumeration of lattice paths in mathbb Z 2 with steps (1,1) and (1, 1) with respect to the major index, defined as the sum of the positions of the valleys, and to the number of certain crossings. The first problem considers crossings of a single path with a fixed horizontal line. The second one counts pairs of paths with respect to the number of times they cross each other. Our proofs introduce lattice path bijections with convenient visual descriptions, and the answers are given by remarkably simple formulas involving q binomial coefficients.


A Shape Aware Retargeting Approach to Transfer Human Motion and Appearance in Monocular Videos. Transferring human motion and appearance between videos of human actors remains one of the key challenges in Computer Vision. Despite the advances from recent image to image translation approaches, there are several transferring contexts where most end to end learning based retargeting methods still perform poorly. Transferring human appearance from one actor to another is only ensured when a strict setup has been complied, which is generally built considering their training regime's specificities. In this work, we propose a shape aware approach based on a hybrid image based rendering technique that exhibits competitive visual retargeting quality compared to state of the art neural rendering approaches. The formulation leverages the user body shape into the retargeting while considering physical constraints of the motion in 3D and the 2D image domain. We also present a new video retargeting benchmark dataset composed of different videos with annotated human motions to evaluate the task of synthesizing people's videos, which can be used as a common base to improve tracking the progress in the field. The dataset and its evaluation protocols are designed to evaluate retargeting methods in more general and challenging conditions. Our method is validated in several experiments, comprising publicly available videos of actors with different shapes, motion types, and camera setups. The dataset and retargeting code are publicly available to the community at https www.verlab.dcc.ufmg.br retargeting motion.


Human in the Loop Deep Reinforcement Learning with Application to Autonomous Driving. Due to the limited smartness and abilities of machine intelligence, currently autonomous vehicles are still unable to handle all kinds of situations and completely replace drivers. Because humans exhibit strong robustness and adaptability in complex driving scenarios, it is of great importance to introduce humans into the training loop of artificial intelligence, leveraging human intelligence to further advance machine learning algorithms. In this study, a real time human guidance based deep reinforcement learning (Hug DRL) method is developed for policy training of autonomous driving. Leveraging a newly designed control transfer mechanism between human and automation, human is able to intervene and correct the agent's unreasonable actions in real time when necessary during the model training process. Based on this human in the loop guidance mechanism, an improved actor critic architecture with modified policy and value networks is developed. The fast convergence of the proposed Hug DRL allows real time human guidance actions to be fused into the agent's training loop, further improving the efficiency and performance of deep reinforcement learning. The developed method is validated by human in the loop experiments with 40 subjects and compared with other state of the art learning approaches. The results suggest that the proposed method can effectively enhance the training efficiency and performance of the deep reinforcement learning algorithm under human guidance, without imposing specific requirements on participant expertise and experience.


Targeted Supervised Contrastive Learning for Long Tailed Recognition. Real world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have investigated the potential of supervised contrastive learning for long tailed recognition, and demonstrated that it provides a strong performance gain. In this paper, we show that while supervised contrastive learning can help improve performance, past baselines suffer from poor uniformity brought in by imbalanced data distribution. This poor uniformity manifests in samples from the minority class having poor separability in the feature space. To address this problem, we propose targeted supervised contrastive learning (TSC), which improves the uniformity of the feature distribution on the hypersphere. TSC first generates a set of targets uniformly distributed on a hypersphere. It then makes the features of different classes converge to these distinct and uniformly distributed targets during training. This forces all classes, including minority classes, to maintain a uniform distribution in the feature space, improves class boundaries, and provides better generalization even in the presence of long tail data. Experiments on multiple datasets show that TSC achieves state of the art performance on long tailed recognition tasks.


Dual Metric Learning for Effective and Efficient Cross Domain Recommendations. Cross domain recommender systems have been increasingly valuable for helping consumers identify useful items in different applications. However, existing cross domain models typically require large number of overlap users, which can be difficult to obtain in some applications. In addition, they did not consider the duality structure of cross domain recommendation tasks, thus failing to take into account bidirectional latent relations between users and items and achieve optimal recommendation performance. To address these issues, in this paper we propose a novel cross domain recommendation model based on dual learning that transfers information between two related domains in an iterative manner until the learning process stabilizes. We develop a novel latent orthogonal mapping to extract user preferences over multiple domains while preserving relations between users across different latent spaces. Furthermore, we combine the dual learning method with the metric learning approach, which allows us to significantly reduce the required common user overlap across the two domains and leads to even better cross domain recommendation performance. We test the proposed model on two large scale industrial datasets and six domain pairs, demonstrating that it consistently and significantly outperforms all the state of the art baselines. We also show that the proposed model works well with very few overlap users to obtain satisfying recommendation performance comparable to the state of the art baselines that use many overlap users.


The Kauffman bracket skein module of the complement of (2, 2p 1) torus knots via braids. In this paper we compute the Kauffman bracket skein module of the complement of (2, 2p 1) torus knots, KBSM(T (2, 2p 1) c) , via braids. We start by considering geometric mixed braids in S 3 , the closure of which are mixed links in S 3 that represent links in the complement of (2, 2p 1) torus knots, T (2, 2p 1) c . Using the technique of parting and combing, we obtain algebraic mixed braids, that is, mixed braids that belong to the mixed braid group B 2, n and that are followed by their coset'' part, that represents T (2, 2p 1) c . In that way we show that links in T (2, 2p 1) c may be pushed to the genus 2 handlebody, H 2 , and we establish a relation between KBSM(T (2, 2p 1) c) and KBSM(H 2) . In particular, we show that in order to compute KBSM(T (2, 2p 1) c) it suffices to consider a basis of KBSM(H 2) and study the effect of combing on elements in this basis. We consider the standard basis of KBSM(H 2) and we show how to treat its elements in KBSM(T (2, 2p 1) c) , passing through many different spanning sets for KBSM(T (2, 2p 1) c) . These spanning sets form the intermediate steps in order to reach at the set mathcal B T (2, 2p 1) c , which, using an ordering relation and the notion of total winding, we prove that it forms a basis for KBSM(T (2, 2p 1) c) . We finally consider c.c.o. 3 manifolds M obtained from S 3 by surgery along the trefoil knot and we discuss steps needed in order to compute the Kauffman bracket skein module of M . We first demonstrate the process described before for computing the Kauffman bracket skein module of the complement of the trefoil, KBSM(Tr c) , and we study the effect of braid band moves on elements in the basis of KBSM(Tr c) . These moves reflect isotopy in M and are similar to the second Kirby moves.


Alternating sign matrices and Verma modules. We show that the poset of alternating sign matrices, with Bruhat order, is isomorphic to the poset of certain submodules of the dominant Verma module for the special linear Lie algebra frak sl n . The latter poset consists of the intersections of Verma submodules and can also be defined in terms of a Kazhdan Lusztig cell.


Slow localized patterns in singularly perturbed 2 component reaction diffusion equations. Localized patterns in singularly perturbed reaction diffusion equations typically consist of slow parts in which the associated solution follows an orbit on a slow manifold in a reduced spatial dynamical system alternated by fast excursions in which the solution jumps from one slow manifold to another, or back to the original slow manifold. In this paper we consider the existence and stability of stationary and traveling slow localized patterns that do not exhibit such jumps, i.e. that are completely embedded in a slow manifold of the singularly perturbed spatial dynamical system. These patterns have rarely been considered in the literature, for two reasons (i) in the classical Gray Scott Gierer Meinhardt type models that dominate the literature, the flow on the slow manifold is typically linear and thus cannot exhibit homoclinic pulse or heteroclinic front solutions (ii) the slow manifolds occurring in the literature are typically vertical' i.e. given by u equiv u 0 , where u is the fast variable so that the stability problem is determined by a simple (decoupled) scalar equation. The present research concerns a general system of singularly perturbed reaction diffusion equations and is motivated by several explicit ecosystem models that do give rise to non vertical normally hyperbolic slow manifolds on which the flow may exhibit both homoclinic and heteroclinic orbits that correspond to either stationary or traveling localized patterns. The associated spectral stability problems are at leading order given by a nonlinear, but scalar, eigenvalue problem with Sturm Liouville characteristics and we establish that homoclinic pulse patterns are typically unstable, while heteroclinic fronts can either be stable or unstable. However, we also show that homoclinic pulse patterns that are asymptotically close to a heteroclinic cycle may be stable.


ClipCap CLIP Prefix for Image Captioning. Image captioning is a fundamental task in vision language understanding, where the model predicts a textual informative caption to a given input image. In this paper, we present a simple approach to address this task. We use CLIP encoding as a prefix to the caption, by employing a simple mapping network, and then fine tunes a language model to generate the image captions. The recently proposed CLIP model contains rich semantic features which were trained with textual context, making it best for vision language perception. Our key idea is that together with a pre trained language model (GPT2), we obtain a wide understanding of both visual and textual data. Hence, our approach only requires rather quick training to produce a competent captioning model. Without additional annotations or pre training, it efficiently generates meaningful captions for large scale and diverse datasets. Surprisingly, our method works well even when only the mapping network is trained, while both CLIP and the language model remain frozen, allowing a lighter architecture with less trainable parameters. Through quantitative evaluation, we demonstrate our model achieves comparable results to state of the art methods on the challenging Conceptual Captions and nocaps datasets, while it is simpler, faster, and lighter. Our code is available in https github.com rmokady CLIP prefix caption.


Observations on K image Expansion of Image Mixing Augmentation for Classification. Image mixing augmentations (e.g., Mixup or CutMix), which typically mix two images, have become de facto training tricks for image classification. Despite their huge success on image classification, the number of images to mix has not been profoundly investigated by the previous works, only showing the naive K image expansion leads to poor performance degradation. This paper derives a new K image mixing augmentation based on the stick breaking process under Dirichlet prior. We show that our method can train more robust and generalized classifiers through extensive experiments and analysis on classification accuracy, a shape of a loss landscape and adversarial robustness, than the usual two image methods. Furthermore, we show that our probabilistic model can measure the sample wise uncertainty and can boost the efficiency for Network Architecture Search (NAS) with 7x reduced search time.


Maximally predictive ensemble dynamics from data. We leverage the interplay between microscopic variability and macroscopic order to connect physical descriptions across scales directly from data, without underlying equations. We reconstruct a state space by concatenating measurements in time, building a maximum entropy partition of the resulting sequences, and choosing the sequence length to maximize predictive information. Trading non linear trajectories for linear, ensemble evolution, we analyze reconstructed dynamics through transfer operators. The evolution is parameterized by a transition time tau capturing the source entropy rate at small tau and revealing timescale separation with collective, coherent states through the operator spectrum at larger tau . Applicable to both deterministic and stochastic systems, we illustrate our approach through the Langevin dynamics of a particle in a double well potential and the Lorenz system. Applied to the behavior of the nematode worm C. elegans , we derive a "run and pirouette" navigation strategy directly from posture dynamics. We demonstrate how sequences simulated from the ensemble evolution capture both fine scale posture dynamics and large scale effective diffusion in the worm's centroid trajectories and introduce a top down, operator based clustering which reveals subtle subdivisions of the "run" behavior.


Fixed points, descents, and inversions in parabolic double cosets of the symmetric group. We consider statistics on permutations chosen uniformly at random from fixed parabolic double cosets of the symmetric group. We show that the distribution of fixed points is asymptotically Poisson and establish central limit theorems for the distribution of descents and inversions. Our proofs use Stein's method with size bias coupling and dependency graphs, which also gives convergence rates for our distributional approximations. As applications of our size bias coupling and dependency graph constructions, we obtain concentration of measure results on the number of fixed points, descents, and inversions.


A DLT based Smart Contract Architecture for Atomic and Scalable Trading. Distributed Ledger Technology (DLT) has an enormous potential but also downsides. One downside of many DLT systems, such as blockchain, is their limited transaction throughput that hinders their adoption in many use cases (e.g., real time payments). State channels have emerged as a potential solution to enhance throughput by allowing transactions to process off chain. While current proposals can increase scalability, they require high collateral and lack support for dynamic systems that require asynchronous state transitions. Additionally, the latency of channel initialisations can cause issues especially if fast interactions are required. In this paper, we propose an atomic, scalable and privacy preserving protocol that enables secure and dynamic updates. We develop a smart contract based Credit Note System (CNS) that allows participants to lock funds before a state channel initialisation, which enhances flexibility and efficiency. We formalise our model using the Universal Composability (UC) framework and demonstrate that it achieves the stated design goals of privacy, scalability, and atomicity. Moreover, we implement a dispute process in the state channel to counter availability attacks. Finally, we analyse the protocol in the context of an asynchronous smart grid based marketplace.


Multi Sentence Resampling A Simple Approach to Alleviate Dataset Length Bias and Beam Search Degradation. Neural Machine Translation (NMT) is known to suffer from a beam search problem after a certain point, increasing beam size causes an overall drop in translation quality. This effect is especially pronounced for long sentences. While much work was done analyzing this phenomenon, primarily for autoregressive NMT models, there is still no consensus on its underlying cause. In this work, we analyze errors that cause major quality degradation with large beams in NMT and Automatic Speech Recognition (ASR). We show that a factor that strongly contributes to the quality degradation with large beams is textit dataset length bias textit NMT datasets are strongly biased towards short sentences . To mitigate this issue, we propose a new data augmentation technique textit Multi Sentence Resampling (MSR) . This technique extends the training examples by concatenating several sentences from the original dataset to make a long training example. We demonstrate that MSR significantly reduces degradation with growing beam size and improves final translation quality on the IWSTL 15 En Vi, IWSTL 17 En Fr, and WMT 14 En De datasets.


Approximate solution of the Cauchy problem for a first order integrodifferential equation with solution derivative memory. We consider the Cauchy problem for a first order evolution equation with memory in a finite dimensional Hilbert space when the integral term is related to the time derivative of the solution. The main problems of the approximate solution of such nonlocal problems are due to the necessity to work with the approximate solution for all previous time moments. We propose a transformation of the first order integrodifferential equation to a system of local evolutionary equations. We use the approach known in the theory of Voltaire integral equations with an approximation of the difference kernel by the sum of exponents. We formulate a local problem for a weakly coupled system of equations with additional ordinary differential equations. We have given estimates of the stability of the solution by initial data and the right hand side for the solution of the corresponding Cauchy problem. The primary attention is paid to constructing and investigating the stability of two level difference schemes, which are convenient for computational implementation. The numerical solution of a two dimensional model problem for the evolution equation of the first order, when the Laplace operator conditions the dependence on spatial variables, is presented.


Matrix valued Allen Cahn equation and the Keller Rubinstein Sternberg problem. In this paper, we consider the sharp interface limit of a matrix valued Allen Cahn equation, which takes the form partial t A Delta A varepsilon 2 ( A A mathrm T A A) text with A Omega subset mathbb R m to mathbb R n times n . We show that the sharp interface system is a two phases flow system the interface evolves according to the motion by mean curvature in the two bulk phase regions, the solution obeys the heat flow of harmonic maps with values in O (n) and O (n) (represent the sets of n times n orthogonal matrices with determinant 1 and 1 respectively) on the interface, the phase matrices in two sides satisfy a novel mixed boundary condition. The above result provides a solution to the Keller Rubinstein Sternberg's (conjecture) problem in this O(n) setting. Our proof relies on two key ingredients. First, in order to construct the approximate solution by matched asymptotic expansions as the standard approach does not seem to work, we introduce the notion of quasi minimal connecting orbits. They satisfy the usual leading order equations up to some small higher order terms. In addition, the linearized systems around these quasi minimal orbits needs to be solvable up to some good remainders. These flexibilities are needed for the possible "degenerations" or higher dimensional kernels for the linearized operators due to intriguing boundary conditions at the sharp interface. The second key point is to establish a spectral uniform lower bound estimate for the linearized operator around approximate solutions. To this end, we introduce additional decompositions to reduce the problem into the coercive estimates of several linearized operators for scalar functions and some singular product estimates which is accomplished by exploring special cancellation structures between eigenfunctions of these linearized operators.


Animatable Neural Radiance Fields from Monocular RGB Videos. We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit pose guided deformation while learning the scene representation network. In particular, we estimate the human pose for each frame and learn a constant canonical space for the detailed human template, which enables natural shape deformation from the observation space to the canonical space under the explicit control of the pose parameters. To compensate for inaccurate pose estimation, we introduce the pose refinement strategy that updates the initial pose during the learning process, which not only helps to learn more accurate human reconstruction but also accelerates the convergence. In experiments we show that the proposed approach achieves 1) implicit human geometry and appearance reconstruction with high quality details, 2) photo realistic rendering of the human from novel views, and 3) animation of the human with novel poses.


Commuting with Autonomous Vehicles A Branch and Cut Algorithm with Redundant Modeling. This paper studies the benefits of autonomous vehicles in ride sharing platforms dedicated to serving commuting needs. It considers the Commute Trip Sharing Problem with Autonomous Vehicles (CTSPAV), the optimization problem faced by a reservation based platform that receives daily commute trip requests and serves them with a fleet of autonomous vehicles. The CTSPAV can be viewed as a special case of the Dial A Ride Problem (DARP). However, this paper recognizes that commuting trips exhibit special spatial and temporal properties that can be exploited in a branch and cut algorithm that leverages a redundant modeling approach. In particular, the branch and cut algorithm relies on a MIP formulation that schedules mini routes representing inbound or outbound trips. This formulation is effective in finding high quality solutions quickly but its relaxation is relatively weak. To remedy this limitation, the mini route MIP is complemented by a DARP formulation which is not as effective in obtaining primal solutions but has a stronger relaxation. The benefits of the proposed approach are demonstrated by comparing it with another, more traditional, exact branch and cut procedure and a heuristic method based on mini routes. The methodological contribution is complemented by a comprehensive analysis of a CTSPAV platform for reducing vehicle counts, travel distances, and congestion. In particular, the case study for a medium sized city reveals that a CTSPAV platform can reduce daily vehicle counts by a staggering 92 and decrease vehicles miles by 30 . The platform also significantly reduces congestion, measured as the number of vehicles on the road per unit time, by 60 during peak times. These benefits, however, come at the expense of introducing empty miles. Hence the paper also highlights the tradeoffs between future ride sharing and car pooling platforms.


Linear equations for unordered data vectors. Following a recently considered generalisation of linear equations to unordered data vectors and to ordered data vectors, we perform a further generalisation to k element sets of unordered data vectors. These generalised equations naturally appear in the analysis of vector addition systems (or Petri nets) extended so that each token carries a set of unordered data. We show that nonnegative integer solvability of linear equations is in nondeterministic exponential time while integer solvability is in polynomial time.


A Person Re identification Data Augmentation Method with Adversarial Defense Effect. The security of the Person Re identification(ReID) model plays a decisive role in the application of ReID. However, deep neural networks have been shown to be vulnerable, and adding undetectable adversarial perturbations to clean images can trick deep neural networks that perform well in clean images. We propose a ReID multi modal data augmentation method with adversarial defense effect 1) Grayscale Patch Replacement, it consists of Local Grayscale Patch Replacement(LGPR) and Global Grayscale Patch Replacement(GGPR). This method can not only improve the accuracy of the model, but also help the model defend against adversarial examples 2) Multi Modal Defense, it integrates three homogeneous modal images of visible, grayscale and sketch, and further strengthens the defense ability of the model. These methods fuse different modalities of homogeneous images to enrich the input sample variety, the variaty of samples will reduce the over fitting of the ReID model to color variations and make the adversarial space of the dataset that the attack method can find difficult to align, thus the accuracy of model is improved, and the attack effect is greatly reduced. The more modal homogeneous images are fused, the stronger the defense capabilities is . The proposed method performs well on multiple datasets, and successfully defends the attack of MS SSIM proposed by CVPR2020 against ReID 10 , and increases the accuracy by 467 times(0.2 to 93.3 ).The code is available at https github.com finger monkey ReID Adversarial Defense.


Discourse Analysis of Covid 19 in Persian Twitter Social Networks Using Graph Mining and Natural Language Processing. One of the new scientific ways of understanding discourse dynamics is analyzing the public data of social networks. This research's aim is Post structuralist Discourse Analysis (PDA) of Covid 19 phenomenon (inspired by Laclau and Mouffe's Discourse Theory) by using Intelligent Data Mining for Persian Society. The examined big data is five million tweets from 160,000 users of the Persian Twitter network to compare two discourses. Besides analyzing the tweet texts individually, a social network graph database has been created based on retweets relationships. We use the VoteRank algorithm to introduce and rank people whose posts become word of mouth, provided that the total information spreading scope is maximized over the network. These users are also clustered according to their word usage pattern (the Gaussian Mixture Model is used). The constructed discourse of influential spreaders is compared to the most active users. This analysis is done based on Covid related posts over eight episodes. Also, by relying on the statistical content analysis and polarity of tweet words, discourse analysis is done for the whole mentioned subpopulations, especially for the top individuals. The most important result of this research is that the Twitter subjects' discourse construction is government based rather than community based. The analyzed Iranian society does not consider itself responsible for the Covid 19 wicked problem, does not believe in participation, and expects the government to solve all problems. The most active and most influential users' similarity is that political, national, and critical discourse construction is the predominant one. In addition to the advantages of its research methodology, it is necessary to pay attention to the study's limitations. Suggestion for future encounters of Iranian society with similar crises is given.


Personalized Transformer for Explainable Recommendation. Personalization of natural language generation plays a vital role in a large spectrum of tasks, such as explainable recommendation, review summarization and dialog systems. In these tasks, user and item IDs are important identifiers for personalization. Transformer, which is demonstrated with strong language modeling capability, however, is not personalized and fails to make use of the user and item IDs since the ID tokens are not even in the same semantic space as the words. To address this problem, we present a PErsonalized Transformer for Explainable Recommendation (PETER), on which we design a simple and effective learning objective that utilizes the IDs to predict the words in the target explanation, so as to endow the IDs with linguistic meanings and to achieve personalized Transformer. Besides generating explanations, PETER can also make recommendations, which makes it a unified model for the whole recommendation explanation pipeline. Extensive experiments show that our small unpretrained model outperforms fine tuned BERT on the generation task, in terms of both effectiveness and efficiency, which highlights the importance and the nice utility of our design.


AttDMM An Attentive Deep Markov Model for Risk Scoring in Intensive Care Units. Clinical practice in intensive care units (ICUs) requires early warnings when a patient's condition is about to deteriorate so that preventive measures can be undertaken. To this end, prediction algorithms have been developed that estimate the risk of mortality in ICUs. In this work, we propose a novel generative deep probabilistic model for real time risk scoring in ICUs. Specifically, we develop an attentive deep Markov model called AttDMM. To the best of our knowledge, AttDMM is the first ICU prediction model that jointly learns both long term disease dynamics (via attention) and different disease states in health trajectory (via a latent variable model). Our evaluations were based on an established baseline dataset (MIMIC III) with 53,423 ICU stays. The results confirm that compared to state of the art baselines, our AttDMM was superior AttDMM achieved an area under the receiver operating characteristic curve (AUROC) of 0.876, which yielded an improvement over the state of the art method by 2.2 . In addition, the risk score from the AttDMM provided warnings several hours earlier. Thereby, our model shows a path towards identifying patients at risk so that health practitioners can intervene early and save patient lives.


A behavioural modelling approach to assess the impact of COVID 19 vaccine hesitancy. In this paper we introduce a compartmental epidemic model describing the transmission of the COVID 19 disease in presence of non mandatory vaccination. The model takes into account the hesitancy and refusal of vaccination. To this aim, we employ the information index, which mimics the idea that individuals take their decision on vaccination based not only on the present but also on the past information about the spread of the disease. Theoretical analysis and simulations show clearly as a voluntary vaccination can certainly reduce the impact of the disease but it is unable to eliminate it. We also show how the information related parameters affect the dynamics of the disease. In particular, the hesitancy and refusal of vaccination is better contained in case of large information coverage and small memory characteristic time. Finally, the possible influence of seasonality is also investigated.


NAS Bench 360 Benchmarking Diverse Tasks for Neural Architecture Search. Most existing neural architecture search (NAS) benchmarks and algorithms prioritize performance on well studied tasks, e.g., image classification on CIFAR and ImageNet. This makes the applicability of NAS approaches in more diverse areas inadequately understood. In this paper, we present NAS Bench 360, a benchmark suite for evaluating state of the art NAS methods for convolutional neural networks (CNNs). To construct it, we curate a collection of ten tasks spanning a diverse array of application domains, dataset sizes, problem dimensionalities, and learning objectives. By carefully selecting tasks that can both interoperate with modern CNN based search methods but that are also far afield from their original development domain, we can use NAS Bench 360 to investigate the following central question do existing state of the art NAS methods perform well on diverse tasks? Our experiments show that a modern NAS procedure designed for image classification can indeed find good architectures for tasks with other dimensionalities and learning objectives however, the same method struggles against more task specific methods and performs catastrophically poorly on classification in non vision domains. The case for NAS robustness becomes even more dire in a resource constrained setting, where a recent NAS method provides little to no benefit over much simpler baselines. These results demonstrate the need for a benchmark such as NAS Bench 360 to help develop NAS approaches that work well on a variety of tasks, a crucial component of a truly robust and automated pipeline. We conclude with a demonstration of the kind of future research our suite of tasks will enable. All data and code is made publicly available.


Prompting Visual Language Models for Efficient Video Understanding. Visual language pre training has shown great success for learning joint visual textual representations from large scale web data, demonstrating remarkable ability for zero shot generalisation. This paper presents a simple method to efficiently adapt one pre trained visual language model to novel tasks with minimal training, and here, we consider video understanding tasks. Specifically, we propose to optimise a few random vectors, termed as continuous prompt vectors, that convert the novel tasks into the same format as the pre training objectives. In addition, to bridge the gap between static images and videos, temporal information is encoded with lightweight Transformers stacking on top of frame wise visual features. Experimentally, we conduct extensive ablation studies to analyse the critical components and necessities. On 9 public benchmarks of action recognition, action localisation, and text video retrieval, across closed set, few shot, open set scenarios, we achieve competitive or state of the art performance to existing methods, despite training significantly fewer parameters.


Termination Analysis for the pi Calculus by Reduction to Sequential Program Termination. We propose an automated method for proving termination of pi calculus processes, based on a reduction to termination of sequential programs we translate a pi calculus process to a sequential program, so that the termination of the latter implies that of the former. We can then use an off the shelf termination verification tool to check termination of the sequential program. Our approach has been partially inspired by Deng and Sangiorgi's termination analysis for the pi calculus, and checks that there is no infinite chain of communications on replicated input channels, by converting such a chain of communications to a chain of recursive function calls in the target sequential program. We have implemented an automated tool based on the proposed method and confirmed its effectiveness.