Learning What to Memorize Using Intrinsic Motivation to Form Useful Memory in Partially Observable Reinforcement Learning. Reinforcement Learning faces an important challenge in partial observable environments that has long term dependencies. In order to learn in an ambiguous environment, an agent has to keep previous perceptions in a memory. Earlier memory based approaches use a fixed method to determine what to keep in the memory, which limits them to certain problems. In this study, we follow the idea of giving the control of the memory to the agent by allowing it to have memory changing actions. This learning mechanism is supported by an intrinsic motivation to memorize rare observations that can help the agent to disambiguate its state in the environment. Our approach is experimented and analyzed on several partial observable tasks with long term dependencies and compared with other memory based methods.


Erd H o s Ko Rado theorems for ovoidal circle geometries and polynomials over finite fields. In this paper we investigate Erd H o s Ko Rado theorems in ovoidal circle geometries. We prove that in M "obius planes of even order greater than 2, and ovoidal Laguerre planes of odd order, the largest families of circles which pairwise intersect in at least one point, consist of all circles through a fixed point. In ovoidal Laguerre planes of even order, a similar result holds, but there is one other type of largest family of pairwise intersecting circles. As a corollary, we prove that the largest families of polynomials over mathbb F q of degree at most k , with 2 leq k q , which pairwise take the same value on at least one point, consist of all polynomials f of degree at most k such that f(x) y for some fixed x and y in mathbb F q . We also discuss this problem for ovoidal Minkowski planes, and we investigate the largest families of circles pairwise intersecting in two points in circle geometries.


Diagnosing Vision and Language Navigation What Really Matters. Vision and language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or training techniques to boost navigation performance. However, there still exist non negligible gaps between machines' performance and human benchmarks. Moreover, the agents' inner mechanisms for navigation decisions remain unclear. To the best of our knowledge, how the agents perceive the multimodal input is under studied and needs investigation. In this work, we conduct a series of diagnostic experiments to unveil agents' focus during navigation. Results show that indoor navigation agents refer to both object and direction tokens when making decisions. In contrast, outdoor navigation agents heavily rely on direction tokens and poorly understand the object tokens. Transformer based agents acquire a better cross modal understanding of objects and display strong numerical reasoning ability than non Transformer based agents. When it comes to vision and language alignments, many models claim that they can align object tokens with specific visual targets. We find unbalanced attention on the vision and text input and doubt the reliability of such cross modal alignments.


Fragment based molecular generative model with high generalization ability and synthetic accessibility. Deep generative models are attracting great attention for molecular design with desired properties. Most existing models generate molecules by sequentially adding atoms. This often renders generated molecules with less correlation with target properties and low synthetic accessibility. Molecular fragments such as functional groups are more closely related to molecular properties and synthetic accessibility than atoms. Here, we propose a fragment based molecular generative model which designs new molecules with target properties by sequentially adding molecular fragments to any given starting molecule. A key feature of our model is a high generalization ability in terms of property control and fragment types. The former becomes possible by learning the contribution of individual fragments to the target properties in an auto regressive manner. For the latter, we used a deep neural network that predicts the bonding probability of two molecules from the embedding vectors of the two molecules as input. The high synthetic accessibility of the generated molecules is implicitly considered while preparing the fragment library with the BRICS decomposition method. We show that the model can generate molecules with the simultaneous control of multiple target properties at a high success rate. It also works equally well with unseen fragments even in the property range where the training data is rare, verifying the high generalization ability. As a practical application, we demonstrated that the model can generate potential inhibitors with high binding affinities against the 3CL protease of SARS COV 2 in terms of docking score.


Spectral gap estimates for Brownian motion on domains with sticky reflecting boundary diffusion. Introducing an interpolation method we estimate the spectral gap for Brownian motion on general domains with sticky reflecting boundary diffusion associated to the first nontrivial eigenvalue for the Laplace operator with corresponding Wentzell type boundary condition. In the manifold case our proofs involve novel applications of the celebrated Reilly formula.


Insight centric Visualization Recommendation. Visualization recommendation systems simplify exploratory data analysis (EDA) and make understanding data more accessible to users of all skill levels by automatically generating visualizations for users to explore. However, most existing visualization recommendation systems focus on ranking all visualizations into a single list or set of groups based on particular attributes or encodings. This global ranking makes it difficult and time consuming for users to find the most interesting or relevant insights. To address these limitations, we introduce a novel class of visualization recommendation systems that automatically rank and recommend both groups of related insights as well as the most important insights within each group. Our proposed approach combines results from many different learning based methods to discover insights automatically. A key advantage is that this approach generalizes to a wide variety of attribute types such as categorical, numerical, and temporal, as well as complex non trivial combinations of these different attribute types. To evaluate the effectiveness of our approach, we implemented a new insight centric visualization recommendation system, SpotLight, which generates and ranks annotated visualizations to explain each insight. We conducted a user study with 12 participants and two datasets which showed that users are able to quickly understand and find relevant insights in unfamiliar data.


Simultaneous Embedding of Colored Graphs. A set of colored graphs are compatible, if for every color i , the number of vertices of color i is the same in every graph. A simultaneous embedding of k compatibly colored graphs, each with n vertices, consists of k planar polyline drawings of these graphs such that the vertices of the same color are mapped to a common set of vertex locations. We prove that simultaneous embedding of k in o( log log n) colored planar graphs, each with n vertices, can always be computed with a sublinear number of bends per edge. Specifically, we show an O( min c, n 1 1 gamma ) upper bound on the number of bends per edge, where gamma 2 lceil k 2 rceil and c is the total number of colors. Our bound, which results from a better analysis of a previously known algorithm Durocher and Mondal, SIAM J. Discrete Math., 32(4), 2018 , improves the bound for k , as well as the bend complexity by a factor of sqrt 2 k . The algorithm can be generalized to obtain small universal point sets for colored graphs. We prove that n lceil c b rceil vertex locations, where b ge 1 , suffice to embed any set of compatibly colored n vertex planar graphs with bend complexity O(b) , where c is the number of colors.


The trace formula with respect to the twisted Grover matrix of a mixed digraph. We define a zeta function woth respect to the twisted Grover matrix of a mixed digraph, and present an exponential expression and a determinant expression of this zeta function. As an application, we give a trace formula with respect to the twisted Grover matrix of a mixed digraph.


Topic Driven Adaptive Network for Cross Domain Sentiment Classification. Cross domain sentiment classification has been a hot spot these years, which aims to learn a reliable classifier using labeled data from the source domain and evaluate it on the target domain. In this vein, most approaches utilized domain adaptation that maps data from different domains into a common feature space. To further improve the model performance, several methods targeted to mine domain specific information were proposed. However, most of them only utilized a limited part of domain specific information. In this study, we first develop a method of extracting domain specific words based on the topic information. Then, we propose a Topic Driven Adaptive Network (TDAN) for cross domain sentiment classification. The network consists of two sub networks semantics attention network and domain specific word attention network, the structures of which are based on transformers. These sub networks take different forms of input and their outputs are fused as the feature vector. Experiments validate the effectiveness of our TDAN on sentiment classification across domains.


Strong Identification Codes for Graphs. For any graph (G, ) a set of vertices ( cal V ) is said to be dominating if every vertex of (G ) contains at least one node of (G ) and separating if each vertex (v ) contains a unique neighbour (u v in cal V ) that is adjacent to no other vertex of (G. ) If ( cal V ) is both dominating and separating, then ( cal V ) is defined to be an identification code. In this paper, we study strong identification codes with an index (r, ) by imposing the constraint that each vertex of (G ) contains at least (r ) unique neighbours in ( cal V . ) We use the probabilistic method to study both the minimum size of strong identification codes and the existence of graphs that allow an identification code with a given index.


Localizations of Morava E theory and deformations of formal groups. We study the relationship between the transchromatic localizations of Morava E theory, L K(n 1) E n , and formal groups. In particular, we show that the coefficient ring pi 0L K(n 1) E n has a modular interpretation, representing deformations of formal groups with certain extra structure, and derive similar descriptions of the cooperations algebra and E n 1 homology of this spectrum. As an application, we show that L K(1) E 2 has exotic mathcal E infty structures not obtained by K(1) localizing the mathcal E infty ring E 2 .


Online Facility Location with Linear Delay. We study the problem of online facility location with delay. In this problem, a sequence of n clients appear in the metric space, and they need to be eventually connected to some open facility. The clients do not have to be connected immediately, but such a choice comes with a penalty each client incurs a waiting cost (the difference between its arrival and connection time). At any point in time, an algorithm may decide to open a facility and connect any subset of clients to it. This is a well studied problem both of its own, and within the general class of network design problems with delays. Our main focus is on a new variant of this problem, where clients may be connected also to an already open facility, but such action incurs an extra cost an algorithm pays for waiting of the facility (a cost incurred separately for each such "late" connection). This is reminiscent of online matching with delays, where both sides of the connection incur a waiting cost. We call this variant two sided delay to differentiate it from the previously studied one sided delay. We present an O(1) competitive deterministic algorithm for the two sided delay variant. On the technical side, we study a greedy strategy, which grows budgets with increasing waiting delays and opens facilities for subsets of clients once sums of these budgets reach certain thresholds. Our technique is a substantial extension of the approach used by Jain, Mahdian and Saberi STOC 2002 for analyzing the performance of offline algorithms for facility location. We then show how to transform our O(1) competitive algorithm for the two sided delay variant to O( log n log log n) competitive deterministic algorithm for one sided delays. We note that all previous online algorithms for problems with delays in general metrics have at least logarithmic ratios.


Homotopy theory of Moore flows (II). This paper proves that the q model structures of Moore flows and of multipointed d spaces are Quillen equivalent. The main step is the proof that the counit and unit maps of the Quillen adjunction are isomorphisms on the q cofibrant objects (all objects are q fibrant). As an application, we provide a new proof of the fact that the categorization functor from multipointed d spaces to flows has a total left derived functor which induces a category equivalence between the homotopy categories. The new proof sheds light on the internal structure of the categorization functor which is neither a left adjoint nor a right adjoint. It is even possible to write an inverse up to homotopy of this functor using Moore flows.


SmartSplit Latency Energy Memory Optimisation for CNN Splitting on Smartphone Environment. Artificial Intelligence has now taken centre stage in the smartphone industry owing to the need of bringing all processing close to the user and addressing privacy concerns. Convolution Neural Networks (CNNs), which are used by several AI applications, are highly resource and computation intensive. Although new generation smartphones come with AI enabled chips, minimal memory and energy utilisation is essential as many applications are run concurrently on a smartphone. In light of this, optimising the workload on the smartphone by offloading a part of the processing to a cloud server is an important direction of research. In this paper, we analyse the feasibility of splitting CNNs between smartphones and cloud server by formulating a multi objective optimisation problem that optimises the end to end latency, memory utilisation, and energy consumption. We design SmartSplit, a Genetic Algorithm with decision analysis based approach to solve the optimisation problem. Our experiments run with multiple CNN models show that splitting a CNN between a smartphone and a cloud server is feasible. The proposed approach, SmartSplit fares better when compared to other state of the art approaches.


Optimal To Do List Gamification for Long Term Planning. Most people struggle with prioritizing work. While inexact heuristics have been developed over time, there is still no tractable principled algorithm for deciding which of the many possible tasks one should tackle in any given day, month, week, or year. Additionally, some people suffer from cognitive biases such as the present bias, leading to prioritization of their immediate experience over long term consequences which manifests itself as procrastination and inefficient task prioritization. Our method utilizes optimal gamification to help people overcome these problems by incentivizing each task by a number of points that convey how valuable it is in the long run. We extend the previous version of our optimal gamification method with added services for helping people decide which tasks should and should not be done when there is not enough time to do everything. To improve the efficiency and scalability of the to do list solver, we designed a hierarchical procedure that tackles the problem from the top level goals to fine grained tasks. We test the accuracy of the incentivised to do list by comparing the performance of the strategy with the points computed exactly using Value Iteration for a variety of case studies. These case studies were specifically designed to cover the corner cases to get an accurate judge of performance. Our method yielded the same performance as the exact method for all case studies. To demonstrate its functionality, we released an API that makes it easy to deploy our method in Web and app services. We assessed the scalability of our method by applying it to to do lists with increasingly larger numbers of goals, sub goals per goal, hierarchically nested levels of subgoals. We found that the method provided through our API is able to tackle fairly large to do lists having a 576 tasks. This indicates that our method is suitable for real world applications.


Boundary layer formation in the quasigeostrophic model near nonperiodic rough coasts. We study the so called homogeneous model of wind driven ocean circulation, also known as the single layer quasigeostrophic model. Our attention focuses on performing a complete asymptotic analysis that highlights boundary layer formation along the coastal line. We assume rough coasts without any particular structure, resulting in the study of a nonlinear PDE system for the western boundary layer in an infinite domain. As a consequence, we look for the solution in nonlocalized Sobolev spaces. Under this hypothesis, the eastern boundary layer exhibits a singular behavior at low frequencies far from the rough boundary leading to issues with convergence. The problem is tackled by imposing ergodicity properties. We establish the well posedness of the governing boundary layer equations and the approximate solution. Our results generalize the ones in the paper of Bresch and G 'erard Varet (Commun. Math. Phys. (1) 253 (2005), 81 119) in the context of periodic irregularities.


Generate and Revise Reinforcement Learning in Neural Poetry. Writers, poets, singers usually do not create their compositions in just one breath. Text is revisited, adjusted, modified, rephrased, even multiple times, in order to better convey meanings, emotions and feelings that the author wants to express. Amongst the noble written arts, Poetry is probably the one that needs to be elaborated the most, since the composition has to formally respect predefined meter and rhyming schemes. In this paper, we propose a framework to generate poems that are repeatedly revisited and corrected, as humans do, in order to improve their overall quality. We frame the problem of revising poems in the context of Reinforcement Learning and, in particular, using Proximal Policy Optimization. Our model generates poems from scratch and it learns to progressively adjust the generated text in order to match a target criterion. We evaluate this approach in the case of matching a rhyming scheme, without having any information on which words are responsible of creating rhymes and on how to coherently alter the poem words. The proposed framework is general and, with an appropriate reward shaping, it can be applied to other text generation problems.


Embracing New Techniques in Deep Learning for Estimating Image Memorability. Various work has suggested that the memorability of an image is consistent across people, and thus can be treated as an intrinsic property of an image. Using computer vision models, we can make specific predictions about what people will remember or forget. While older work has used now outdated deep learning architectures to predict image memorability, innovations in the field have given us new techniques to apply to this problem. Here, we propose and evaluate five alternative deep learning models which exploit developments in the field from the last five years, largely the introduction of residual neural networks, which are intended to allow the model to use semantic information in the memorability estimation process. These new models were tested against the prior state of the art with a combined dataset built to optimize both within category and across category predictions. Our findings suggest that the key prior memorability network had overstated its generalizability and was overfit on its training set. Our new models outperform this prior model, leading us to conclude that Residual Networks outperform simpler convolutional neural networks in memorability regression. We make our new state of the art model readily available to the research community, allowing memory researchers to make predictions about memorability on a wider range of images.


Evaluation of Tree Based Regression over Multiple Linear Regression for Non normally Distributed Data in Battery Performance. Battery performance datasets are typically non normal and multicollinear. Extrapolating such datasets for model predictions needs attention to such characteristics. This study explores the impact of data normality in building machine learning models. In this work, tree based regression models and multiple linear regressions models are each built from a highly skewed non normal dataset with multicollinearity and compared. Several techniques are necessary, such as data transformation, to achieve a good multiple linear regression model with this dataset the most useful techniques are discussed. With these techniques, the best multiple linear regression model achieved an R 2 81.23 and exhibited no multicollinearity effect for the dataset used in this study. Tree based models perform better on this dataset, as they are non parametric, capable of handling complex relationships among variables and not affected by multicollinearity. We show that bagging, in the use of Random Forests, reduces overfitting. Our best tree based model achieved accuracy of R 2 97.73 . This study explains why tree based regressions promise as a machine learning model for non normally distributed, multicollinear data.


IFCNet A Benchmark Dataset for IFC Entity Classification. Enhancing interoperability and information exchange between domain specific software products for BIM is an important aspect in the Architecture, Engineering, Construction and Operations industry. Recent research started investigating methods from the areas of machine and deep learning for semantic enrichment of BIM models. However, training and evaluation of these machine learning algorithms requires sufficiently large and comprehensive datasets. This work presents IFCNet, a dataset of single entity IFC files spanning a broad range of IFC classes containing both geometric and semantic information. Using only the geometric information of objects, the experiments show that three different deep learning models are able to achieve good classification performance.


VeSoNet Traffic Aware Content Caching for Vehicular Social Networks based on Path Planning and Deep Reinforcement Learning. Vehicular social networking is an emerging application of the promising Internet of Vehicles (IoV) which aims to achieve the seamless integration of vehicular networks and social networks. However, the unique characteristics of vehicular networks such as high mobility and frequent communication interruptions make content delivery to end users under strict delay constrains an extremely challenging task. In this paper, we propose a social aware vehicular edge computing architecture that solves the content delivery problem by using some of the vehicles in the network as edge servers that can store and stream popular content to close by end users. The proposed architecture includes three components. First, we propose a social aware graph pruning search algorithm that computes and assigns the vehicles to the shortest path with the most relevant vehicular content providers. Secondly, we use a traffic aware content recommendation scheme to recommend relevant content according to their social context. This scheme uses graph embeddings in which the vehicles are represented by a set of low dimension vectors (vehicle2vec) to store information about previously consumed content. Finally, we propose a Deep Reinforcement Learning (DRL) method to optimize the content provider vehicles distribution across the network. The results obtained from a realistic traffic simulation show the effectiveness and robustness of the proposed system when compared to the state of the art baselines.


Boolean intersection ideals of permutations in the Bruhat order. Motivated by recent work with Mazorchuk, we characterize the conditions under which the intersection of two principal order ideals in the Bruhat order is boolean. That characterization is presented in three versions in terms of reduced words, in terms of permutation patterns, and in terms of permutation support. The equivalence of these properties follows from an analysis of what it means to have a specific letter repeated in a permutation's reduced words namely, that a specific 321 pattern appears.


Hierarchical Cross Modality Semantic Correlation Learning Model for Multimodal Summarization. Multimodal summarization with multimodal output (MSMO) generates a summary with both textual and visual content. Multimodal news report contains heterogeneous contents, which makes MSMO nontrivial. Moreover, it is observed that different modalities of data in the news report correlate hierarchically. Traditional MSMO methods indistinguishably handle different modalities of data by learning a representation for the whole data, which is not directly adaptable to the heterogeneous contents and hierarchical correlation. In this paper, we propose a hierarchical cross modality semantic correlation learning model (HCSCL) to learn the intra and inter modal correlation existing in the multimodal data. HCSCL adopts a graph network to encode the intra modal correlation. Then, a hierarchical fusion framework is proposed to learn the hierarchical correlation between text and images. Furthermore, we construct a new dataset with relevant image annotation and image object label information to provide the supervision information for the learning procedure. Extensive experiments on the dataset show that HCSCL significantly outperforms the baseline methods in automatic summarization metrics and fine grained diversity tests.


Controllable Abstractive Dialogue Summarization with Sketch Supervision. In this paper, we aim to improve abstractive dialogue summarization quality and, at the same time, enable granularity control. Our model has two primary components and stages 1) a two stage generation strategy that generates a preliminary summary sketch serving as the basis for the final summary. This summary sketch provides a weakly supervised signal in the form of pseudo labeled interrogative pronoun categories and key phrases extracted using a constituency parser. 2) A simple strategy to control the granularity of the final summary, in that our model can automatically determine or control the number of generated summary sentences for a given dialogue by predicting and highlighting different text spans from the source text. Our model achieves state of the art performance on the largest dialogue summarization corpus SAMSum, with as high as 50.79 in ROUGE L score. In addition, we conduct a case study and show competitive human evaluation results and controllability to human annotated summaries.


Fractional Fourier transforms, powers of harmonic oscillators and their propagators on Pilipovic and modulation spaces. We show that harmonic oscillator propagators and fractional Fourier transforms are essentially the same. We deduce continuity properties for such operators on modulation spaces. Especially we extend some known results in the literature. We also show that general forms of fractional harmonic oscillator propagators are continuous on suitable Pilipovic spaces.


ChangeChip A Reference Based Unsupervised Change Detection for PCB Defect Detection. The usage of electronic devices increases, and becomes predominant in most aspects of life. Surface Mount Technology (SMT) is the most common industrial method for manufacturing electric devices in which electrical components are mounted directly onto the surface of a Printed Circuit Board (PCB). Although the expansion of electronic devices affects our lives in a productive way, failures or defects in the manufacturing procedure of those devices might also be counterproductive and even harmful in some cases. It is therefore desired and sometimes crucial to ensure zero defect quality in electronic devices and their production. While traditional Image Processing (IP) techniques are not sufficient to produce a complete solution, other promising methods like Deep Learning (DL) might also be challenging for PCB inspection, mainly because such methods require big adequate datasets which are missing, not available or not updated in the rapidly growing field of PCBs. Thus, PCB inspection is conventionally performed manually by human experts. Unsupervised Learning (UL) methods may potentially be suitable for PCB inspection, having learning capabilities on the one hand, while not relying on large datasets on the other. In this paper, we introduce ChangeChip, an automated and integrated change detection system for defect detection in PCBs, from soldering defects to missing or misaligned electronic elements, based on Computer Vision (CV) and UL. We achieve good quality defect detection by applying an unsupervised change detection between images of a golden PCB (reference) and the inspected PCB under various setting. In this work, we also present CD PCB, a synthesized labeled dataset of 20 pairs of PCB images for evaluation of defect detection algorithms.


A General Framework for Inverse Problem Solving using Self Supervised Deep Learning Validations in Ultrasound and Photoacoustic Image Reconstruction. The image reconstruction process in medical imaging can be treated as solving an inverse problem. The inverse problem is usually solved using time consuming iterative algorithms with sparsity or other constraints. Recently, deep neural network (DNN) based methods have been developed to accelerate the inverse problem solving process. However, these methods typically adopt supervised learning scheme, which requires ground truths, or labels of the solutions, for training. In many applications, it would be challenging or even impossible to obtain the ground truth, such as the tissue reflectivity function in ultrasound beamforming. In this study, a general framework based on self supervised learning (SSL) scheme is proposed to train a DNN to solve the inverse problems. In this way, the measurements can be used as both the inputs and the labels during the training of DNN. The proposed SSL method is applied to four typical linear inverse problems for validation, i.e., plane wave ultrasound and photoacoustic image reconstructions, compressed sensing based synthetic transmit aperture dataset recovery and deconvolution in ultrasound localization microscopy. Results show that, using the proposed framework, the trained DNN can achieve improved reconstruction accuracy with reduced computational time, compared with conventional methods.


A matrix Harnack inequality for semilinear heat equations. We derive a matrix version of Li Yau type estimates for positive solutions of semilinear heat equations on Riemannian manifolds with nonnegative sectional curvatures and parallel Ricci tensor, similarly to what R. Hamilton did in cite hamilton7 for the standard heat equation. We then apply these estimates to obtain some Harnack type inequalities, which give local bounds on the solutions in terms of the geometric quantities involved.


Adaptive Channel Encoding Transformer for Point Cloud Analysis. Transformer plays an increasingly important role in various computer vision areas and remarkable achievements have also been made in point cloud analysis. Since they mainly focus on point wise transformer, an adaptive channel encoding transformer is proposed in this paper. Specifically, a channel convolution called Transformer Conv is designed to encode the channel. It can encode feature channels by capturing the potential relationship between coordinates and features. Compared with simply assigning attention weight to each channel, our method aims to encode the channel adaptively. In addition, our network adopts the neighborhood search method of low level and high level dual semantic receptive fields to improve the performance. Extensive experiments show that our method is superior to state of the art point cloud classification and segmentation methods on three benchmark datasets.


Passive, Transparent, and Selective TLS Decryption for Network Security Monitoring. Internet traffic is increasingly encrypted. While this protects the confidentiality and integrity of communication, it prevents network monitoring systems (NMS) and intrusion detection systems (IDSs) from effectively analyzing the now encrypted payloads. Therefore, many enterprise networks have deployed man in the middle (MitM) proxies that intercept TLS connections at the network border to examine packet payloads and thus retain some visibility. However, recent studies have shown that TLS interception often reduces connection security and potentially introduces additional attack vectors to the network. In this paper, we present a cooperative approach in which end hosts as cryptographic endpoints selectively provide TLS key material to NMS for decryption. This enables endpoints to control who can decrypt which content and lets users retain privacy for chosen connections. We implement a prototype based on the Zeek NMS that is able to receive key material from hosts, decrypt TLS connections and perform analyzes on the cleartext. The patch is freely available and we plan to upstream our changes to Zeek once they are mature enough. In our evaluation, we discuss how our approach conceptually requires significantly less computational resources compared to the commonly deployed MitM proxies. Our experimental results indicate, that TLS decryption increases a runtime overhead of about 2.5 times of the original runtime on cleartext. Additionally, we show that the latency for transmitting keys between hosts and the NMS can be effectively addressed by buffering traffic at the NMS for at least 40ms, allowing successful decryption of 99.99 of all observed TLS connections.


Certified Compilation of Financial Contracts. We present an extension to a certified financial contract management system that allows for templated declarative financial contracts and for integration with financial stochastic models through verified compilation into so called payoff expressions. Such expressions readily allow for determining the value of a contract in a given evaluation context, such as contexts created for stochastic simulations. The templating mechanism is useful both at the contract specification level, for writing generic reusable contracts, and for reuse of code that, without the templating mechanism, needs to be recompiled for different evaluation contexts. We report on the effect of using the certified system in the context of a GPGPU based Monte Carlo simulation engine for pricing various over the counter (OTC) financial contracts. The full contract management system, including the payoff language compilation, is verified in the Coq proof assistant and certified Haskell code is extracted from our Coq development along with Futhark code for use in a data parallel pricing engine.


Paraproducts for bilinear multipliers associated with convex sets. We prove bounds in the local L 2 range for exotic paraproducts motivated by bilinear multipliers associated with convex sets. One result assumes an exponential boundary curve. Another one assumes a higher order lacunarity condition.


Multiple ionization energy difference of 163Ho and 163Dy atoms. The multiple ionization energy difference of 163Ho and 163Dy atoms is evaluated for the ionization degree q 30, 48, 56. The calculations are performed by means of the large scale relativistic configuration interaction method combined with the many body perturbation theory. The quantum electrodynamics, nuclear recoil, and frequency dependent Breit interaction corrections are taken into account. The obtained theoretical values are within 1 eV uncertainty. These results can help to increase accuracy of the laboratory neutrino mass limit, provided they are accompanied by the corresponding experiment on electron capture in Ho and a precise measurement of the ion mass difference.


Single Crystal NMR Spectroscopy. Single crystal (SC) NMR spectroscopy is a solid state NMR method that has been used since the early days of NMR to study the magnitude and orientation of tensorial nuclear spin interactions in solids. This review first presents the field of SC NMR instrumentation, then provides a survey of software for analysis of SC NMR data, and finally it highlights selected applications of SC NMR in various fields of research. The aim of the last part is not to provide a complete review of all SC NMR literature but to provide examples that demonstrate interesting applications of SC NMR.


Transversal achievement game on a square grid. This paper intends to solve the Transversal achievement on an n times n grid problem proposed by Dr. Martin Erickson. We approach the problem using mathematical induction and case analysis and prove the hypothesis that for all n greater than 1, the game is a draw.


Orchard Networks are Trees with Additional Horizontal Arcs. Phylogenetic networks are used in biology to represent evolutionary histories. The class of orchard phylogenetic networks was recently introduced for their computational benefits, without any biological justification. Here, we show that orchard networks can be interpreted as trees with additional emph horizontal arcs. Therefore, they are closely related to tree based networks, where the difference is that in tree based networks the additional arcs do not need to be horizontal. Then, we use this new characterization to show that the space of orchard networks is connected under the rNNI rearrangement move, with a diameter of at most 4kn n lceil log 2(n) rceil 2k 6n 8 .


Two layer Ensemble of Deep Learning Models for Medical Image Segmentation. In recent years, deep learning has rapidly become a method of choice for the segmentation of medical images. Deep Neural Network (DNN) architectures such as UNet have achieved state of the art results on many medical datasets. To further improve the performance in the segmentation task, we develop an ensemble system which combines various deep learning architectures. We propose a two layer ensemble of deep learning models for the segmentation of medical images. The prediction for each training image pixel made by each model in the first layer is used as the augmented data of the training image for the second layer of the ensemble. The prediction of the second layer is then combined by using a weights based scheme in which each model contributes differently to the combined result. The weights are found by solving linear regression problems. Experiments conducted on two popular medical datasets namely CAMUS and Kvasir SEG show that the proposed method achieves better results concerning two performance metrics (Dice Coefficient and Hausdorff distance) compared to some well known benchmark algorithms.


Multi modal Sarcasm Detection and Humor Classification in Code mixed Conversations. Sarcasm detection and humor classification are inherently subtle problems, primarily due to their dependence on the contextual and non verbal information. Furthermore, existing studies in these two topics are usually constrained in non English languages such as Hindi, due to the unavailability of qualitative annotated datasets. In this work, we make two major contributions considering the above limitations (1) we develop a Hindi English code mixed dataset, MaSaC, for the multi modal sarcasm detection and humor classification in conversational dialog, which to our knowledge is the first dataset of its kind (2) we propose MSH COMICS, a novel attention rich neural architecture for the utterance classification. We learn efficient utterance representation utilizing a hierarchical attention mechanism that attends to a small portion of the input sentence at a time. Further, we incorporate dialog level contextual attention mechanism to leverage the dialog history for the multi modal classification. We perform extensive experiments for both the tasks by varying multi modal inputs and various submodules of MSH COMICS. We also conduct comparative analysis against existing approaches. We observe that MSH COMICS attains superior performance over the existing models by 1 F1 score point for the sarcasm detection and 10 F1 score points in humor classification. We diagnose our model and perform thorough analysis of the results to understand the superiority and pitfalls.


Excitation of resonant surface plasmons for evanescent waves refocusing by a superlens. The amplification of evanescent waves by flat superlens requires a near resonance coupling which has been linked to resonant surface plasmons. A subtle interplay has been proposed to exist between the excitation of well defined resonant surface plasmons and the focusing capability of a superlens. To gain insights into these resonant modes and their contributions to the amplification and recovery of evanescent waves, we performed simple but robust full wave FDTD simulations on causal negative index Lorentz models. We found that well defined pair of resonant surface plasmons is excited whenever a coupling of a diverging transmitted beam and a converging refracted beam occurs at the second interface. The resonant coupling of these modes at the interface led to the excitation of a single interface resonance predicted by the theory. The physical consequence of this resonance is that incident wave energy is pumped into the negative index material medium and beyond it. These phenomena contribute substantially to the amplification and recovery of the near fields in the image plane. It is noteworthy that, for evanescent wave refocusing to be achieved in a flat superlens, its thickness, and the source to superlens distance should be optimized. This optimization is critical in that an optimal thickness alongside optimal source to superlens distance will allow evanescent wave refocusing to dominate material lost. The FDTD simulated result showed an image of the point source inside the superlens and beyond it when its thickness was optimized. The resolution of the image beyond the superlens was sim.58 lambda and this superlens behaves like a near perfect lens. Overall, these numerically simulated results could serve as useful approximations to the degree of resonant amplification and refocusing of near fields that can be achieved by flat superlens in near fields experimental imaging setups.


Certain Fourier Operators and their Associated Poisson Summation Formulae on mathrm GL 1 . In this paper, we explore a possibility to utilize harmonic analysis on GL 1 to understand Langlands automorphic L functions in general, as a vast generalization of the pioneering work of J. Tate. For a split reductive group G over a number field k , let G vee( BC) be its complex dual group and rho be an n dimensional complex representation of G vee( BC) . For any irreducible cuspidal automorphic representation sig of G( BA) , where BA is the ring of adeles of k , we introduce the space CS sig, rho ( BA times) of ( sig, rho) Schwartz functions on BA times and ( sig, rho) Fourier operator CF sig, rho, psi that takes CS sig, rho ( BA times) to CS wt sig , rho ( BA times) , where wt sig is the contragredient of sig . By assuming the local Langlands functoriality for the pair (G, rho) , we show that the ( sig, rho) theta functions Theta sig, rho (x, phi) sum alp in k times phi( alp x) converges absolutely for all phi in CS sig, rho ( BA times) , and state conjectures on ( sigma, rho) Poisson summation formula on GL 1 . Then we prove conjectures when G GL n and rho is the standard representation of GL n( BC) . The proof uses substantially the local theory of Godement Jacquet for the standard L functions of GL n and the Poisson summation formula for the classical Fourier transform on affine spaces. As an application, we provide a spectral interpretation of the critical zeros of the standard L functions L(s, pi times chi) for any irreducible cuspidal automorphic representation pi of GL n( BA) and idele class character chi of k , which is a reformulation in the adelic framework of the work of A. Connes and is an extension from the Hecke L functions L(s, chi) to the automorphic L functions L(s, pi times chi) .


Modelling Monotonic and Non Monotonic Attribute Dependencies with Embeddings A Theoretical Analysis. During the last decade, entity embeddings have become ubiquitous in Artificial Intelligence. Such embeddings essentially serve as compact but semantically meaningful representations of the entities of interest. In most approaches, vectors are used for representing the entities themselves, as well as for representing their associated attributes. An important advantage of using attribute embeddings is that (some of the) semantic dependencies between the attributes can thus be captured. However, little is known about what kinds of semantic dependencies can be modelled in this way. The aim of this paper is to shed light on this question, focusing on settings where the embedding of an entity is obtained by pooling the embeddings of its known attributes. Our particular focus is on studying the theoretical limitations of different embedding strategies, rather than their ability to effectively learn attribute dependencies in practice. We first show a number of negative results, revealing that some of the most popular embedding models are not able to capture even basic Horn rules. However, we also find that some embedding strategies are capable, in principle, of modelling both monotonic and non monotonic attribute dependencies.


A strong convergence theorem for solving an equilibrium problem and a fixed point problem using the Bregman distance. In this paper, using the Bregman distance, we introduce a new projection type algorithm for finding a common element of the set of solutions of an equilibrium problem and the set of fixed points. Then the strong convergence of the sequence generated by the algorithm will be established under suitable conditions. Finally, using MATLAB software, we present a numerical example to illustrate the convergence performance of our algorithm.


Supply of engineering techniques and software design patterns in psychoanalysis and psychometrics sciences. The purpose of this study is to introduce software technologies and models and artificial intelligence algorithms to improve the weaknesses of CBT (Cognitive Behavior Therapy) method in psychotherapy. The presentation method for this purpose is the implementation of psychometric experiments in which the hidden human variables are inferred from the answers of tests. In this report, we describe the various models of Item Response Theory and measure the hidden components of ability and complementary parameters of the reality of the individual's situation. Psychometrics, selecting the appropriate model and estimating its parameters have been introduced and implemented using R language developed libraries. Due to the high flexibility of the Multi variant Rasch mixture Model, machine learning has been applied to this method of data modeling. BIC and CML were used to determine the number of hidden classes of the model and its parameters respectively, to obtain Measurement Invariance. The sensitivity of items to hidden attributes varies between groups (DIF), so methods for detecting it are introduced. This simulation is done based on the Verbal Aggression Dataset. We also analyze and compile a reference model based on this certificate based on the discovered patterns of software engineering. Other achievements of this study are related to providing a solution to explain the reengineering problems of the mind, by preparing an identity card for the clients by an ontology. Finally, applying the developed knowledge in the form of system thinking and recommended patterns in software engineering during the treatment process is pointed out.


Smooth Fano four folds in Gorenstein formats. We construct some new deformation families of four dimensional Fano manifolds of index 1 in some known classes of Gorenstein formats. These families have explicit descriptions in terms of equations, defining their image under the anti canonical embedding in some weighted projective space. The constructed families have relatively smaller anti canonical degrees than most other known families of smooth Fano 4 folds.


The Struggle with Academic Plagiarism Approaches based on Semantic Similarity. Academic plagiarism is a serious problem nowadays. Due to the existence of inexhaustible sources of digital information, today it is easier to plagiarize more than ever before. The good thing is that plagiarism detection techniques have improved and are powerful enough to detect attempts of plagiarism in education. We are now witnessing efficient plagiarism detection software in action, such as Turnitin, iThenticate or SafeAssign. In the introduction we explore software that is used within the Croatian academic community for plagiarism detection in universities and or in scientific journals. The question is is this enough? Current software has proven to be successful, however the problem of identifying paraphrasing or obfuscation plagiarism remains unresolved. In this paper we present a report of how semantic similarity measures can be used in the plagiarism detection task.


A Fast and Effective Early Stage Multi level Cache Optimization Method Based on Reuse Distance Analysis. In this paper, we propose a practical and effective approach allowing designers to optimize multi level cache size at the early system design phase. Our key contribution is to generalize the reuse distance analysis method and develop an effective and practical cache design optimization approach. We adopt a simple scanning search method to locate optimal cache solutions in terms of cache size, power consumption, or average data access delay. The proposed approach is particularly useful for early phase system designers and is verified to be 150 to 250 times faster than the traditional simulation based approach. In addition, we also introduce a simplified analytical model and provide designers insights about how cache design parameters may affect the expected results. As a result, designers can make an adequate decision in the early system design phase.


A Branch and Price approach for the Continuous Multifacility Monotone Ordered Median Problem. In this paper, we address the Continuous Multifacility Monotone Ordered Median Problem. This problem minimizes a monotone ordered weighted median function of the distances between given demand points in mathbb R d and its closest facility among the p selected, also in a continuous space. We propose a new branch and price procedure for this problem, and two mathehuristics. One of them is a decomposition based procedure and the other an aggregation based heuristic. We give detailed discussions of the validity of the exact formulations and also specify the implementation details of all the solution procedures. Besides, we assess their performance in an extensive computational experience that shows the superiority of the branch and price approach over the compact formulation in medium sized instances. To handle larger instances it is advisable to resort to the matheuristics that also report rather good results.


Lettuce PyTorch based Lattice Boltzmann Framework. The lattice Boltzmann method (LBM) is an efficient simulation technique for computational fluid mechanics and beyond. It is based on a simple stream and collide algorithm on Cartesian grids, which is easily compatible with modern machine learning architectures. While it is becoming increasingly clear that deep learning can provide a decisive stimulus for classical simulation techniques, recent studies have not addressed possible connections between machine learning and LBM. Here, we introduce Lettuce, a PyTorch based LBM code with a threefold aim. Lettuce enables GPU accelerated calculations with minimal source code, facilitates rapid prototyping of LBM models, and enables integrating LBM simulations with PyTorch's deep learning and automatic differentiation facility. As a proof of concept for combining machine learning with the LBM, a neural collision model is developed, trained on a doubly periodic shear layer and then transferred to a different flow, a decaying turbulence. We also exemplify the added benefit of PyTorch's automatic differentiation framework in flow control and optimization. To this end, the spectrum of a forced isotropic turbulence is maintained without further constraining the velocity field. The source code is freely available from https github.com lettucecfd lettuce.


Floquet quadrupole photonic crystals protected by space time symmetry. High order topological phases, such as those with nontrivial quadrupole moments, protect edge states that are themselves topological insulators in lower dimensions. So far, most quadrupole phases of light are explored in linear optical systems, which are protected by spatial symmetries or synthetic symmetries. Here we present Floquet quadrupole phases in driven nonlinear photonic crystals (PhCs) that are protected by space time screw symmetries. We start by illustrating space time symmetries by tracking the trajectory of instantaneous optical axes of the driven media. Our Floquet quadrupole phase is then confirmed in two independent ways symmetry indices at high symmetry momentum points and calculations of the nested Wannier bands. Our work presents a general framework to analyze symmetries in driven optical materials and paves the way to further exploring symmetry protected topological phases in Floquet systems and their optoelectronic applications.


Toward Real time Analysis of Experimental Science Workloads on Geographically Distributed Supercomputers. Massive upgrades to science infrastructure are driving data velocities upwards while stimulating adoption of increasingly data intensive analytics. While next generation exascale supercomputers promise strong support for I O intensive workflows, HPC remains largely untapped by live experiments, because data transfers and disparate batch queueing policies are prohibitive when faced with scarce instrument time. To bridge this divide, we introduce Balsam a distributed orchestration platform enabling workflows at the edge to securely and efficiently trigger analytics tasks across a user managed federation of HPC execution sites. We describe the architecture of the Balsam service, which provides a workflow management API, and distributed sites that provision resources and schedule scalable, fault tolerant execution. We demonstrate Balsam in efficiently scaling real time analytics from two DOE light sources simultaneously onto three supercomputers (Theta, Summit, and Cori), while maintaining low overheads for on demand computing, and providing a Python library for seamless integration with existing ecosystems of data analysis tools.


PandaNet Anchor Based Single Shot Multi Person 3D Pose Estimation. Recently, several deep learning models have been proposed for 3D human pose estimation. Nevertheless, most of these approaches only focus on the single person case or estimate 3D pose of a few people at high resolution. Furthermore, many applications such as autonomous driving or crowd analysis require pose estimation of a large number of people possibly at low resolution. In this work, we present PandaNet (Pose estimAtioN and Dectection Anchor based Network), a new single shot, anchor based and multi person 3D pose estimation approach. The proposed model performs bounding box detection and, for each detected person, 2D and 3D pose regression into a single forward pass. It does not need any post processing to regroup joints since the network predicts a full 3D pose for each bounding box and allows the pose estimation of a possibly large number of people at low resolution. To manage people overlapping, we introduce a Pose Aware Anchor Selection strategy. Moreover, as imbalance exists between different people sizes in the image, and joints coordinates have different uncertainties depending on these sizes, we propose a method to automatically optimize weights associated to different people scales and joints for efficient training. PandaNet surpasses previous single shot methods on several challenging datasets a multi person urban virtual but very realistic dataset (JTA Dataset), and two real world 3D multi person datasets (CMU Panoptic and MuPoTS 3D).


On the bundle of KMS state spaces for flows on a Z absorbing C algebra. We obtain three results 1) Every compact simplex bundle with exactly one point in the fiber over 0 is the KMS bundle of a periodic flow on the Jiang Su algebra. 2) Let A be a separable unital C algebra with a unique trace state. Suppose that A tensorially absorbs the Jiang Su algebra. The (weak) cocycle conjugacy classes of flows that are not approximately inner are uncountable. 3) Let B be a separable, simple, unital, purely infinite and nuclear C algebra in the UCT class. Assume that the K1 group of B is torsion free. Every proper simplex bundle with empty fiber over 0 is the KMS bundle of a periodic flow on B.


Image Reconstruction from Events. Why learn it?. Traditional cameras measure image intensity. Event cameras, by contrast, measure per pixel temporal intensity changes asynchronously. Recovering intensity from events is a popular research topic since the reconstructed images inherit the high dynamic range (HDR) and high speed properties of events hence they can be used in many robotic vision applications and to generate slow motion HDR videos. However, state of the art methods tackle this problem by training an event to image recurrent neural network (RNN), which lacks explainability and is difficult to tune. In this work we show, for the first time, how tackling the joint problem of motion and intensity estimation leads us to model event based image reconstruction as a linear inverse problem that can be solved without training an image reconstruction RNN. Instead, classical and learning based image priors can be used to solve the problem and remove artifacts from the reconstructed images. The experiments show that the proposed approach generates images with visual quality on par with state of the art methods despite only using data from a short time interval (i.e., without recurrent connections). Our method can also be used to improve the quality of images reconstructed by approaches that first estimate the image Laplacian here our method can be interpreted as Poisson reconstruction guided by image priors.


Extended Reality for Knowledge Work in Everyday Environments. Virtual and Augmented Reality have the potential to change information work. The ability to modify the workers senses can transform everyday environments into a productive office, using portable head mounted displays combined with conventional interaction devices, such as keyboards and tablets. While a stream of better, cheaper and lighter HMDs have been introduced for consumers in recent years, there are still many challenges to be addressed to allow this vision to become reality. This chapter summarizes the state of the art in the field of extended reality for knowledge work in everyday environments and proposes steps to address the open challenges.


Semi Supervised Joint Estimation of Word and Document Readability. Readability or difficulty estimation of words and documents has been investigated independently in the literature, often assuming the existence of extensive annotated resources for the other. Motivated by our analysis showing that there is a recursive relationship between word and document difficulty, we propose to jointly estimate word and document difficulty through a graph convolutional network (GCN) in a semi supervised fashion. Our experimental results reveal that the GCN based method can achieve higher accuracy than strong baselines, and stays robust even with a smaller amount of labeled data.


Magnetic Free Silicon Nitride Integrated Optical Isolator. Integrated photonics has enabled signal synthesis, modulation and conversion using photonic integrated circuits (PIC). Many materials have been developed, among which silicon nitride (Si 3 N 4 ) has emerged as a leading platform particularly for nonlinear photonics. Low loss Si 3 N 4 PIC has been widely used for frequency comb generation, narrow linewidth lasers, microwave photonics, photonic computing networks, and even surface electrode ion traps. Yet, among all demonstrated functionalities for Si 3 N 4 integrated photonics, optical non reciprocal devices, such as isolators and circulators, have not been achieved. Conventionally, they are realized based on Faraday effect of magneto optic materials under external magnetic field. However, it has been challenging to integrate magneto optic materials that are not CMOS compatible and that require bulky external magnet. Here, we demonstrate a magnetic free optical isolator based on aluminum nitride (AlN) piezoelectric modulators monolithically integrated on ultralow loss Si 3 N 4 PIC. The transmission reciprocity is broken by spatio temporal modulation of a Si 3 N 4 microring resonator with three AlN bulk acoustic wave resonators that are driven with a rotational phase. This design creates an effective rotating acoustic wave that allows indirect interband transition in only one direction among a pair of strongly coupled optical modes. Maximum of 10 dB isolation is achieved under 100 mW RF power applied to each actuator, with minimum insertion loss of 0.1 dB. The isolation remains constant over nearly 30 dB dynamic range of optical input power, showing excellent optical linearity. Our integrated, linear, magnetic free, electrically driven optical isolator could become key building blocks for integrated lasers, chip scale LiDAR engines, as well as optical interfaces for superconducting circuits.


On the Rank Function of Generic Linearly Constrained Frameworks in mathbb R 2 . We study the rank function of generic rigidity of bar and joint frameworks in mathbb R 2 such that some vertices are constrained to lie in some lines. The rigidity of such frameworks is characterised by Streinu and Theran. In this paper we characterise the rank function of such frameworks in terms of vertex covers by extending Lov 'asz and Yemini's characterisation of the rank function of the 2 dimensional generic bar and joint rigidity matroid.


An improved bound on the chromatic number of the Pancake graphs. In this paper an improved bound on the chromatic number of the Pancake graph P n, n geqslant 2 , is presented. The bound is obtained using a subadditivity property of the chromatic number of the Pancake graph. We also investigate an equitable coloring of P n . An equitable (n 1) coloring based on efficient dominating sets is given and optimal equitable 4 colorings are considered for small n . It is conjectured that the chromatic number of P n coincides with its equitable chromatic number for any n geqslant 2 .


Efficient Placard Discovery for Semantic Mapping During Frontier Exploration. Semantic mapping is the task of providing a robot with a map of its environment beyond the open, navigable space of traditional Simultaneous Localization and Mapping (SLAM) algorithms by attaching semantics to locations. The system presented in this work reads door placards to annotate the locations of offices. Whereas prior work on this system developed hand crafted detectors, this system leverages YOLOv2 for detection and a segmentation network for segmentation. Placards are localized by computing their pose from a homography computed from a segmented quadrilateral outline. This work also introduces an Interruptable Frontier Exploration algorithm, enabling the robot to explore its environment to construct its SLAM map while pausing to inspect placards observed during this process. This allows the robot to autonomously discover room placards without human intervention while speeding up significantly over previous autonomous exploration methods.


COSINE A Web Server for Clonal and Subclonal Structure Inference and Evolution in Cancer Genomics. Cancers evolve from mutation of a single cell with sequential clonal and subclonal expansion of somatic mutation acquisition. Inferring clonal and subclonal structures from bulk or single cell tumor genomic sequencing data has a huge impact on cancer evolution studies. Clonal state and mutational order can provide detailed insight into tumor origin and its future development. In the past decade, a variety of methods have been developed for subclonal reconstruction using bulk tumor sequencing data. As these methods have been developed in different programming languages and using different input data formats, their use and comparison can be problematic. Therefore, we established a web server for clonal and subclonal structure inference and evolution of cancer genomic data (COSINE), which included 12 popular subclonal reconstruction methods. We decomposed each method via a detailed workflow of single processing steps with a user friendly interface. To the best of our knowledge, this is the first web server providing online subclonal inference, including the most popular subclonal reconstruction methods. COSINE is freely accessible at www.clab cosine.net or http bio.rj.run 48996 cun web.


Microlocal analysis of d plane transform on the Euclidean space. We study the basic properties of d plane transform on the Euclidean space as a Fourier integral operator, and its application to the microlocal analysis of streaking artifacts in its filtered back projection. The d plane transform is defined by integrals of functions on the n dimensional Euclidean space over all the d dimensional planes, where 0 d n. This maps functions on the Euclidean space to those on the affine Grassmannian G(d,n). This is said to be X ray transform if d 1 and Radon transform if d n 1. When n 2 the X ray transform is thought to be measurements of CT scanners. In this paper we obtain concrete expression of the canonical relation of the d plane transform and quantitative properties of the filtered back projection of the product of the images of the d plane transform. The latter one is related to the metal streaking artifacts of CT images, and some generalization of recent results of Park Choi Seo (2017) and Palacios Uhlmann Wang (2018) for the X ray transform on the plane.


Dual comb cavity ring down spectroscopy. Cavity ring down spectroscopy is a ubiquitous optical method used to study light matter interactions with high resolution, sensitivity and accuracy. However, it has never been performed with the multiplexing advantages of direct frequency comb spectroscopy without sacrificing orders of magnitude of resolution. We present dual comb cavity ring down spectroscopy (DC CRDS) based on the parallel heterodyne detection of ring down signals with a local oscillator comb to yield absorption and dispersion spectra. These spectra are obtained from widths and positions of cavity modes. We present two approaches which leverage the dynamic cavity response to coherently or randomly driven changes in the amplitude or frequency of the probe field. Both techniques yield accurate spectra of methane an important greenhouse gas and breath biomarker. The high sensitivity and accuracy of broadband DC CRDS, shows promise for applications like studies of the structure and dynamics of large molecules, multispecies trace gas detection and isotopic composition.


Groovy Parallel Patterns A Process oriented Parallelization Library. A novel parallel patterns library, Groovy Parallel Patterns, is presented which, from the outset, has been designed to exploit more general process parallelism than the usual data and task parallel architectures. The library executes on a standard Java Virtual Machine. The library provides a collection of processes that can be plugged together to form a variety of parallel architectures and is intrinsically its own DSL. A network of processes is guaranteed to be deadlock and livelock free and terminate correctly and this is proved by the use of formal methods. Error capture and a basic logging mechanism have been incorporated. The library enables effective refinement of solutions between process networks which can be checked also using formal methods. A library user is only required to create the required methods as pieces of sequential code, typically taken from extant sequential solutions, which can then be invoked by the processes as required. The utility of the library is demonstrated by several examples including Monte Carlo Methods, Concordance, Jacobi solutions, N body problems and Mandelbrot, which is implemented on both a multicore processor and a workstation cluster. The examples are analysed for speedup and efficiency, which show good and consistent performance improvement up to the number of available processor cores and workstations.


On solving convex min min problems with smoothness and strong convexity in one variable group and small dimension of the other. This paper is devoted to some approaches for convex min min problems with smoothness and strong convexity in only one of the two variable groups. It is shown that the proposed approaches, based on Vaidya's cutting plane method and Nesterov's fast gradient method, achieve the linear convergence. The outer minimization problem is solved using Vaidya's cutting plane method, and the inner problem (smooth and strongly convex) is solved using the fast gradient method. Due to the importance of machine learning applications, we also consider the case when the objective function is a sum of a large number of functions. In this case, the variance reduced accelerated gradient algorithm is used instead of Nesterov's fast gradient method. The numerical experiments' results illustrate the advantages of the proposed procedures for logistic regression with the prior on one of the parameter groups.


Language Transformations in the Classroom. Language transformations are algorithms that take a language specification in input, and return the language specification modified. Language transformations are useful for automatically adding features such as subtyping to programming languages (PLs), and for automatically deriving abstract machines. In this paper, we set forth the thesis that teaching programming languages features with the help of language transformations, in addition to the planned material, can be beneficial for students to help them deepen their understanding of the features being taught. We have conducted a study on integrating language transformations into an undergraduate PL course. We describe our study, the material that we have taught, and the exam submitted to students, and we present the results from this study. Although we refrain from drawing general conclusions on the effectiveness of language transformations, this paper offers encouraging data. We also offer this paper to inspire similar studies.


Axially Overlapped Multi Focus Light Sheet with Enlarged Field of View. Light sheet fluorescence microscopy provides optical sectioning and is widely used in volumetric imaging of large specimens. However, the axial resolution and the lateral Field of View (FoV) of the system, defined by the light sheet, typically limit each other due to the spatial band product of the excitation objective. Here, we develop a simple multi focus scheme to extend the FoV, where a Gaussian light sheet can be focused at three or more consecutive positions. Axially overlapped multiple light sheets significantly enlarge the FoV with improved uniformity and negligible loss in axial resolution. By measuring the point spread function of fluorescent beads, we demonstrated that the obtained light sheet has a FoV of 450 um and a maximum axial FWHM of 7.5 um. Compared with the conventional single focus one, the multi focus Gaussian light sheet displays a significantly improved optical sectioning ability over the full FoV when imaging cells and zebrafish.


Unsupervised Energy based Out of distribution Detection using Stiefel Restricted Kernel Machine. Detecting out of distribution (OOD) samples is an essential requirement for the deployment of machine learning systems in the real world. Until now, research on energy based OOD detectors has focused on the softmax confidence score from a pre trained neural network classifier with access to class labels. In contrast, we propose an unsupervised energy based OOD detector leveraging the Stiefel Restricted Kernel Machine (St RKM). Training requires minimizing an objective function with an autoencoder loss term and the RKM energy where the interconnection matrix lies on the Stiefel manifold. Further, we outline multiple energy function definitions based on the RKM framework and discuss their utility. In the experiments on standard datasets, the proposed method improves over the existing energy based OOD detectors and deep generative models. Through several ablation studies, we further illustrate the merit of each proposed energy function on the OOD detection performance.


A Unique Perfect Power Decagonal Number. Let mathcal P s(n) denote the n th s gonal number. We consider the equation mathcal P s(n) y m, for integers n,s,y, and m . All solutions to this equation are known for m 2 and s in 3,5,6,8,20 . We consider the case s 10 , that of decagonal numbers. Using a descent argument and the modular method, we prove that the only decagonal number 1 expressible as a perfect m th power with m 1 is mathcal P 10 (3) 3 3 .


Star shaped acceptability indexes. We propose the star shaped acceptability indexes as generalizations of both the approaches of Cherny and Madan (2009) and Rosazza Gianin and Sgarra (2013) in the same vein as star shaped risk measures generalize both the classes of coherent and convex risk measures. We characterize acceptability indexes through star shaped risk measures, star shaped acceptance sets, and as the minimum of some family of quasi concave acceptability indexes. Further, we introduce concrete examples under our approach linked to Value at Risk, risk adjusted reward on capital, reward based gain loss ratio, monotone reward deviation ratio, and robust acceptability indexes. We also expose an application regarding optimization of performance.


Complex vs convex Morse functions and geodesic open books. Suppose that Sigma is a closed and oriented surface equipped with a Riemannian metric. In the literature, there are four seemingly distinct constructions of open books on the unit (co)tangent bundle of Sigma , having complex, symplectic, contact, and dynamical flavors, respectively. Each one of these constructions is based on either an admissible divide or an ordered Morse function on Sigma . We show that the resulting open books are pairwise isomorphic provided that the ordered Morse function is adapted to the admissible divide on Sigma . Moreover, we observe that if Sigma has positive genus, then none of these open books are planar and furthermore, we determine the only cases when they have genus one pages.


Selectable Set Randomized Kaczmarz. The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK that leverages existing information about the Kaczmarz iterate to identify an adaptive "selectable set" and thus yields an improved convergence guarantee. In this paper, we propose a general perspective for selectable set approaches and prove a convergence result for that framework. In addition, we define two specific selectable set sampling strategies that have competitive convergence guarantees to those of other variants of RK. One selectable set sampling strategy leverages information about the previous iterate, while the other leverages the orthogonality structure of the problem via the Gramian matrix. We complement our theoretical results with numerical experiments that compare our proposed rules with those existing in the literature.


Geodesic stars in random geometry. A point of a metric space is called a geodesic star with m arms if it is the endpoint of m disjoint geodesics. For every m in 1,2,3,4 , we prove that the set of all geodesic stars with m arms in the Brownian sphere has dimension 5 m . This complements recent results of Miller and Qian, who proved that this dimension is smaller than or equal to 5 m .


Convex characters, algorithms and matchings. Phylogenetic trees are used to model evolution leaves are labelled to represent contemporary species ("taxa") and interior vertices represent extinct ancestors. Informally, convex characters are measurements on the contemporary species in which the subset of species (both contemporary and extinct) that share a given state, form a connected subtree. In cite KelkS17 it was shown how to efficiently count, list and sample certain restricted subfamilies of convex characters, and algorithmic applications were given. We continue this work in a number of directions. First, we show how combining the enumeration of convex characters with existing parameterised algorithms can be used to speed up exponential time algorithms for the emph maximum agreement forest problem in phylogenetics. Second, we re visit the quantity g 2(T) , defined as the number of convex characters on T in which each state appears on at least 2 taxa. We use this to give an algorithm with running time O( phi n cdot text poly (n) ) , where phi approx 1.6181 is the golden ratio and n is the number of taxa in the input trees, for computation of emph maximum parsimony distance on two state characters . By further restricting the characters counted by g 2(T) we open an interesting bridge to the literature on enumeration of matchings. By crossing this bridge we improve the running time of the aforementioned parsimony distance algorithm to O( 1.5895 n cdot text poly (n) ) , and obtain a number of new results in themselves relevant to enumeration of matchings on at most binary trees.


Mutually annihilating matrices, and a Cohen Lenstra series for the nodal singularity. We give a generating function for the number of pairs of n times n matrices (A, B) over a finite field that are mutually annihilating, namely, AB BA 0 . This generating function can be viewed as a singular analogue of a series considered by Cohen and Lenstra. We show that this generating function has a factorization that allows it to be meromorphically extended to the entire complex plane. We also use it to count pairs of mutually annihilating nilpotent matrices. This work is essentially a study of the motivic aspects about the variety of modules over mathbb C u,v (uv) as well as the moduli stack of coherent sheaves over an algebraic curve with nodal singularities.


Near Optimal Bounds for Generalized Orthogonal Procrustes Problem via Generalized Power Method. Given multiple point clouds, how to find the rigid transform (rotation, reflection, and shifting) such that these point clouds are well aligned? This problem, known as the generalized orthogonal Procrustes problem (GOPP), has found numerous applications in statistics, computer vision, and imaging science. While one commonly used method is finding the least squares estimator, it is generally an NP hard problem to obtain the least squares estimator exactly due to the notorious nonconvexity. In this work, we apply the semidefinite programming (SDP) relaxation and the generalized power method to solve this generalized orthogonal Procrustes problem. In particular, we assume the data are generated from a signal plus noise model each observed point cloud is a noisy copy of the same unknown point cloud transformed by an unknown orthogonal matrix and also corrupted by additive Gaussian noise. We show that the generalized power method (equivalently alternating minimization algorithm) with spectral initialization converges to the unique global optimum to the SDP relaxation, provided that the signal to noise ratio is high. Moreover, this limiting point is exactly the least squares estimator and also the maximum likelihood estimator. In addition, we derive a block wise estimation error for each orthogonal matrix and the underlying point cloud. Our theoretical bound is near optimal in terms of the information theoretic limit (only loose by a factor of the dimension and a log factor). Our results significantly improve the state of the art results on the tightness of the SDP relaxation for the generalized orthogonal Procrustes problem, an open problem posed by Bandeira, Khoo, and Singer in 2014.


Personalization and Recommendation Technologies for MaaS. Over the last few years, MaaS has been extensively studied and evolved into offering a multitude of mobility services that continuously increase, from alternative car or bike sharing modes to autonomous vehicles, that aspire to become a part of this novel ecosystem. MaaS provides end users with multimodal, integrated, and digital mobility solutions, including a multitude of different choices able to cover users specific needs in a personalized manner. This practically leads to a range of novel MaaS products, that may have complex structures and the challenge of matching them to user preferences and needs so that suitable products can be provided to end users. Moreover, in the everyday use of MaaS, travelers require support to identify routes to reach their destination that adhere to their personal preferences and are aligned to the MaaS product they have purchased. This paper tackles these two user centric challenges by exploiting state of the art techniques from the field of Personalization and Recommendation systems and integrating them in MaaS platforms and route planning applications.


A series approximation to the Kirchhoff integral for Gaussian and exponential roughness covariance functions. The Kirchhoff integral is a fundamental integral in scattering theory, appearing in both the Kirchhoff approximation, as well as the small slope approximation. In this work, a functional Taylor series approximation to the eps converted to.pdf Kirchhoff integral is presented, under the condition that the roughness covariance function follows either an exponential or Gaussian form in both the one dimensional and two dimensional cases. Previous approximations to the Kirchhoff integral Gragg et al. J. Acoust. Soc. Am. 2001, Drumheller and Gragg J. Acoust. Soc. Am., 2001 assumed that the outer scale of the roughness was very large compared to the wavelength, whereas the proposed method can treat arbitrary outer scales. Assuming an infinite outer scale implies that the root mean square (rms) roughness is infinite. The proposed method can efficiently treat surfaces with finite outer scale, and therefore finite rms height. This series is shown to converge independently of roughness or acoustic parameters, and converges to within roundoff error with a reasonable number of terms for a wide variety of dimensionless roughness parameters. The series converges quickly when the dimensionless rms height is small, and slowly when it is large.


Expressing and Exploiting the Common Subgoal Structure of Classical Planning Domains Using Sketches Extended Version. Width based planning methods deal with conjunctive goals by decomposing problems into subproblems of low width. Algorithms like SIW thus fail when the goal is not easily serializable in this way or when some of the subproblems have a high width. In this work, we address these limitations by using a simple but powerful language for expressing finer problem decompositions introduced recently by Bonet and Geffner, called policy sketches. A policy sketch over a set of Boolean and numerical features is a set of sketch rules that express how the values of these features are supposed to change. Like general policies, policy sketches are domain general, but unlike policies, the changes captured by sketch rules do not need to be achieved in a single step. We show that many planning domains that cannot be solved by SIW are provably solvable in low polynomial time with the SIW R algorithm, the version of SIW that employs user provided policy sketches. Policy sketches are thus shown to be a powerful language for expressing domain specific knowledge in a simple and compact way and a convenient alternative to languages such as HTNs or temporal logics. Furthermore, they make it easy to express general problem decompositions and prove key properties of them like their width and complexity.


Combining Particle Swarm Optimizer with SQP Local Search for Constrained Optimization Problems. The combining of a General Purpose Particle Swarm Optimizer (GP PSO) with Sequential Quadratic Programming (SQP) algorithm for constrained optimization problems has been shown to be highly beneficial to the refinement, and in some cases, the success of finding a global optimum solution. It is shown that the likely difference between leading algorithms are in their local search ability. A comparison with other leading optimizers on the tested benchmark suite, indicate the hybrid GP PSO with implemented local search to compete along side other leading PSO algorithms.


Surgery on Aut(F2). We study a geometric construction of certain finite index subgroups of Aut(F2).


Memory Enhanced Embedding Learning for Cross Modal Video Text Retrieval. Cross modal video text retrieval, a challenging task in the field of vision and language, aims at retrieving corresponding instance giving sample from either modality. Existing approaches for this task all focus on how to design encoding model through a hard negative ranking loss, leaving two key problems unaddressed during this procedure. First, in the training stage, only a mini batch of instance pairs is available in each iteration. Therefore, this kind of hard negatives is locally mined inside a mini batch while ignoring the global negative samples among the dataset. Second, there are many text descriptions for one video and each text only describes certain local features of a video. Previous works for this task did not consider to fuse the multiply texts corresponding to a video during the training. In this paper, to solve the above two problems, we propose a novel memory enhanced embedding learning (MEEL) method for videotext retrieval. To be specific, we construct two kinds of memory banks respectively cross modal memory module and text center memory module. The cross modal memory module is employed to record the instance embeddings of all the datasets for global negative mining. To avoid the fast evolving of the embedding in the memory bank during training, we utilize a momentum encoder to update the features by a moving averaging strategy. The text center memory module is designed to record the center information of the multiple textual instances corresponding to a video, and aims at bridging these textual instances together. Extensive experimental results on two challenging benchmarks, i.e., MSR VTT and VATEX, demonstrate the effectiveness of the proposed method.


p nilpotency criteria for some verbal subgroups. Let G be a finite group, let p be a prime and let w be a group word. We say that G satisfies P(w,p) if the prime p divides the order of xy for every w value x in G of p' order and for every non trivial w value y in G of order divisible by p . If k geq 2 , we prove that the k th term of the lower central series of G is p nilpotent if and only if G satisfies P( gamma k,p) . In addition, if G is soluble, we show that the k th term of the derived series of G is p nilpotent if and only if G satisfies P( delta k,p) .


Normal vs. Adversarial Salience based Analysis of Adversarial Samples for Relation Extraction. Recent neural based relation extraction approaches, though achieving promising improvement on benchmark datasets, have reported their vulnerability towards adversarial attacks. Thus far, efforts mostly focused on generating adversarial samples or defending adversarial attacks, but little is known about the difference between normal and adversarial samples. In this work, we take the first step to leverage the salience based method to analyze those adversarial samples. We observe that salience tokens have a direct correlation with adversarial perturbations. We further find the adversarial perturbations are either those tokens not existing in the training set or superficial cues associated with relation labels. To some extent, our approach unveils the characters against adversarial samples. We release an open source testbed, "DiagnoseAdv" in https github.com zjunlp DiagnoseAdv.


TimeTraveler Reinforcement Learning for Temporal Knowledge Graph Forecasting. Temporal knowledge graph (TKG) reasoning is a crucial task that has gained increasing research interest in recent years. Most existing methods focus on reasoning at past timestamps to complete the missing facts, and there are only a few works of reasoning on known TKGs to forecast future facts. Compared with the completion task, the forecasting task is more difficult that faces two main challenges (1) how to effectively model the time information to handle future timestamps? (2) how to make inductive inference to handle previously unseen entities that emerge over time? To address these challenges, we propose the first reinforcement learning method for forecasting. Specifically, the agent travels on historical knowledge graph snapshots to search for the answer. Our method defines a relative time encoding function to capture the timespan information, and we design a novel time shaped reward based on Dirichlet distribution to guide the model learning. Furthermore, we propose a novel representation method for unseen entities to improve the inductive inference ability of the model. We evaluate our method for this link prediction task at future timestamps. Extensive experiments on four benchmark datasets demonstrate substantial performance improvement meanwhile with higher explainability, less calculation, and fewer parameters when compared with existing state of the art methods.


The sharp upper bound for the area of the nodal sets of Dirichlet Laplace eigenfunctions. Let Omega be a bounded domain in mathbb R n with C 1 boundary and let u lambda be a Dirichlet Laplace eigenfunction in Omega with eigenvalue lambda . We show that the (n 1) dimensional Hausdorff measure of the zero set of u lambda does not exceed C( Omega) sqrt lambda . This result is new even for the case of domains with C infty smooth boundary.


RL CSDia Representation Learning of Computer Science Diagrams. Recent studies on computer vision mainly focus on natural images that express real world scenes. They achieve outstanding performance on diverse tasks such as visual question answering. Diagram is a special form of visual expression that frequently appears in the education field and is of great significance for learners to understand multimodal knowledge. Current research on diagrams preliminarily focuses on natural disciplines such as Biology and Geography, whose expressions are still similar to natural images. Another type of diagrams such as from Computer Science is composed of graphics containing complex topologies and relations, and research on this type of diagrams is still blank. The main challenges of graphic diagrams understanding are the rarity of data and the confusion of semantics, which are mainly reflected in the diversity of expressions. In this paper, we construct a novel dataset of graphic diagrams named Computer Science Diagrams (CSDia). It contains more than 1,200 diagrams and exhaustive annotations of objects and relations. Considering the visual noises caused by the various expressions in diagrams, we introduce the topology of diagrams to parse topological structure. After that, we propose Diagram Parsing Net (DPN) to represent the diagram from three branches topology, visual feature, and text, and apply the model to the diagram classification task to evaluate the ability of diagrams understanding. The results show the effectiveness of the proposed DPN on diagrams understanding.


Text line extraction using fully convolutional network and energy minimization. Text lines are important parts of handwritten document images and easier to analyze by further applications. Despite recent progress in text line detection, text line extraction from a handwritten document remains an unsolved task. This paper proposes to use a fully convolutional network for text line detection and energy minimization for text line extraction. Detected text lines are represented by blob lines that strike through the text lines. These blob lines assist an energy function for text line extraction. The detection stage can locate arbitrarily oriented text lines. Furthermore, the extraction stage is capable of finding out the pixels of text lines with various heights and interline proximity independent of their orientations. Besides, it can finely split the touching and overlapping text lines without an orientation assumption. We evaluate the proposed method on VML AHTE, VML MOC, and Diva HisDB datasets. The VML AHTE dataset contains overlapping, touching and close text lines with rich diacritics. The VML MOC dataset is very challenging by its multiply oriented and skewed text lines. The Diva HisDB dataset exhibits distinct text line heights and touching text lines. The results demonstrate the effectiveness of the method despite various types of challenges, yet using the same parameters in all the experiments.


Connectivity of Alternating Sign Triangle. Alternating sign triangles were introduced by Carroll and Speyer in relation to cube recurrence, by analogy to alternating sign matrices for octahedron recurrence. In this paper, we prove the connectivity of alternating sign triangles, which is analogous to the connectivity of alternating sign matrices.


An impossible utopia in distance geometry. The Distance Geometry Problem asks for a realization of a given weighted graph in mathbb R K . Two variants of this problem, both originating from protein conformation, are based on a given vertex order (which abstracts the protein backbone). Both variants involve an element of discrete decision in the realization of the next vertex in the order using K preceding (already realized) vertices. The difference between these variants is that one requires the K preceding vertices to be contiguous. The presence of this constraint allows one to prove, via a combinatorial counting of the number of solutions, that the realization algorithm is fixed parameter tractable. Its absence, on the other hand, makes it possible to efficiently construct the vertex order directly from the graph. Deriving a combinatorial counting method without using the contiguity requirement would therefore be desirable. In this paper we prove that, unfortunately, such a counting method cannot be devised in general.


Flexible Joint Manipulator Trajectory Tracking with Learned Two Stage Model employing One Step Future Prediction. Flexible joint manipulators are frequently used for increased safety during human robot collaboration and shared workspace tasks. However, joint flexibility significantly reduces the accuracy of motion, especially at high velocities and with inexpensive actuators. In this paper, we present a learning based approach to identify the unknown dynamics of a flexible joint manipulator and improve the trajectory tracking at high velocities. We propose a two stage model which is composed of a one step forward dynamics future predictor and an inverse dynamics estimator. The second part is based on linear time invariant dynamical operators to approximate the feed forward joint position and velocity commands. We train the model end to end on real world data and evaluate it on the Baxter robot. Our experiments indicate that augmenting the input with one step future state prediction improves the performance, compared to the same model without prediction. We compare joint position, joint velocity and end effector position tracking accuracy against the classical baseline controller and several simpler models.


LocalTrans A Multiscale Local Transformer Network for Cross Resolution Homography Estimation. Cross resolution image alignment is a key problem in multiscale gigapixel photography, which requires to estimate homography matrix using images with large resolution gap. Existing deep homography methods concatenate the input images or features, neglecting the explicit formulation of correspondences between them, which leads to degraded accuracy in cross resolution challenges. In this paper, we consider the cross resolution homography estimation as a multimodal problem, and propose a local transformer network embedded within a multiscale structure to explicitly learn correspondences between the multimodal inputs, namely, input images with different resolutions. The proposed local transformer adopts a local attention map specifically for each position in the feature. By combining the local transformer with the multiscale structure, the network is able to capture long short range correspondences efficiently and accurately. Experiments on both the MS COCO dataset and the real captured cross resolution dataset show that the proposed network outperforms existing state of the art feature based and deep learning based homography estimation methods, and is able to accurately align images under 10 times resolution gap.


Benchmarking real time monitoring strategies for ethanol production from lignocellulosic biomass. The goal of this paper is to review and critically assess different methods to monitor key process variables for ethanol production from lignocellulosic biomass. Because cellulose based biofuels cannot yet compete with non cellulosic biofuels, process control and optimization are of importance to lower the production costs. This study reviews different monitoring schemes, to indicate what the added value of real time monitoring is for process control. Furthermore, a comparison is made on different monitoring techniques to measure the off gas, the concentrations of dissolved components in the inlet to the process, the concentrations of dissolved components in the reactor, and the biomass concentration. Finally, soft sensor techniques and available models are discussed, to give an overview of modeling techniques that analyze data, with the aim of coupling the soft sensor predictions to the control and optimization of cellulose to ethanol fermentation. The paper ends with a discussion of future needs and developments.